Azure data engineer

Azure Data Engineer Job Description

Role Overview

This role requires a highly experienced Azure Data Engineer with a strong technical background and extensive hands-on expertise in building and optimizing data pipelines on Azure. The ideal candidate will have deep experience with Azure-native data services, big data technologies, and modern cloud-based data architectures.

Mandatory Skills & Experience

Technical degree in Engineering, Computer Science, or a related field

9+ years of experience designing, developing, and delivering data pipelines and ETL/ELT solutions using Azure Data Factory

7+ years of hands-on programming experience in one or more of the following:

PowerShell

C#

Java

Python

Scala

SQL

Proven experience working with Azure data services, including:

Azure Storage (Blobs)

Azure Data Lake Storage (ADLS)

Azure SQL Database

Cosmos DB

SQL and NoSQL Data Warehousing solutions

Core Technical Skills

Data pipeline development using Databricks, Stream Analytics, and Power BI

Big data technologies, including:

Hadoop ecosystem

Spark / Spark SQL

Hive

Streaming platforms (Kafka, Event Hub)

Strong understanding of distributed systems

Ability to perform AS-IS and TO-BE analysis

Experience contributing to cloud-native data architecture and design

Key Responsibilities

Design, build, and optimize data ingestion, transformation, and curation pipelines on Azure PaaS services (storage, big data, serverless, SQL/NoSQL)

Ensure scalability, reliability, and performance of data solutions

Participate in architectural discussions and contribute to data engineering best practices and community standards

Collaborate with cross-functional teams to support analytics and business intelligence needs