Azure Data Engineer

Job Title: Azure Data Engineer

Job Description

We are seeking an experienced Azure Data Engineer to design, build, and maintain scalable data solutions on the Azure cloud platform. The role involves data ingestion, transformation, storage, and analytics to support business intelligence and data-driven decision-making.

Key Responsibilities

Data Ingestion & Integration

• Design and implement data pipelines to ingest data from databases, APIs, files, and streaming sources
• Use Azure Data Factory for ETL/ELT processes and orchestration

Data Transformation & Processing

• Perform large-scale data processing using Azure Databricks or Azure Synapse Analytics
• Develop and optimize data transformation workflows using Apache Spark

Data Storage & Management

• Manage data storage solutions such as Azure Data Lake, Azure Blob Storage, Azure SQL Database, and Cosmos DB
• Ensure data availability, scalability, and performance

Data Warehousing

• Design and implement data warehouse solutions using Azure Synapse Analytics
• Optimize data models for analytics and reporting

Data Modeling & Analysis

• Collaborate with analysts and data scientists to build data models
• Support analytical workloads using Azure Analysis Services or Databricks

Mandatory Skills

• Strong experience in Azure Data Factory for data integration and pipeline development
• Hands-on experience with Azure Databricks / Azure Synapse Analytics
• Expertise in data transformation and processing using Apache Spark
• Strong knowledge of data storage solutions (Data Lake, Blob Storage, Azure SQL, Cosmos DB)
• Experience in data warehousing and data modeling concepts

Good-to-Have Skills

• Experience with DevOps and automation tools (Azure DevOps, CI/CD pipelines)
• Knowledge of monitoring and logging using Azure Monitor
• Experience in automation using Azure Automation
• Familiarity with data governance and security best practices