Azure Data Engineering ETL/ELT Pipelines Data Lake Cloud Data Modernization
Experience: 5+ Years
Locations: Hyderabad | Bengaluru | Pune | Chennai
About The Role
We are seeking an experienced
Azure Data Engineer to design, develop, and optimize scalable cloud-based data solutions on the Microsoft Azure platform. The ideal candidate will build high-performance ETL/ELT pipelines, implement modern data lake architectures, and enable enterprise analytics using Azure-native data services. You will collaborate with cross-functional teams to deliver reliable, secure, and scalable data platforms.
About The Program
SWITS DIGITAL is supporting enterprise customers in modernizing their data ecosystem by migrating legacy data platforms to Microsoft Azure. The program focuses on developing cloud-native data pipelines, implementing modern data lake and warehouse architectures, optimizing enterprise reporting, and enabling advanced analytics through Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Power BI.
Required Skills
- Azure Data Factory (ADF)
- Azure Databricks
- PySpark
- Azure Data Lake Storage (ADLS Gen2)
- Azure Synapse Analytics
- SQL / T-SQL
- Power BI
- Azure SQL Database
- Azure DevOps
- Git
- Python
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation workflows using Azure Databricks and PySpark.
- Develop and maintain cloud-based data lakes using Azure Data Lake Storage (ADLS Gen2).
- Create, optimize, and manage analytical data models using Azure Synapse Analytics.
- Develop complex SQL queries, stored procedures, and performance tuning strategies.
- Integrate data from multiple on-premises and cloud-based data sources into Azure.
- Implement data quality, monitoring, governance, and validation frameworks.
- Collaborate with Data Architects, BI Developers, QA teams, and business stakeholders.
- Support CI/CD deployment using Azure DevOps and Git.
- Troubleshoot and optimize Azure data pipelines for scalability and performance.
Qualifications
- 5+ years of Data Engineering experience.
- Strong hands-on experience with Azure Data Factory, Azure Databricks, and PySpark.
- Expertise in SQL/T-SQL, ETL/ELT development, and data modeling.
- Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Synapse Analytics.
- Good understanding of cloud data architecture and data warehousing concepts.
- Knowledge of Azure DevOps, Git, and CI/CD practices.
- Experience with Power BI datasets and semantic models is an added advantage.
- Excellent analytical, problem-solving, and communication skills.
