Role Summary
We are seeking an experienced Senior Azure Data Engineer to design and implement robust data solutions on Azure. The role involves building scalable ETL/ELT pipelines, working with big-data processing frameworks, and collaborating with architects to deliver cloud-based data warehouse solutions. The ideal candidate will have strong hands-on expertise in Azure data services and modern data engineering practices.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using Azure Data Factory and Azure Synapse Pipelines
- Implement error handling mechanisms and optimize pipeline performance by identifying and resolving bottlenecks
- Work with Azure Databricks (PySpark), Azure Data Lake Storage (ADLS Gen 2), Azure Synapse, and Microsoft Fabric
- Collaborate with architects to design and implement Cloud Data Warehouse solutions
- Develop reporting framework layers for Power BI and Tableau
- Apply big-data processing approaches and schema-on-read methodologies
- Write efficient code in Python (PySpark) and SQL for data transformation and processing
Required Skills
- 6-10 years of hands-on experience with Azure data services
- Strong expertise in Azure Data Factory, Azure Databricks (PySpark), ADLS Gen 2, Azure Synapse, and Microsoft Fabric
- Proficiency in Python (PySpark) and SQL
- Experience designing and implementing ETL/ELT pipelines with error handling and performance tuning
- Knowledge of Cloud Data Warehouse design and implementation
- Understanding of big-data processing and schema-on-read methodologies
- Experience designing reporting frameworks for BI tools
Good-to-have Skills
- Power BI DAX development experience
- Exposure to Tableau
- Performance optimization and troubleshooting skills
Additional Information
- Shift Timings: 11:00 AM to 8:00 PM IST (Candidate must be flexible for 4-hour overlap with US hours)
- Work Mode: Hybrid 2-3 days per week from Pune office
- Project Duration: 6 months (Contract to Hire)
- Immediate to 5 weeks notice period preferred
#AzureDataEngineer #DataEngineering #AzureDataFactory #AzureDatabricks #PySpark #AzureSynapse #MicrosoftFabric #CloudDataWarehouse #ETLPipelines #BigData #PowerBI #Pune #HybridJob #C2H #DataEngineeringJobs #HiringNow
