Azure Data Engineer Lead

Role: Azure Data Engineer Lead

Experience: 8–10 Years

Location: Chennai, Bangalore

Key Skills: Azure Data Engineering, Azure Databricks, Azure Data Factory, PySpark, SQL

About The Role

We are looking for a hands-on Azure Data Engineer Lead to architect, build, and scale enterprise-grade data platforms on Microsoft Azure. You will lead a team of data engineers, define best practices, and partner with architects, analysts, and business stakeholders to turn raw data into reliable, high-performance pipelines that power analytics, reporting, and AI initiatives.

Key Responsibilities

• Lead the design, development, and optimization of scalable data pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics
• Architect modern data lakehouse solutions using ADLS Gen2, Delta Lake, and Synapse/Fabric
• Define and enforce data engineering standards, coding guidelines, and CI/CD practices across the team
• Own end-to-end data architecture — ingestion, transformation, orchestration, and governance
• Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable technical solutions
• Optimize pipeline performance, cost, and reliability across large-scale distributed datasets
• Implement robust data quality, security, lineage, and monitoring frameworks (Purview, Key Vault, Log Analytics)
• Mentor and guide a team of data engineers; conduct code reviews and technical design sessions
• Drive cloud cost optimization and adherence to Azure Well-Architected Framework principles
• Stay current with emerging Azure data services and evaluate their adoption
  
  

Required Skills

• Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2
• Proficiency in PySpark, SQL, and Python for large-scale data processing
• Experience with Delta Lake / Lakehouse architecture
• Strong understanding of data modeling (dimensional, star/snowflake schema)
• Experience with CI/CD pipelines (Azure DevOps) and Infrastructure-as-Code (Terraform/ARM/Bicep)
• Solid grasp of data governance, security, and compliance (RBAC, Azure Purview, encryption)
• Experience leading teams and managing project delivery in an Agile environment
• Strong communication and stakeholder management skills
  
  

Good To Have

• Experience with Microsoft Fabric / Power BI
• Exposure to Azure Event Hub / Stream Analytics for real-time processing
• Knowledge of MLOps or integration with Azure Machine Learning
• Microsoft certifications: DP-203 (Azure Data Engineer Associate), Azure Solutions Architect
  
  

Why Join Us

• Work on cutting-edge cloud data platforms at enterprise scale
• Lead a talented team and shape data engineering practices from the ground up
• Competitive compensation, flexible work model, and continuous learning opportunities
  
  

Skills: databricks,pyspark,azure databricks,azure data engineering,azure data factory,sql,azure data engineer