Role: Lead Data Engineer (Azure)

Location: Chennai / Bangalore

Experience: 8+ years

Notice: Immediate joiners preferred

A Seasoned Vendor in AIM Research's PeMa Quadrant for Top Data Engineering Service Providers 2026 is looking for talented Azure Lead Data Engineers to join our growing team.

As a Lead Data Engineer, you will play a pivotal role in a team known for delivering enterprise-grade data engineering solutions that enable organizations to build scalable, governed, and AI-ready data platforms. In this role, you will drive the architecture, design, implementation, and optimization of modern data solutions on Microsoft Azure, leveraging technologies such as Azure Data Factory (ADF), Synapse Analytics.

You will contribute to both data platform modernization initiatives and greenfield implementations, applying proven accelerators and engineering practices that reduce development effort and accelerate business value.

Working closely with architects, engineers, and AI specialists, you will ensure the delivery of robust, high-quality data platforms that power advanced analytics, AI solutions, and business-critical decision-making across the enterprise.

Key Responsibilities:

Technical Architecture & Design

Lead technical architecture and design efforts for data engineering solution components for delivering business solutions
Design and implement scalable, secure and resilient data engineering solutions on Microsoft Azure platform, with a good understanding of data architecture patterns
Evaluate and select appropriate technology stack for data engineering solution components – cloud native services, open-source tools, data storage, data processing frameworks etc.

Data Engineering Development

Lead, mentor and manage a team of dynamic data engineers for development, testing and implementation of data pipelines ensuing quality, performance and on-time delivery
Responsible for detailed technical design and data mapping specification
Ensure adherence to industry best practices, coding standards and guidelines driving continuous improvement in code quality and delivery excellence
Optimize data solutions for performance, cost-efficiency and scalability
Ensure data quality and integrity for downstream systems and applications

Technical Project Management

Plan, prioritize and manage data engineering projects, ensuring timely delivery with quality
Identify and mitigate risks, troubleshoot issues, handle customer escalations
Ensure alignment with business requirements and priorities, working closely with stakeholders – both internal and customer

Collaboration and Documentation

Maintain comprehensive technical documentation, including architecture diagrams, high level / low level data integration design, data mapping specifications, database design etc.
Working closely with peers, BI engineers and data scientists to enable advanced analytics, machine learning models and reporting solutions

Requirements:

8+ years of hands-on experience in delivering data engineering solutions
Experience leading a team of 5+ team members, responsible for technical project management including stakeholder management, design review, code reviews and mentoring
Strong hands-on experience in Microsoft Azure platform, with experience in data engineering related services and technologies including Azure Data Factory, Azure Functions, Azure Databricks, Azure Synapse Analytics, Azure Event Hub, Azure Stream Analytics and Azure Data Lake Storage
Expertise in database concepts, SQL and relational modelling
Good understanding and experience working with NoSQL databases
Strong hands-on experience in implementing data pipelines using Python and PySpark
Good understanding of data lake and data warehouse concepts, modern data architecture patterns and industry trends in data engineering space
Hands-on experience in data modelling, with a good understanding of both ER modelling and dimensional modelling
Good understanding and experience implementing data quality management solutions
Good understanding of metadata management for data engineering solutions and data platforms
Good understanding of data governance concepts – including data stewardship, data security and data privacy management
Experience with version control tools like Git for managing version control for source code
Experience with DevOps processes, including experience implementing CI/CD pipelines for data engineering solution components
Strong analytical and problem-solving skills.
Excellent communication and collaboration skills

Good to Have:

Certifications on Azure platform, preferably related to Data Engineering
Experience working with Azure Logic Apps and API Management
Good understand and experience working with BI/visualization tools like PowerBI

Lead Data Engineer-Azure