Lead Data Engineer
Primary Skills
- SQL Server, Stream Analytics, CosmosDB, ETL Fundamentals, Purview, SQL, Event Hub, SQL (Basic + Advanced), Python, Data Warehousing, ADLS G2, AZure Monitoring, Synapse, Data Factory, Logic App, Modern Data Platform Fundamentals, Databricks, Data Explorer, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Blob
Specialization
- Azure Data Architecture: Principal Data Engineer
Job requirements
- Job Title: Azure Data Engineer / Modern Data Platform Engineer
Experience: 4-10 Years
Location: Gurgaon / Hybrid / As per project needs
Job Description
We are looking for an experienced
Azure Data Engineer to design, build, and optimize scalable data solutions on the
Azure Modern Data Platform. The ideal candidate will have strong hands-on experience across data ingestion, transformation, storage, and analytics using Azure-native services and strong SQL and Python skills.
Key Responsibilities
- Design, develop, and maintain data pipelines and ETL/ELT solutions using Azure Data Factory, Databricks, and Synapse Analytics
- Build and manage data ingestion from streaming and batch sources using Event Hub, Stream Analytics, and REST-based integrations
- Develop and optimize SQL Server, T-SQL, PL/SQL, stored procedures, and complex queries (basic to advanced)
- Implement data storage solutions using Azure Data Lake Storage Gen2 (ADLS G2), Azure Blob Storage, and Cosmos DB
- Create and manage enterprise data models and data warehouse solutions
- Work on near real-time analytics using Azure Data Explorer and streaming data platforms
- Implement and monitor data quality, performance, and reliability using Azure Monitoring
- Manage metadata, data governance, lineage, and compliance using Microsoft Purview
- Collaborate with business and analytics teams to translate requirements into scalable technical solutions
- Support orchestration and automation using Logic Apps
- Ensure best practices in data modeling, security, performance tuning, and cost optimization
Required Skills & Technical Expertise
Azure Data Platform
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- Azure Data Explorer
- Azure Stream Analytics
- Azure Event Hub
- Azure Monitoring
- Azure Logic Apps
Data Storage & Databases
- SQL Server
- Cosmos DB
- Azure Data Lake Storage Gen2 (ADLS G2)
- Azure Blob Storage
Programming & Query Languages
- SQL (Basic & Advanced)
- T-SQL
- PL/SQL
- Stored Procedures
- Python
Data Engineering & Architecture
- ETL / ELT Fundamentals
- Data Warehousing Concepts
- Modern Data Platform Fundamentals
- Data Modeling Fundamentals
Data Governance & Management
Good to Have
- Experience with real-time/streaming data architectures
- Exposure to analytics and reporting layers
- Cloud cost optimization and performance tuning experience
- Knowledge of CI/CD pipelines for data platforms
Soft Skills
- Strong problem-solving and analytical skills
- Good communication and stakeholder management abilities
- Ability to work independently and in agile teams
- Attention to detail and ownership mindset