Role Summary
We are looking for an experienced Lead Data Engineer to drive the design and delivery of scalable data pipelines and analytics solutions. The role requires strong hands-on expertise along with the ability to guide teams and ensure high-quality execution.
Key Responsibilities
- Lead development of robust data pipelines using Azure Data Factory and Azure Databricks
- Build and optimize large-scale data processing workflows using Python/PySpark
- Collaborate with business, analytics, and engineering teams to deliver data solutions
- Ensure code quality, performance optimization, and best practices across the team
- Mentor junior engineers and conduct technical reviews
- Troubleshoot and resolve complex data and integration issues
- Contribute to CI/CD implementation and DevOps practices
- Work with modern platforms like Microsoft Fabric for unified data and analytics solutions
Required Skills
- Strong hands-on experience in Azure Data Factory and Azure Databricks
- Expertise in Python and PySpark for data processing
- Solid understanding of data warehousing and ETL/ELT concepts
- Experience with Microsoft Fabric or similar modern data platforms
- Good knowledge of data modeling and performance tuning
- Familiarity with Agile and DevOps practices
Skills: fabric,azure,data bricks,python
