Are you a visionary cloud data architect ready to shape the future of enterprise analytics We're seeking a passionate Lead Engineer Azure Databricks to join our high-impact Business Analytics/BI team as a senior technical leader. This is a career-defining opportunity to architect scalable, secure, and high-performance cloud data platforms that power reporting, advanced analytics, and AI/ML innovation across the organization.
In this strategic role, you will own the end-to-end cloud data architecture strategy, drive our analytics modernization journey, and lead the migration of legacy Enterprise Data Warehouses to a modern Azure Databricks Lakehouse ecosystem. You'll partner closely with IT leadership, business stakeholders, and analytics teams to deliver best-in-class, governed data solutions that accelerate insights and business value.
Exp: 9 to 13 years
Location: Gurugram
Shift: 2-11pm
Key Responsibilities
- Design and govern enterprise-scale cloud data platforms (data lakes, Lakehouse, and cloud data warehouses) supporting BI/EDW, analytics, and AI/ML workloads
- Architect and implement Databricks Lakehouse solutions using Delta Lake and Medallion (Bronze/Silver/Gold) patterns
- Lead the full lifecycle of legacy EDW migration to Azure, including phased strategies, data refactoring, and seamless integration with enterprise systems
- Establish architecture standards, best practices, CI/CD pipelines, and data governance frameworks (Unity Catalog, RBAC, encryption)
- Provide day-to-day technical leadership, mentoring, and prioritization to a team of data engineers and vendor partners
- Deliver high-performance batch and real-time ingestion pipelines using PySpark, SQL, Databricks Workflows, Delta Live Tables, and Structured Streaming
- Optimize cost, performance, and reliability while enabling self-service analytics and trusted data products for BI teams
What You'll Bring
- 10+ years designing and delivering enterprise data & analytics platforms, with proven hands-on expertise in Azure Databricks, Delta Lake, and Lakehouse architectures
- Advanced proficiency in SQL, Python, PySpark, Spark SQL, and modern cloud data services
- Strong experience modernizing legacy EDW environments and building governed, scalable data platforms
- Demonstrated leadership in architecture reviews, design discussions, and guiding cross-functional teams
- Solid understanding of data governance, security, compliance, and quality frameworks
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field
- Experience with SAP ERP analytics integration (S/4HANA or ECC) is a strong asset; familiarity with Power BI/Tableau and Microsoft Fabric is a plus
- Bonus: Exposure to AI/ML-ready data platforms or Agentic AI concepts
