Greetings from IndusInd Bank!!
We are currently hiring for Lead Data Engineer
Location- Mumbai
Experience- 10 to 17 Yrs
Role Details:
Lead, design, and build a cloud-native data platform on Azure, with a strong focus on Azure Databricks and modern data engineering practices. This role requires a hands-on technical leader who can architect scalable solutions while leading a team of Data Engineers and Data Analysts to deliver high-quality data products and insights.
Overall, Job Description
Data Modeling & Architecture
- Expertise in:
- Conceptual, Logical & Physical Data Modeling
- Dimensional modeling (Star/Snowflake schemas)
- Experience building models optimized for:
- Lakehouse (Databricks)
- Analytical workloads
- Strong understanding of:
- Data partitioning, indexing, data skipping, caching techniques
Programming & Transformation
- Strong hands-on skills in:
- PySpark (mandatory)
- Python for data transformation and automation
- Experience implementing:
- Data pipelines using Databricks workflows / jobs
- Reusable transformation frameworks
Integration & Advanced Capabilities
- Experience with:
- API integration and data ingestion frameworks
- CI/CD in Azure (Azure DevOps, Git integration with Databricks)
- Infrastructure as Code (ARM templates / Terraform – good to have)
Analytics & BI
- Experience integrating data platforms with:
- Power BI (preferred)
- Ability to:
- Create semantic layers and datasets for business consumption
- Enable self-service analytics
Good to Have
- Knowledge of:
- Azure Purview / Microsoft Fabric (emerging tools)
- Data governance frameworks
- Streaming analytics and real-time pipelines
Key Responsibilities
- Hands-On Technical Leadership
- Lead by example with active hands-on development in Azure Databricks
- Design and implement:
- Scalable lakehouse architectures
- High-performance data pipelines
- Review and guide code, architecture, and best practices across the team
Team Leadership
- Manage and mentor a team of:
- Data Engineers
- Data Analysts
- Drive best practices in:
- Code quality
- Data engineering standards
- Agile delivery
Architecture & Solution Design
- Translate business needs into:
- End-to-end Azure data architecture
- Scalable and reusable data models
- Define standards for:
- Data ingestion, transformation, storage, and serving layers
Stakeholder Engagement
- Collaborate with business stakeholders to:
- Understand requirements
- Translate into technical solutions
- Deliver actionable insights
- Act as the primary data advisor for the business vertical
Data Governance & Quality
- Implement and enforce:
- Data governance policies
- Data quality frameworks
- Metadata management (cataloging, lineage)
Optimization & Innovation
- Continuously optimize:
- Databricks jobs (performance & cost)
- Data storage and query performance
- Stay current with:
- Azure and Databricks advancements
- Modern data engineering practices (Medallion architecture, DataOps)
Education and Work Experience Requirements:
EDUCATION
Essential requirements:
- Bachelor's degree in Computer Science or equivalent
- Preferred certifications:
- Azure Data Engineer (DP-203)
- Azure Fundamentals (AZ-900)
- Databricks certifications (Associate/Professional)
Preferred: Technical Skills
Core Data Engineering (Must-Have)
- Deep expertise in Azure Data Platform, including:
- Azure Databricks (core focus) – Spark (PySpark/Scala), Delta Lake, notebooks, workflow orchestration
- Azure Data Factory (ADF) – pipeline orchestration, integration runtime, monitoring
- Azure Data Lake (ADLS Gen2) – storage design, partitioning strategies
- Azure Synapse Analytics – data warehousing and SQL analytics
- Strong hands-on experience with:
- Data lakehouse architecture (Delta Lake preferred)
- ETL/ELT frameworks and data ingestion patterns
- Streaming (good to have): Structured Streaming, Event Hub, Kafka
WORK EXPERIENCE
- 10–17 years of overall experience
- Minimum 7+ years of hands-on experience in:
- Data engineering
- Data modeling in large-scale enterprise data platforms
- Strong experience in Azure-based data ecosystems and Databricks implementations
- Proven track record of leading data engineering and analytics teams
Interested candidates kindly share your updated profile on [Confidential Information] or apply on our ATS portal link below for better tracking:
Requition No: 87628
https://app1100.workline.hr/CandidatePortal/18999c40-0af4-47be-88b8-e594e8d8af58/Data-Warehousing-Engineer-Job-in-IBL-House-Office-86846
