Lead Databricks

JOB DESCRIPTION

Location: Pune (Kharadi / Baner) / Mumbai (BKC), Bangalore (Manyata Tech Park

About the Role

We are seeking an experienced Tech Lead with strong Databricks expertise to drive the

implementation of Lakehouse architecture and

scalable ELT pipelines.

The role involves close collaboration with architects and stakeholders to deliver secure, high-

performance data solutions for banking

and financial services use cases.

Experience

• 5 to 10 years of overall experience in Data Engineering

• 3 to 4 years of hands-on experience in Databricks

Key Responsibilities

Develop and manage ELT pipelines using Databricks and implement Medallion Architecture (Bronze,

Silver, Gold

layers)

• Optimize PySpark jobs for performance, scalability, and cost efficiency

• Implement orchestration and CI/CD pipelines for data workflows

• Collaborate with architects and business stakeholders to translate requirements into technical

solutions

• Enforce data governance practices including RBAC, data masking, and compliance standards

• Mentor team members and ensure adherence to coding best practices

Required Skills

• Strong hands-on experience with Databricks, Apache Spark (SQL, Python), Delta Lake, and Unity

Catalog

• Experience with ELT pipelines, Databricks Workflows, and Azure Data Factory (ADF)

• Hands-on experience with cloud platforms (Azure preferred)

• Familiarity with streaming technologies such as Kafka or Azure Event Hubs

Preferred Certifications

• Databricks Associate or Professional Certification

• Microsoft Azure DP-203