Description
We are looking for an experienced Databricks Lead – Azure to design and deliver scalable, high-performance data engineering solutions. The ideal candidate will drive architecture, optimize pipelines, and lead end-to-end implementations using Azure data platforms.
Responsibilities
- Lead design & implementation of end-to-end data engineering solutions using Azure Databricks, ADLS, and Delta Lake
- Drive architecture decisions, ensuring scalability, performance, and cost optimization
- Develop efficient data pipelines using PySpark and SQL
- Translate business requirements into robust data models and analytics solutions
- Implement best practices for data governance, security, and CI/CD
- Oversee production deployments and ensure reliability
- Mentor team members, conduct code reviews, and ensure delivery excellence
Skills and Qualifications
- 5-10 years of experience in data engineering or analytics with a focus on Databricks and Azure.
- Proficiency in Apache Spark and Databricks for big data processing.
- Strong knowledge of Azure services, including Azure Data Lake, Azure SQL Database, and Azure Data Factory.
- Experience with programming languages such as Python, Scala, or SQL.
- Familiarity with data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
- Strong communication and collaboration skills to work effectively with stakeholders.
Mandatory Skills
⭐ Desired Skills
- Databricks (advanced capabilities, optimization, and architecture exposure)
Experience Required
- Relevant Experience: 3–4 Years
- Total Experience: 5–10 Years
Additional Details
- Interview Mode: Face-to-Face
- BGC: Infosys Standard (Post Onboarding)
- Delivery SPOC: Santhoshi, Franson, Haritha
- ECMS Req ID: 562309