Search by job, company or skills

Lead Data Databricks

Lead Data Databricks

perficient india
9-11 Years
Not Disclosed
  • Posted 10 hours ago
  • Be among the first 10 applicants

Job Description

We are looking for a Lead Azure Databricks Engineer

Locations: #Hyderabad |#Bangalore | #Chennai | #Pune | #Nagpur

Experience: 9+ Years

Employment Type: Full-time | Hybrid (3 days work from office)

Interview Mode: Virtual followed by mandatory in-person

Notice Period: Immediate- 15 Days

Job Title:Azure Databricks Engineer (Lead or Architect)

Job Description:

We are looking for a skilled Data Engineer with strong expertise in Azure Databricks, PySpark, SQL, and Python to join our team. The ideal candidate will design, build, and optimize scalable data pipelines and support analytics initiatives on the Azure platform.

Responsibilities:

  • Design and maintain ETL/ELT pipelines using Azure Databricks
  • Write efficient PySpark and Python code for large-scale data processing
  • Develop and optimize complex SQL queries for data transformation and reporting
  • Work with Delta Lake, Azure Data Lake Storage (ADLS), and Azure Data Factory
  • Monitor and troubleshoot pipeline performance
  • Collaborate with data analysts and business teams to deliver reliable datasets

Requirements:

  • 7+ years of experience in data engineering
  • Strong hands-on skills in Azure Databricks, PySpark, SQL, and Python
  • Understanding of data pipeline design, ETL/ELT concepts, and data warehousing
  • Familiarity with Azure ecosystem tools is a plus
  • Good problem-solving and communication skills

Preferred Certifications

Databricks Certified Data Engineer Associate or Professional

Databricks Champion

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

10-12 yrs
Hyderabad
Skills:
Containerization (Docker, Distributed Systems, Kubernetes, Monitoring Tools, Automation Frameworks, AWS Databricks platform, Python application program development, Data Lake Tools, Terraform development, AI-assisted reliability workflows, Large-scale data processing, CI/CD pipelines
7-9 yrs
Hyderabad, India
Skills:
Sql, Databricks, Python, Pyspark