Databricks Developer

Role: Databricks Developer

Location – Pune / Gurgaon

Experience: 4–8 years

Employment Type: Full-time

We're hiring a Databricks Developer to build scalable data pipelines and analytics solutions on the Databricks Lakehouse platform.

Roles & Responsibility:

1. Build data pipelines: Design and develop ETL/ELT pipelines using PySpark, SQL, and Databricks workflows for structured and semi-structured data.

2. Optimize performance: Tune Spark jobs, manage partitioning, caching, and cluster configurations to reduce cost and runtime.

3. Data modeling & storage: Implement Delta Lake tables, manage schema evolution, and ensure data quality with Unity Catalog.

4. Collaborate & deliver: Work with data analysts, scientists, and engineering teams to translate requirements into production-ready solutions.

Required Skills:

• 4–8 years in data engineering with 2+ years hands-on with Databricks and Apache Spark.
• Strong in PySpark, SQL, and Python. Experience with Delta Lake and Unity Catalog is a plus.
• Familiarity with cloud platforms – AWS, Azure, or GCP – and CI/CD for data workflows.
• Understanding of data warehousing concepts, data modeling, and performance tuning.
• Experience with orchestration tools like Airflow, ADF, or Databricks Workflows.

Nice to have

• Exposure to streaming with Structured Streaming or Kafka
• Certifications: Databricks Certified Data Engineer Associate/Professional
• Experience with MLflow for model deployment