Senior Databricks Data Engineer

Role : Senior Databricks Data Engineer

Company Name : WillWare Technologies 

Experience : 6 to 8 Years 

Work Model : Hybrid / Fulltime 

Work Location : Pune 

Role Summary:

Lead engineer driving performance tuning, cost optimization strategies, and enforcing best practices across Databricks workloads.

 Key Responsibilities:

• Analyze and optimize existing workloads for cost and performance
• Design efficient data models and scalable pipelines
• Implement advanced Spark optimization techniques (shuffle tuning, caching strategies)
• Optimize cluster utilization (instance types, spot usage, auto-termination)
• Establish coding standards and reusable frameworks
• Mentor junior engineers and conduct code reviews

Required Skills:

• Strong Databricks + Spark expertise (deep performance tuning experience)
• Advanced Delta Lake optimization techniques
• Cost optimization strategies in cloud data platforms
• Strong debugging and profiling skills