Databricks - Principal Data Engineer

12-14 Years

This job is no longer accepting applications

Job Description

Core Responsibilities:

Databricks Architecture — Design, optimize, and manage end‑to‑end data pipelines using Databricks (Spark, Delta Lake, Unity Catalog).
ETL/ELT Pipelines — Build scalable ingestion and transformation frameworks for structured and semi‑structured data.
Cloud Platforms — Implement solutions on Azure/AWS/GCP with strong understanding of compute, storage, and networking.
Data Warehouse Modernization — Lead migration from legacy systems to modern lakehouse architectures.
Team Leadership — Mentor engineers, conduct design reviews, and drive delivery excellence.
Customer Engagement — Lead technical discussions, requirement workshops, and solution walkthroughs.

Required Skills & Qualifications

Databricks Expertise: Deep knowledge of Unity Catalog, Photon engine, Databricks SQL, and optimization.
Cloud Infrastructure: Proven experience architecting scalable data solutions on Azure, AWS, or GCP.
Data Warehousing: Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning.
Soft Skills: Exceptional analytical thinking, stakeholder management, and clear technical articulation.
Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, DevOps.
Experience with large‑scale DWH, performance tuning, and data modeling.
Proven ability to lead multi‑team delivery in enterprise environments.
Total Experience: 12 years
Relevant Experience: 7 years in Databricks and cloud data engineering
Location: Hybrid
Employment Type: Full-time