Databricks Data Engineer

'We are seeking a Databricks Data Engineer to design, develop, and optimize scalable data pipelines supporting enterprise analytics, AI/ML, and Agentic AI solutions.

The ideal candidate should have strong hands-on experience with Azure Databricks, Apache Spark (PySpark), Spark SQL, and Delta Lake for building batch and streaming data pipelines.

Experience with Azure Data Lake Storage, Unity Catalog, Kafka/Event Hubs, and data integration patterns is essential. The role requires expertise in ETL/ELT development, Lakehouse architecture, and data quality best practices.

Candidates should be proficient in Python, SQL, Git-based CI/CD, and Terraform.

Experience with Azure cloud services and performance tuning of Spark workloads is highly desirable.

The engineer will collaborate with data scientists, MLOps engineers, and platform teams to deliver reliable, governed, and scalable data solutions.

Strong analytical, troubleshooting, and communication skills are essential in a collaborative enterprise environment.