Sr. Databricks Data Engineer

About Client:

One of our MNC clients offers technology consulting and digital solutions to global enterprises across industries, enabling transformative scale at unparalleled speed. With 145,000+ professionals across 90+ countries helping 1100+ clients, it provides a full spectrum of services including consulting, information technology, enterprise applications, business process services, engineering services, network services, customer experience & design services, AI & analytics, and cloud & infrastructure services. It is the first Indian company in the world to have been awarded the Sustainable Markets Initiative's Terra Carta Seal, in recognition of actively leading the charge to create a climate and nature-positive future.

Job Title : Sr. Databricks Data Engineer

Exp : 7 - 10 years

Location: Chennai

Notice Period: 0 - 15 days/ serving

Mode of Hire : Contract

Job Summary:

Required Skills:

- 5+ years experience in data engineering, with demonstrable expertise in I746.

- Strong knowledge of Python, SQL, and Spark-based data pipeline design.

- Experience with enterprise data governance, role-based security, and large-scale metadata management.

- Excellent interpersonal and communication skills for cross-functional collaboration.

Essential Tools and Utilities

- Databricks UCX Toolkit (databrickslabs/ucx): CLI and automation tool for migration, available on GitHub

- Databricks REST API and CLI: For workspace, job, asset, and access management

- Unity Catalog API

- Databricks Catalog Explorer: UI-based migration and table sync tool

- Azure CLI /PowerShell

- Databricks SQL Warehouses and Compute (standard and dedicated access modes)

- Source control (Git) and CI/CD tools for pipeline automation

- Logging, audit, and lineage tools connected to Databricks and Unity Catalog for data quality validation.