EXPERTISE AND QUALIFICATIONS
. 8+ years of overall technical experience with at least 4 years working hands-on with Microsoft Azure and Databricks.
. Experience of leading at least 2 end to end Data Lakehouse project on Azure Databricks involving Medallion Architecture.
Deep expertise in the Databricks ecosystem, including: PySpark, Notebooks, Unity Catalog, Delta Live Tables, Workflows, SQL Warehouse, Mosaic AI, AI/BI Genie.
.
. Hands-on experience building modern data platforms on Azure using tools and services such as: Azure
Databricks, Azure Data Factory, ADLS Gen2, SQL Database, Microsoft Fabric, Event Hub, Stream Analytics, Cosmos DB,
Azure Purview, Log Analytics, and Azure Explorer.
. Experience of designing and developing metadata-driven frameworks (relevant for Data Engineering processes).
. Strong programming, debugging, and performance tuning skills in Python and SQL.
. Good Experience of Data modeling (both Dimensional and 3-NF)
. Good Exposure to developing LLM/GenAI-powered applications.
. Sound understanding of CI/CD processes using Git and Jenkins or Azure DevOps.
. Familiarity with big data platforms such as Cloudera (CDH) or Hortonworks (HDP) is a plus.
. Exposure to technologies like Neo4j, Elasticsearch, and vector databases is desirable.
. Bonus: Experience with Azure infrastructure provisioning, networking, security, and governance.
Educational Background:
Bachelors degree (B.E/B.Tech) in Computer Science, Information Technology, or a related field from a reputed institute (preferred).