DataBricks Engineer_Virtual Drive_9-JAN

Hello, Good Day!

JOB Description :-

Tech Stack & Essential Tools :

• Databricks.
• PySpark / Python.
• SQL.
• Azure Data Factory.
• Data Lake, Azure SQL DB.
• Databases: Azure SQL server.

Good to Know : CI / CD (Continuous Integration / Continuous Delivery or Deployment): Azure DevOps, Mongo DB, Datadog and Splunk.

Key Responsibilities :

• Understand the Python code written in the DataBricks notebooks , troubleshoot & Identify the bugs in the code in case of any issues
• Monitor and troubleshoot DataBricks workflows / job failures
• Monitor and troubleshoot Azure Data Factory (ADF) pipeline runs.
• Work on DataBricks / Azure Data Factory (ADF) production fixes or enhancements as needed
• Support business-critical reporting during the transformation process.
• Document processes and implement industry best practices.
• Be an active member of a global team.
• Deep understanding of modern Data Architecture, Data WareHousing concepts and Dimensional Modeling.

Required qualifications :

Working DataBricks experience & strong Apache Spark Python.

Working experience in Azure Cloud.

Good understanding of Data WareHousing / Data Lakes concepts.

Proven senior-level data support experience using Cloud technology.

Preferred certifications:

Databricks Certified Data Engineering Associate.

Azure Data Engineering (DP-203).