Azure Data Engineer

Detailed JD *(Roles and Responsibilities)

• Experience in Databricks, PL/SQL, PySpark, Python, and Azure Data Factory (ADF).
• Experience in designing, developing, and maintaining data pipelines and data streams.
• Experience in moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
• Experience in working with stakeholders to understand their data needs and provide solutions.
• Experience in collaborating with other teams to ensure data quality and consistency.
• Experience in developing and maintaining data models and data dictionaries.
• Optimize ETL processes for performance and scalability.
• Experience in developing and maintaining data integrity and accuracy
• Experience in developing and maintaining data governance policies and procedures.
• Experience in developing and maintaining data security policies and procedures.
• Good understanding of deployment processes
• Ability to manage customer handling

Flexible for support and maintenance type of project

Mandatory skills*

Databricks, PySpark, Python, Azure Data Factory (ADF)