Data Engineer

Roles Responsibilities

1 Deploy and validate ADF pipelines Databricks notebooks Key Vault configurations Logic Apps Azure Synapse using Azure Devops CICD Pipelines and SQL scripts via SSMS

2 Build maintain and enhance CICD pipelines in Azure DevOps for data platforms

3 Handling of regular and hotfix deployments

4 Handle Branching code push pushdown code merges using Azure Devops

5 Identify and resolve merge conflicts and manage outdated or inactive pull requests

6 Perform cherrypicking and rollback of code for Azure Data Factory Azure Databricks Logic Apps

7 Troubleshoot and resolve CICD and deployment failures ensuring production stability

8 Manage Databricks clusters Azure SQL Configurations through Ansible scripts

9 Maintain Release Management trackersRelease Notes Deployment Calendars and communicate deployment status to stakeholders

10 Manage release and deployment activities across Dev Test and Production environments

Must Have Skills

1 Experience with deploying Azure Data Factory Azure Databricks PySparkSpark SQL Logic Apps Azure Synapse and Azure SQL

2 Experience in deploying and managing Azure Key Vault Secrets

3 Should have knowledge about Data Products

4 Expertise in Azure DevOps including Repos CICD Pipelines and Release Management Solid understanding of CICD concepts deployment strategiesregular deployments hotfix deployment and environment promotion

5 Proficiency in Azure Devops branching strategies merge conflict resolution cherrypicking and rollback

6 Working knowledge of Ansible scripting to extend or modify CICD pipelines

7 Strong troubleshooting and problemsolving skills in complex deployment scenarios

8 Good communication skills and experience in clientfacing and crossteam collaboration