Azure Devops with Databricks and Datafactory

Job Title: Azure DevOps Engineer – ADF & Azure Databricks

Location: Bangalore

Key Responsibilities

• Design, implement, and maintain robust Azure DevOps CI/CD pipelines.
• Automate application deployment, testing, and infrastructure provisioning.
• Manage and optimize Azure cloud environments.
• Implement and maintain Infrastructure as Code (IaC) using Terraform.
• Configure and support source control repositories using Git and Azure Repos.
• Manage, deploy, and support Azure Data Factory (ADF) and Azure Databricks (ADB) environments and workloads.
• Develop and maintain CI/CD pipelines for ADF and ADB deployments.
• Monitor application and infrastructure performance using Azure Monitor, Application Insights, and Log Analytics.
• Collaborate with development, QA, security, data engineering, and infrastructure teams to improve release efficiency.
• Implement security best practices, secrets management, and compliance controls.
• Troubleshoot deployment, performance, infrastructure, and data platform-related issues.
• Support release management and environment governance.

Mandatory Skills

Azure DevOps & CI/CD

• Strong hands-on experience with Azure DevOps.
• Experience designing and maintaining CI/CD pipelines.
• Git Version Control and Azure Repos.
• Build automation and release management.
• YAML Pipelines.

Azure Data Platforms – Mandatory

• Strong hands-on experience with Azure Data Factory (ADF).
• Strong hands-on experience with Azure Databricks (ADB).
• Experience building and managing CI/CD pipelines for ADF and ADB deployments.
• Experience supporting data processing and deployment workflows across ADF and Databricks environments.