Azure DevOps / Infrastructure Engineer

Azure DevOps / Infrastructure Engineer

Job Description: We are seeking an experienced Azure DevOps / Infrastructure Engineer with a specialisation in cloud data warehouse technologies to join our team. The ideal candidate will have in-depth expertise in data ops activities using Azure DevOps and in managing and optimizing Azure services, including Azure Data Factory, Azure Databricks, Azure Storage, Azure Synapse and AKS clsuters. You will be responsible for designing, implementing, and maintaining robust, scalable, and secure cloud infrastructure solutions, focusing on modern data warehousing and analytics platforms. This role requires availability during Eastern US working hours (e.g., 9 AM – 5 PM EST), with some flexibility as needed.

Key Responsibilities:

• Perform DevOps operations including automating infrastructure deployments, code change releases, managing configurations, and implementing monitoring and alerting systems.

• Maintain with Terraform cloud infrastructure solutions on Azure for data warehousing and analytics, ensuring high availability, scalability, and security.

• Maintain AKS clusters supporting infrastructure for custom ETL solutions.

• Manage and optimize Azure Data Factory pipelines for ETL processes, ensuring efficient data movement and transformation.

• Maintain Azure Databricks environments for big data processing, machine learning, and advanced analytics.

• Administer and manage Azure Synapse Analytics for data integration, data storage, and enterprise-scale analytics.

• Oversee the configuration and optimization of Azure Storage solutions, ensuring data is stored efficiently and securely.

• Ensure cloud infrastructure adheres to best practices for security, cost optimization, and disaster recovery.

• Troubleshoot and resolve complex infrastructure-related issues in a timely manner. • Provide technical leadership in cloud architecture design, mentoring junior engineers, and ensuring adherence to architectural best practices.

• Maintain documentation of cloud infrastructure, processes, and DevOps pipelines.

• Work closely with data engineering and data science teams to ensure seamless integration of cloud services with data warehouse environments.

• Support ongoing infrastructure monitoring, performance tuning, and capacity planning. Required Skills & Qualifications:

• 3+ years of hands-on experience in Azure cloud infrastructure.

• Solid understanding of DevOps practices, including infrastructure as code (IaC) and automation using Azure DevOps.

• Experience in managing DataOps operations for cloud data warehouse environments, including deployment automation and monitoring.

• Experience in managing AKS clusters with Argo CD solution.

• Strong expertise in Azure Data Factory, Azure Databricks, Azure Synapse, and Azure Storage.

• Proficiency with Git for version control and integration with CI/CD pipelines.

• Experience with Terraform or ARM templates for infrastructure provisioning.

• Strong knowledge of cloud security best practices, including data encryption, identity management, and access controls.

• Excellent problem-solving skills and ability to troubleshoot complex technical issues.

• Familiarity with scripting languages (e.g., PowerShell, Python) for automation tasks.

• Strong communication and collaboration skills, with the ability to work effectively across teams. Preferred Qualifications:

• Knowledge of data governance and compliance standards, particularly in cloud environments. • Experience with Claude Code.

• Experience with other cloud platforms (e.g., AWS, GCP) is a plus.