DevOps Engineer

Role Overview:

We are seeking an experienced Data Engineer with DevOps expertise to design, implement, and manage CI/CD pipelines, cloud infrastructure, and data platform automation. The ideal candidate will have strong hands-on experience with Azure Databricks, Snowflake, Python/Spark, and Teradata.

Key Responsibilities:

Design, build, and maintain CI/CD pipelines for data engineering and analytics workflows.

Automate deployment and monitoring of Azure Databricks clusters and jobs.

Integrate Snowflake and Teradata environments into automated workflows.

Develop and optimize Python and Spark scripts for ETL and data processing.

Implement Infrastructure as Code (IaC) using Terraform or Azure Resource Manager.

Ensure security, compliance, and cost optimization across cloud resources.

Monitor system performance and troubleshoot production issues.

Required Skills:

5+ years of experience in DevOps or related roles.

Strong experience in Azure Databricks, Snowflake, Python, Spark, and Teradata.

CI/CD tools: Azure DevOps, Jenkins, GitHub Actions.

Containerization: Docker, Kubernetes.

Azure cloud infrastructure.

Monitoring tools: Prometheus, Grafana, Azure Monitor.