V
Databricks Platform Engineer
V
Databricks Platform Engineer
Virtusa- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
Job Requirements
This offshore Platform Engineer role focuses on administering and operating Databricks environments, including clusters, jobs, and workflows, to support enterprise Agentic AI solutions.
Key responsibilities include managing Unity Catalog for data governance, implementing CI/CD pipelines, and enforcing security and cost controls through cluster policies.
The engineer will also oversee Spark Structured Streaming pipelines, ensuring reliable data ingestion from messaging services like Kafka.
Monitoring platform health via Azure Monitor and Dynatrace, alongside troubleshooting performance and scaling issues, is critical to the role.
Candidates require 4+ years of Databricks/Spark experience, proficiency in Terraform and Git-based CI/CD, and strong skills in Python and SQL.
The position demands a bachelor's degree, with preferred skills including Databricks certifications and familiarity with ITIL service management processes
Work Experience
7-10Years
This offshore Platform Engineer role focuses on administering and operating Databricks environments, including clusters, jobs, and workflows, to support enterprise Agentic AI solutions.
Key responsibilities include managing Unity Catalog for data governance, implementing CI/CD pipelines, and enforcing security and cost controls through cluster policies.
The engineer will also oversee Spark Structured Streaming pipelines, ensuring reliable data ingestion from messaging services like Kafka.
Monitoring platform health via Azure Monitor and Dynatrace, alongside troubleshooting performance and scaling issues, is critical to the role.
Candidates require 4+ years of Databricks/Spark experience, proficiency in Terraform and Git-based CI/CD, and strong skills in Python and SQL.
The position demands a bachelor's degree, with preferred skills including Databricks certifications and familiarity with ITIL service management processes
Work Experience
7-10Years
More Info
Key Skills
Spark Structured Streaming
Unity Catalog
CI/CD pipelines
Databricks certifications
Cluster policies
Azure Monitor
Git-based CI/CD
About Company
