Databricks Platform Engineer / Databricks Administrator

Job Title: Databricks Platform Engineer / Databricks Administrator

Location: [Bangalore / US Shift hours (6.00 pm to 3.00 am]

Function: AWS | Databricks | Jenkins | Terraform | Python

We are seeking a highly skilled, hands-on engineer with deep expertise in Databricks, CI/CD, and cloud infrastructure on AWS. The ideal candidate should be well-versed in Databricks infrastructure management, automation, and deployment pipelines, with strong programming skills in Python.

Key Responsibilities

• Manage and maintain AWS cloud infrastructure, ensuring scalability, security, and cost efficiency
• Design, build, and manage Databricks infrastructure on AWS
• Support deployment and operationalization of Databricks-based data platforms, including cluster management and job orchestration
• Implement Infrastructure as Code (IaC) practices using tools such as Terraform or AWS CloudFormation
• Develop automation scripts and tools using Python and Shell Scripting to streamline operational processes
• Design, implement, and optimize CI/CD pipelines using CloudBees (Jenkins) to support application and data platform deployments
• Collaborate with software engineering, data engineering, and architecture teams to enable reliable and efficient delivery pipelines
• Monitor system performance, availability, and reliability using enterprise monitoring solutions
• Troubleshoot production issues and implement root cause analysis with preventive action.
  
  

Required Qualifications

• Bachelor s degree in Computer Science, Information Technology, Engineering, or related discipline
• 4+ years of experience in DevOps, cloud engineering, or related roles
• Exposure to Databricks platform (cluster setup, job execution, notebooks)
• Hands-on experience with AWS services (EC2, S3, IAM, VPC, Lambda, etc.)
• Experience with CloudBees/Jenkins for CI/CD pipeline implementation
• Experience with Git-based version control systems
• Experience in Data bricks Platform Administration - Unity Catalog, Clusters, Platform security and access management.
• Hands on Databricks Apps and Databricks Genie Admin / Configuration.
• Experience with monitoring and logging tools such as CloudWatch, DataDog
• Understanding of cloud security, networking, and system architecture principles
• Strong scripting/programming skills in Python and Groovy
• Experience working in Agile/Scrum environments