Job Description

Responsibilities :

Key Responsibilities:

Administer and maintain Databricks workspaces, clusters, and compute policies to ensure high availability and performance.

Configure and manage user access, roles, permissions, and workspace governance aligned to security best practices.

Monitor platform health, job reliability, cluster utilization, and troubleshoot failures across notebooks, jobs, and connectivity.

Implement cost optimization practices such as cluster sizing, auto-scaling, scheduling, and usage reporting.

Support integrations with cloud services and storage, ensuring stable connectivity and secure data access patterns.

Create and maintain operational documentation, runbooks, and standard procedures for recurring administration tasks.

Partner with engineering and data teams to onboard workloads, enforce standards, and improve platform usability.

Assist with incident response, root-cause analysis, and continuous improvements to reduce operational risk.

Additional Responsibilities:

Minimum Qualifications:

Bachelor's degree or equivalent in Engineering, Computer Science, MCA, MSc, or related discipline.

3-5 years of experience in platform administration/support with hands-on Databricks Administration.

Working experience with cloud platforms and core cloud concepts (networking, IAM, storage, compute).

Experience managing access controls, policies, and operational governance in a shared environment.

Strong troubleshooting skills with the ability to analyze logs/metrics and resolve platform issues effectively. Preferred Qualifications:

Experience operating Databricks on major cloud platforms with an understanding of cloud-native security and governance.

Exposure to automation for administrative tasks and environment standardization to improve reliability and speed.

Proven ability to drive performance tuning and cost optimization for compute workloads in cloud environments.

Experience supporting multiple teams, prioritizing requests, and communicating clearly with technical and non-technical stakeholders.

Familiarity with monitoring/alerting practices and building operational dashboards for platform visibility. Good to have skills: Terraform, CI/CD, Python scripting, Monitoring & Alerting (Grafana/Prometheus/CloudWatch), Identity & Access Management (IAM)