Experience: 6+ Years
Location: Bangalore / Hyderabad (Hybrid)
Shift: 2:00 PM – 11:00 PM IST
About the Role
We are looking for an experienced Senior Databricks Platform Engineer to join a high-impact engineering team driving enterprise-scale cloud and data platform modernization.
In this role, you will work on building, enhancing, and supporting modern Azure-native data platforms centred around Databricks. You'll collaborate with cloud, infrastructure, DevOps, and analytics teams to deliver scalable, secure, and high-performing data solutions that power business-critical applications.
This is an excellent opportunity for professionals who enjoy platform engineering, cloud technologies, automation, and enterprise data ecosystems.
Key Responsibilities
Databricks Platform Engineering
- Design, implement, and support enterprise Databricks environments.
- Manage Databricks Workspaces, Clusters, Jobs, and Notebooks.
- Build and optimise Lakehouse architecture using Delta Lake and Unity Catalog.
- Improve Spark workload performance and cluster efficiency.
- Support batch and streaming data processing workloads.
- Manage multiple environments including Development, QA, and Production.
Azure Cloud & Platform Integration
- Integrate Databricks with Azure services and enterprise applications.
- Work with Azure Storage, Data Lake, APIs, and analytics platforms.
- Support cloud-native platform engineering initiatives.
- Ensure platform scalability, availability, and operational excellence.
DevOps & Automation
- Collaborate with DevOps teams to implement CI/CD best practices.
- Support deployment pipelines using GitHub and Azure DevOps.
- Contribute to Infrastructure as Code (IaC) initiatives.
- Participate in automation and platform modernisation projects.
Governance & Operations
- Implement security, governance, and access management best practices.
- Support RBAC, encryption, monitoring, and data lineage.
- Troubleshoot production issues and perform root cause analysis.
- Document operational procedures and platform standards.
Required Skills & Experience
- 6+ years of experience in Cloud Engineering, Platform Engineering, Data Engineering, or related domains.
- Minimum 3 years of hands-on experience with Databricks.
- Strong expertise in:
- Azure Databricks
- Delta Lake
- Unity Catalog
- Apache Spark
- Databricks Workspaces and Cluster Management
- Experience with Microsoft Azure cloud services.
- Exposure to GitHub, Azure DevOps, and CI/CD practices.
- Experience integrating enterprise applications through APIs.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and stakeholder management skills.
Preferred Skills
- PySpark
- Python
- SQL / Spark SQL
- Scala
- Azure Data Lake
- Event Hub
- Streaming data architectures
- AKS / Kubernetes
- Terraform or Bicep
- Infrastructure as Code (IaC)
- Azure Monitor, Datadog, or similar monitoring tools
- Experience supporting enterprise cloud migration or modernisation programmes
What You'll Work On
- Enterprise Azure Data Platforms
- Databricks Platform Engineering
- Cloud Infrastructure Modernisation
- DevOps & Automation
- Platform Operations & Reliability
- Large-scale Analytics & AI Data Ecosystems
Why Join
- Work on enterprise-scale Azure and Databricks transformation programmes.
- Collaborate with experienced global engineering teams.
- Gain exposure to modern cloud, DevOps, and platform engineering practices.
- Be part of innovative projects involving large-scale data platforms, automation, and analytics.
If you're passionate about building scalable cloud-native data platforms and enjoy solving complex engineering challenges, we'd love to hear from you.
