Job Title: Databricks Solution Architect
Experience: 10+ Years (Minimum 4 Years Relevant Databricks Experience)
Location: Bangalore
Job Summary
We are seeking an experienced
Databricks Solution Architect with strong hands-on expertise in designing, architecting, and delivering end-to-end data solutions using Databricks at enterprise scale. The ideal candidate will have a deep understanding of cloud data engineering, distributed processing, data governance, and modern data architecture frameworks.
Primary Skills (Must-Have)- Strong track record of delivering 23 end-to-end Databricks implementations in large enterprise environments.
- Proven experience as a Data Architect / Platform Architect with advanced Databricks expertise.
- Hands-on experience in cloud data engineering using Azure, AWS, or GCP.
- Deep understanding of:
- Apache Spark
- Delta Lake
- SQL Warehouse
- Databricks Unity Catalog
- Strong proficiency in Python, SQL, and data engineering pipelines.
- Experience with DBT is an added advantage.
Secondary Skills (Good-to-Have)- Experience in data governance, security frameworks, and compliance:
- RBAC, SSO, encryption, lineage, and auditing.
- Ability to design scalable, secure, and cost-optimized cloud-native platforms.
- Experience implementing:
- CI/CD pipelines
- DevOps practices
- Infrastructure-as-Code (Terraform or similar)
- Hands-on experience designing, developing, and optimizing large-scale batch pipelines for ingestion, transformation, and analytics using Databricks.
- Experience building and managing real-time streaming pipelines using:
- Spark Structured Streaming
- Delta Live Tables
- Other Databricks-native streaming frameworks
Role & Responsibilities
- Serve as the Solution Architect responsible for designing and delivering Databricks-based data platforms.
- Work with enterprise stakeholders to translate business requirements into scalable architectural designs.
- Lead the development of high-performance batch and streaming pipelines.
- Define architecture standards, best practices, and governance frameworks.
- Ensure platform reliability, security, and cost efficiency across cloud environments.
- Guide cross-functional engineering teams and provide technical leadership throughout project lifecycles.
- Collaborate with DevOps, Cloud, and Security teams to ensure seamless integration and platform adoption.