Chief Lakehouse Architect Databricks CoE
- Posted 2 months ago
- Be among the first 10 applicants
Job Description
Chief Lakehouse Architect – Databricks CoE1
Principal architect responsible for defining and executing enterprise-grade Databricks Lakehouse architecture standards, engagements and guiding complex solution designs. Drive cost optimization and financial governance for Databricks platforms across clients and internal workloads.
Key Responsibilities
Principal architect responsible for defining and executing enterprise-grade Databricks Lakehouse architecture standards, engagements and guiding complex solution designs. Drive cost optimization and financial governance for Databricks platforms across clients and internal workloads.
Key Responsibilities
- Define Databricks reference architectures (batch, streaming, ML, GenAI)
- Own standards for Delta Lake, medallion architecture, Unity Catalog
- Design multi-workspace Databricks platform architectures
- Lead Databricks migrations from legacy data warehouses programs
- Design, Review and approve architecture for all Databricks deals
- Mentor architects and senior Databricks engineers
- Define Databricks FinOps framework
- Optimize cluster policies, DBU usage, and job scheduling
- Work with engineering teams on performance-to-cost optimization
- Advise leadership and clients on Databricks cost strategies
- 12–15 years in data architecture
- 5–7 years hands-on Databricks & Apache Spark
- 3+ years designing enterprise Databricks platforms, managing Databricks costs at scale
- Databricks platform internals & optimization
- Spark performance tuning and scalability
- Delta Lake internals (ACID, compaction, Z-order)
- Databricks Jobs, Workflows, CI/CD, IaC
- Cloud-native Databricks (AWS / Azure / GCP)
- Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing
- Cloud billing & monitoring tools
- Cost optimization patterns for Spark workloads
- Databricks Data Engineer Professional
- FinOps Practitioner
More Info
Key Skills
Cloud billing monitoring tools
Spark performance tuning and scalability
Cluster tuning auto-scaling strategies Databricks DBU model pricing
Databricks Jobs Workflows CI CD IaC
Cloud-native Databricks AWS Azure GCP
Cost optimization patterns for Spark workloads
Databricks platform internals optimization
Delta Lake internals ACID compaction Z-order
About Company