We're looking for a Databricks Technical Lead who can guide the design and build-out of our data engineering and transformation platforms. This person will be the go-to expert on Databricks, Delta Lake, and Spark, and will help shape how data flows across our organization from ingestion all the way through our curated layers.
This is a hands-on leadership role. You won't just review work you'll help solve hard problems, mentor engineers, set standards, and make architecture decisions that will influence the platform for years.
What You'll Do
- Lead the technical direction for Databricks-based data pipelines and frameworks.
- Design and review patterns for ingesting, transforming, and publishing data (Bronze Silver Gold).
- Define best practices around Delta Lake, schema evolution, SCD handling, and metadata-driven transformations.
- Provide technical oversight across multiple engineering squads.
- Work with architects, data modelers, quality engineers, and operations teams to ensure pipelines are built the right way.
- Mentor data engineers and help elevate the overall engineering capability.
- Oversee Unity Catalog governance, including RBAC, lineage, and schema enforcement.
- Help troubleshoot complex performance issues and guide teams on tuning and optimization.
- Support integration with orchestration tools and CI/CD processes.