Job Description
Overview
Senior Tech Lead, Data Platform
Responsibilities
Team Leadership & Delivery: Lead the planning, execution, and delivery of data platform features,
taking ownership of your team's sprints and roadmap commitments.
Hands-On Development: Act as the most senior developer on the team, writing clean, maintainable,
and well-tested code for critical components, particularly within the Apache Spark and Kubernetes
ecosystem.
Code Quality & Best Practices: Uphold a high standard of engineering excellence by conducting
thorough code reviews, establishing best practices for testing and deployment, and championing clean
code principles.
Mentorship & Coaching: Mentor and develop the engineers on your team, helping them grow their
technical skills and advance their careers.
Unblocking the Team: Act as the primary technical point of contact for your team, resolving technical
challenges, making pragmatic design decisions, and ensuring the team has what it needs to succeed.
Operational Excellence: Lead the charge on improving the observability, reliability, and performance
of our data pipelines and platform components.
Requirements
Required Qualifications
7+ years of hands-on software engineering experience, with a focus on data-intensive systems.
2+ years of experience in a formal or informal technical leadership role, including mentoring
engineers and leading project delivery.
Expert-level programming skills in Python (PySpark) or Scala.
Strong, hands-on experience with Apache Spark, including application development and
performance tuning.
Solid understanding of Kubernetes and experience deploying applications to it.
Proven ability to break down complex projects into manageable tasks and drive them to completion.
Preferred Qualifications
Experience with workflow orchestration tools like Airflow or Argo Workflows.
Experience building and maintaining CI/CD pipelines (e.g., GitLab CI, Jenkins).
Familiarity with S3-compatible object storage (MinIO, AWS S3) and table formats (Apache Iceberg,
Delta Lake).
Experience with interactive SQL engines like Trino.
