Role Overview
Setoo is looking for a Senior, Fractional Back-End Data Engineer to own the maintenance, reliability, and expansion of our data platform.
This role is not greenfield experimentation. The foundation is already in place. Your responsibility is to take long-term ownership of the data layer as the product scales—ensuring pipelines are automated, resilient, observable, and easy to extend.
You will play a critical role as we continuously ingest SEC and regulatory datasets, enrich them with private partner contact data, and roll out new datasets across our web application.
What You'll Own
- End-to-end data pipelines including SEC/regulatory data and private enrichment datasets
- Automation-first infrastructure with resilient, scalable pipelines
- Dataset lifecycle management: schema evolution, versioning, backfills
- Production stability: monitoring, alerting, performance tuning
- Clean data interfaces for web and product teams
Core Responsibilities
- Design, maintain, and extend Apache Airflow DAGs
- Build robust Python ingestion and transformation services
- Develop and optimize SQL models across BigQuery and Postgres/AlloyDB
- Manage GCP-native data infrastructure (BigQuery, GCS, Cloud Run)
- Implement data quality checks and anomaly detection
- Collaborate with internal teams and external data providers
- Maintain clear technical documentation
What Good Looks Like
- Pipelines run without manual intervention
- New datasets onboard smoothly and safely
- Failures are visible and recoverable
- Platform scales without frequent rewrites
- Engineering time shifts from firefighting to growth
IDEAL BACKGROUND
- 7+ years in backend or data engineering
- Strong Python and Apache Airflow experience
- Advanced SQL skills
- Hands-on GCP experience
- Automation-focused system builder
- Comfortable owning outcomes as a fractional leader
ENGAGEMENT MODEL
- Fractional or contractual role
- 6+ months ongoing engagement
- High trust, low ceremony, real ownership
What We Value
- Strong analytical thinking and attention to detail.
Skills: python,google cloud storage,google cloud platform,sql,alloydb / postgres,cloud run,bigquery,apache airflow
