Role: Data Science Expert (Remote, Part-Time)
Role Overview
We are looking for a skilled Data Science Expert to support advanced AI lab evaluations focused on analytics and data science workflows. In this role, you will design realistic, end-to-end data scenarios and evaluate how AI agents handle complex tasks across SQL analysis, dashboards, experimentation, and data engineering. This is a challenging, high-focus role for someone who enjoys long-horizon technical problem-solving and clear analytical reasoning.
Key Responsibilities
- Design realistic data science and analytics workflows for frontier AI evaluations.
- Create scenarios involving SQL analysis, dashboard builds, metric definitions, and A/B test design.
- Develop and assess funnel, cohort, and ad-hoc business analysis tasks.
- Build and evaluate data engineering scenarios such as ETL/ELT pipelines, dbt models, and data quality monitoring.
- Review warehouse schema design and orchestration workflows such as Airflow or Dagster DAGs.
- Grade how AI agents reason through complex data tasks and document strengths and gaps.
- Produce clear, structured evaluation feedback and data artifacts.
Required Skills & Qualifications
- Experience as an analytics engineer, BI analyst, data scientist, or data engineer.
- Strong working knowledge of at least two of the following: advanced SQL, dbt, warehousing, experimentation, pipeline orchestration, metric modeling, or Python for analysis.
- Experience reading and producing data artifacts such as SQL queries, dbt models, experiment readouts, dashboard specs, and schema diagrams.
- Strong written communication skills with the ability to explain reasoning step by step.
- Comfort working on long, complex problem sets rather than short, repetitive tasks.
- Ability to work independently in a remote contractor setup.
Compensation and Engagement
- Part-time remote contract role.
- Pay range: $70–$120/hour, depending on domain depth and prior experience.
- Independent contractor engagement with weekly payments.
- Flexible schedule with project-based work.
- Projects may be extended, shortened, or concluded early based on needs and performance.
Equal Opportunity Employer
We welcome qualified applicants from all backgrounds and review candidates based on skills and experience. Reasonable accommodations are available upon request.
