Scaled Operations Manager
Role Overview
You will own end-to-end operations for large-scale AI data production, model evaluation, and human-in-the-loop workflows. This role requires building operating frameworks, scaling global teams, driving efficiency, and partnering with product, engineering, and customers. You will lead cross-functional execution across quality, workforce planning, delivery, automation, and program management.
Key Responsibilities
Scaled Operations Leadership
- Build and scale high-volume AI data operations (annotation, RLHF, evaluation, red-teaming)
- Lead global delivery teams across multiple programs and customers
- Design operating models for 100–1000+ contributor scale
- Drive operational SLAs, quality, and turnaround time
Program & Delivery Management
- Own end-to-end delivery across multiple AI model training programs
- Partner with product and research teams on task design and execution
- Establish execution cadences, reporting, and governance
- Manage cross-functional stakeholders (Product, Eng, Customer)
Process & Efficiency
- Build SOPs, QA frameworks, and performance metrics
- Drive automation across workflows using AI and tooling
- Improve productivity, cost per task, and throughput
- Implement scalable quality control mechanisms
Workforce & Capacity Planning
- Build capacity models and hiring forecasts
- Manage vendor and in-house contributor ecosystem
- Drive utilization and staffing optimization
- Scale global distributed workforce
Cross-functional Execution
- Work with engineering to build internal tooling
- Partner with recruiting for rapid scale
- Collaborate with finance on cost optimization
- Support customer-facing program delivery
Basic Qualifications
- 10+ years in operations, program management, or scaled delivery
- Experience managing large-scale operations (100+ workforce)
- Background in BPO, Trust & Safety, AI ops, or data operations
- Strong stakeholder management and execution skills
- Experience building processes from scratch
- Strong analytical and problem-solving ability
Preferred Qualifications
- Experience in AI/ML data operations or model evaluation
- Experience scaling human-in-the-loop workflows
- Experience in global vendor operations
- Experience with automation and operational tooling
- Startup or high-growth environment experience
- Consulting or strategy + ops background