
Search by job, company or skills
Location: Remote
Engagement Type: Full-time Contract
Contract Duration: Minimum 1-month contract (extendable based on project charter)
Role Overview
We are looking for Strategy/Management - Consultants / Engagement Managers (6+ years experience) to evaluate and improve the reasoning quality of advanced AI systems.
In this role, you will simulate the Engagement Manager reviewing the work of a junior consultant (the AI). You will design realistic consulting problems, define the ideal problem-solving workflow, and audit the AI's outputs for analytical rigor, sourcing quality, and logical consistency.
This role is well suited for consultants on a career break or exploring a transition who want a short-term, intellectually rigorous engagement.
Key Responsibilities:
Prompt Architecture (Client Simulation) Create high-fidelity consulting prompts that simulate real client problems (e.g., Decompose the unit economics of a D2C launch in Vietnam). Prompts may include synthetic supporting materials such as Excel models, PDFs, research documents, messages, or slide decks to mirror real consulting workflows.
Golden Path Definition Define the ideal step-by-step workflow for solving consulting problems. Establish the benchmark for what high-quality consulting analysis should look like.
Forensic Evaluation (Audit)
Review AI-generated research and strategy memos and identify issues such as:
Source Failures: Use of weak or generic sources instead of authoritative materials (e.g., government publications, regulatory filings, industry databases).
Logic Breaks: Missing variables or flawed assumptions in analytical models (e.g., margin vs. markup confusion).
Hallucinations: Fabricated regulations, statistics, or metrics.
Value-at-Stake Sizing: Verification of market sizing models (TAM/SAM/SOM) and financial calculations using first-principles reasoning.
Feedback Loops (RLHF) Provide clear, structured feedback explaining why an output fails and how it should be improved, helping the AI learn consultant-grade reasoning.
Experience:
6+ years in Management Consulting or Corporate Strategy
Experience at firms such as McKinsey, Bain, BCG, Oliver Wyman, L.E.K., Strategy&, EY-Parthenon, Kearney, or similar firms preferred
Job ID: 144357417