Job Requirements
At Quest Global, it's not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better placeto make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.
Key Responsibilities
- Model Evaluation: Implementing evaluation pipelines to assess model response quality, coherence, factual grounding, and semantic accuracy. Experience with RAGAS framework
- Hallucination & Bias Detection: Developing systems to identify and operationalize checks for hallucinations (false facts) and inherited data biases.
- Prompt Engineering for Testing: Crafting complex prompts to test model boundaries
- Automated AI Testing: Building and maintaining automated testing frameworks using specialized tools (e.g., LangSmith, DeepEval, or TruLens) integrated into CI/CD pipelines.
- Dataset Management: Defining and managing high-quality evaluation datasets and synthetic test data for model benchmarking.
- API Integration: Integrating third-party APIs (OpenAI, AWS Bedrock, Anthropic) into applications to leverage pre-trained models.
- Safety & Compliance: Ensuring AI outputs adhere to ethical standards, legal regulations (like the EU AI Act), and company safety policies.
We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.
We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.
Work Experience
- Programming: Expert-level Python is typically mandatory for script automation and interacting with AI libraries.
- AI/ML Fundamentals: Good understanding of LLM architectures, Retrieval-Augmented Generation (RAG) pipelines, and model drift.
- Specialized Testing Frameworks: Proficiency with tools like Pytest, Playwright and AI evaluation frameworks like TruLens or LangGraph.
- Observability & MLOps: Familiarity with cloud-native tools (AWS Bedrock, Azure AI), Docker, Kubernetes
- Soft Skills: Strong communication, problem-solving, and collaboration skills
