Job Description
About BeGig
BeGig is the leading tech freelancing marketplace, connecting innovative early-stage, non-tech founders with top-tier freelance talent. By joining BeGig, you're not just taking on one project — you're joining a platform that will continuously match you with high-impact opportunities tailored to your expertise.
Your Opportunity
Join our network as an AI Testing Engineer and play a key role in ensuring the reliability, safety, and performance of AI models and applications. You'll work with developers and data scientists to design testing frameworks, evaluate LLMs and ML models, and flag issues before systems go live.
Role Overview
As an AI Testing Engineer, you will:
- Develop and execute test plans for machine learning models and AI workflows.
- Evaluate LLM/model outputs for quality, bias, and edge cases.
- Collaborate with engineering teams to automate testing pipelines and ensure release readiness.
What You'll Do
- Design unit, integration, and regression tests for ML models and LLM applications.
- Build automated evaluation frameworks for accuracy, latency, and behavior.
- Create synthetic datasets and edge cases to stress-test AI systems.
- Conduct human-in-the-loop evaluations for prompts and agent workflows.
- Track model versioning, performance metrics, and testing coverage.
Technical Requirements
- 2+ years of experience in QA, ML testing, or AI/ML development.
- Proficiency in Python and testing tools like pytest, unittest, or custom scripts.
- Hands-on experience testing LLMs or generative models (OpenAI, Claude, etc.).
- Familiarity with LangChain, RAG workflows, or agent systems (plus).
- Bonus: Experience with CI/CD pipelines, MLflow, or other MLOps tools.
What We're Looking For
- Detail-oriented testers who understand AI system behavior and risks.
- Freelancers who can work independently and collaborate with dev/product teams.
- Passion for ensuring AI applications are safe, reliable, and production-ready.
Why Join Us
- Contribute to building trustworthy AI systems used by real-world businesses.
- Flexible, fully remote freelance role.
- Be the first to access future AI QA, model evaluation, and test automation projects.
- Join a fast-growing community shaping the future of AI safety and reliability.
Ready to put AI systems to the test Apply now and become an AI Testing Engineer with BeGig!
More Info
About Company
