Senior Quality Engineering (QE) Lead for GenAI Systems
Years of Experience: 10-13 Years
Job Summary: We are seeking a highly skilled Senior Quality Engineering Lead to spearhead the QE strategy for our Generative AI (GenAI) systems. The ideal candidate will have extensive experience in designing and developing test automation frameworks, with a strong focus on AI agents, LLM workflows, data pipelines, and API integrations. This role requires a proactive leader who can build scalable test suites using JavaScript and Playwright, while driving continuous improvement and operational excellence across GenAI initiatives.
Responsibilities:
- Lead the development and implementation of the QE strategy for GenAI systems.
- Design and develop robust test automation frameworks to ensure high-quality software delivery.
- Build scalable test suites using JavaScript and Playwright, focusing on efficiency and effectiveness.
- Oversee the testing of AI agents, ensuring their functionality and performance meet established standards.
- Define and implement LLM workflow testing tasks to validate model outputs and integration points.
- Manage API integration testing to ensure seamless communication between systems.
- Establish and maintain QE standards, optimizing test coverage and enabling risk-based testing.
- Advance AI-assisted testing methodologies, utilizing synthetic data and observability-driven insights.
- Ensure compliance with regulatory requirements, document architecture, and support audits.
- Track quality KPIs and ROI, aligning test strategies with risk, regulatory needs, and customer impact.
Mandatory Skills:
- 10-13 years of experience in Quality Engineering, with a focus on GenAI systems.
- Strong expertise in Playwright for test automation.
- Proven experience with AI agents and their testing methodologies.
- In-depth knowledge of LLM workflows and associated testing tasks.
- Experience in API integration testing and validation.
Preferred Skills:
- Familiarity with synthetic data generation techniques.
- Experience with observability tools and practices.
- Knowledge of risk-based testing frameworks.
- Strong analytical and problem-solving skills.
- Excellent communication and leadership abilities.
Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Relevant certifications in Quality Engineering or Software Testing are a plus.
- Demonstrated ability to lead cross-functional teams and drive quality initiatives.
If you are passionate about quality engineering and have a strong background in Generative AI systems, we encourage you to apply and join our innovative team.