Job description
We are looking for a highly motivated individual with strong analytical and technical skills for the position of AI Validation Engineer. You will play a critical role in evaluating the performance, accuracy, and fairness of our AI solutions, including the AI Assistant and its associated skills. You will help ensure that our AI systems meet the highest standards of quality and align with our responsible AI principles.
About the Role
In this opportunity as AI Validation Engineer, you will:
- Collaborate with data scientists, AI engineers, and product managers to understand AI system requirements and functionalities.
- Develop and execute comprehensive test plans to assess the performance, accuracy, robustness, and fairness of AI models and applications.
- Design and implement automated testing frameworks for efficient and continuous AI validation.
- Analyze AI model outputs, identify potential biases, errors, or limitations, and provide actionable feedback to the development team.
- Contribute to the development and implementation of responsible AI guidelines and best practices within the organization.
- Stay abreast of the latest advancements in AI validation techniques and technologies.
- Document testing procedures and results clearly and concisely.
- Collaborate with stakeholders to address and resolve identified AI validation issues.
About You
You're a fit for the role of AI Validation Engineer if your background includes:
- 5-12 years of experience in Data Science or related field, (prefer candidates with at least 2 years specifically focused on AI validation)
- Bachelor's or Master's degree in Computer Science, Engineering, Statistics, or a related field.
- Experience with machine learning frameworks and tools (e.g., TensorFlow, PyTorch, Scikit-learn).
- Strong understanding of AI concepts, including machine learning, deep learning, and natural language processing.
- Experience with AI validation techniques and methodologies.
- Proficiency in scripting languages like Python for test automation.
- Familiarity with testing frameworks and tools.
- Experience with data analysis and visualization tools.
- Excellent analytical and problem-solving abilities to identify and diagnose AI system issues.
- Strong communication and collaboration skills to effectively convey findings and recommendations to technical and non-technical audiences.
- Meticulous attention to detail to ensure thoroughness and accuracy in AI validation processes.
- Understanding of responsible AI principles and their practical implications for AI validation.
- Experience with cloud-based AI platforms (AWS, Azure).
- Familiarity with AI ethics and governance frameworks.
- Experience working in an Agile development environment.
