AI Testing Engineer

Key Responsibilities

• Design, develop, and execute test plans and test cases for AI/ML-based applications
• Validate AI models for accuracy, bias, performance, and reliability
• Perform functional, regression, integration, and system testing
• Test data pipelines, model training workflows, and inference systems
• Analyze model outputs and identify anomalies or inconsistencies
• Collaborate with data scientists, developers, and product teams
• Automate test cases using modern automation tools and frameworks
• Ensure data quality, integrity, and compliance in AI systems
• Document defects, track issues, and support resolution
• Stay updated with the latest AI testing tools and trends

Required Skills & Qualifications

• Bachelor's degree in Computer Science, IT, or related field
• 0-2 years of experience in software testing or QA
• Basic understanding of AI/ML concepts (supervised, unsupervised learning, NLP, etc.)
• Knowledge of testing methodologies and SDLC/STLC
• Familiarity with Python or any programming language
• Understanding of APIs and experience with API testing tools (Postman, etc.)
• Exposure to test automation tools (Selenium, Playwright, or similar)
• Basic knowledge of data validation and SQL
• Strong analytical and problem-solving skills
• Good communication and teamwork abilities

Preferred Skills

• Exposure to AI testing tools and frameworks
• Understanding of model evaluation metrics (accuracy, precision, recall, F1-score)
• Knowledge of NLP, Computer Vision, or Generative AI systems
• Knowledge /Experience with cloud platforms (AWS, Azure, or GCP)
• Familiarity with CI/CD pipelines