AI/ML Test Engineer (AWS/GCP)

Role Overview

At present, we have two AI/ML Test Engineer (AWS/GCP) Individual Contributor positions open and would welcome suitable candidate submissions for these opportunities.

Key Responsibilities

• Design and execute test strategies for AI/ML applications and data pipelines.
• Validate machine learning model performance, accuracy, robustness, and reliability.
• Perform functional, integration, regression, API, and end-to-end testing.
• Develop and maintain automated test frameworks using Python and modern testing tools.
• Test AWS-based AI/ML solutions, including SageMaker and Bedrock deployments.
• Verify data quality, model inputs/outputs, and ETL processes.
• Conduct performance, security, and scalability testing.
• Monitor production AI systems for model drift and performance degradation.
• Collaborate closely with Data Scientists, ML Engineers, Developers, and DevOps teams.
  
  

Required Skills

• Strong experience in Software Testing and Test Automation.
• Proficiency in Python and SQL.
• Experience with Selenium, Playwright, PyTest, or Robot Framework.
• Good understanding of Machine Learning concepts and model lifecycle.
• Hands-on experience with AWS services such as EC2, S3, Lambda, SageMaker, and CloudWatch.
• Experience in API testing using Postman or REST Assured.
• Understanding of CI/CD pipelines and DevOps practices.
  
  

Preferred Skills

• Experience testing Generative AI solutions and Large Language Models (LLMs).
• Knowledge of AWS Bedrock, MLOps, and Responsible AI practices.
• Exposure to performance testing tools and cloud-native testing approaches.
• Familiarity with Agile/Scrum methodologies.
  
  

Skills: aws – ec2, s3, lambda,selenium / playwright,aws sagemaker,test automation,functional, integration, regression & e2e testing,ci/cd & devops practices,ai/ml application testing,pytest / robot framework,data quality & etl testing,sql,performance, security & scalability testing,aws cloudwatch,machine learning concepts & model lifecycle,api testing – postman / rest assured,python