Automation Test Engineer

About the Role

We are looking for a skilled AI Test Engineer with expertise in AI evaluation areas and Android platform testing. The ideal candidate will have a strong understanding of software testing practices and the ability to collaborate effectively with development teams.

Job Title

AI Test Engineer

Responsibilities

• Evaluate AI performance in areas such as answer relevancy, task completion, correctness, hallucination detection, and tool correctness.
• Conduct testing on Android platform and applications using relevant tools.
• Test application memory, performance, and battery usage across Android environments.
• Follow the Software Testing Life Cycle (STLC) to ensure thorough testing.
• Implement AI safety and security testing practices.
• Collaborate closely with development teams and leads.
• Review Module-specific HLD/PRD documents and create test strategies, plans, and detailed test cases.
• Develop automation tests using tools like Python, PyWinAuto, Selenium, and Playwright.
• Foster effective cross-team collaboration.
• Mentor and guide junior engineers.
  
  

Required Skills

• Strong expertise in AI evaluation areas.
• Extensive experience in Android platform and application testing.
• Deep knowledge of application memory, performance, and battery testing.
• Understanding of the Software Testing Life Cycle (STLC).
• Basic knowledge of AI safety and security testing.
• Hands-on experience with development teams.
• Ability to translate requirements into test strategies and plans.
• Experience in automation testing using Python, PyWinAuto, Selenium, and Playwright.
• Demonstrated cross-team collaboration skills.
• Ability to mentor junior engineers.
  
  

Desirable Skills

• Certification in software testing or related field.
• Familiarity with other automation testing tools and frameworks.
  
  

Education Qualification

• Bachelor's degree in Computer Science, Engineering, or related field.