Job Description:
Job Title: Senior Quality Engineer
Experience: 5- 7 years
Requirements:
- Bachelor's/Master's degree in Computer Science or related field.
- 5-6 years of experience in Quality Engineering (QE) domain.
- Good understanding of Generative AI tools and platforms - especially LLMs.
- Foundation Knowledge of Gen-AI concepts, technologies, tools and frameworks
- Basic understanding of LLM models, prompt engineering, and some exposure to AI Art models and tools
- Detailed understanding and solid hands-on working knowledge of LLM evaluations, and using evaluators to validate the quality of LLM outputs.
- Solid knowledge of software testing methodologies, tools, and processes.
- Excellent analytical and problem-solving skills.
- Effective communication and collaboration skills.
- Proven ability to lead and mentor team members.
- Ability to lead quality assurance for data-driven and data-intensive apps and solutions
- Ability to prepare and organize test data sets and manage large amounts of test data
- Performing thorough data validation and verification to ensure accuracy and consistency of data. This includes developing and executing test plans, scripts, and tools for data verification.
- Build and execute test plans for workflow driven apps and solutions, and pipeline automation solutions
- Developing and implementing automated testing tools and frameworks to streamline QA processes. Optimize testing procedures for efficiency and effectiveness.
Responsibilities:
>Take ownership of solution quality for a digital product or platform
>Collaborate closely with the Dev team and Product team to drive quality engineering and assurance for an existing digital product
>Ensure successful client adoption and client onboarding as new clients are onboarded onto a digital product/platform.
>Lead and execute comprehensive automated testing strategies for cloud applications, ensuring high quality and reliability.
>Hands-on experience with API test tools (ex. Postman, SOAP UI, etc.) , API test automation
>Hands-on experience with Test Automation overall and the ability to automate all aspects of testing, from UE to Back-End Testing
>Proficient in designing, implementing, and maintaining automated test scripts.
>Thorough understanding of Gen AI automation principles and implementation.
>Solid understanding of using LLM Evaluation frameworks and libraries (such as RAGAS and others) to perform automated evaluation of LLM Outputs
>Solid understanding of LLM Quality metrics and validating AI generated outputs
> Proven experience on testing of creative apps .
> Experience with testing mobile apps is an advantage (nice-to-have)
> Collaborate with cross-functional teams to define testing requirements and ensure effective test coverage.
>Conduct test case reviews, identify gaps, and provide constructive feedback to improve overall test quality.
>Analyze and troubleshoot complex issues in a timely manner, documenting and communicating findings.
>Stay updated with industry best practices and emerging technologies in QA and automation.
>Mentor and guide junior QA engineers, fostering a collaborative and knowledge-sharing environment.
>Continuously improve testing processes and methodologies to enhance efficiency and effectiveness.
Location:
Pune
Brand:
Dentsu Creative
Time Type:
Full time
Contract Type:
Permanent
