Specialist - Quality Engineering

Job Summary

• Test generative AI solutions on AWS validating LLMs RAG prompts and agentic workflows with n8n and Python libraries like deepchecks and LangChain

Key Requirements 8 Points

• Test LLM outputs on AWS Bedrock using boto3
• Validate finetuned LLMs on AWS SageMaker with deepchecks
• Verify langchain prompts in AWS environments
• Test RAG pipelines with AWS OpenSearch and langchain
• Validate AI agents crewaiautogen on AWS Lambda
• Test n8n agentic workflows eg n8nioworkflows6270
• Ensure deployment stability on Amazon ECSEKS with Docker
• Monitor performance with Amazon CloudWatch and wandb

Must Have Skills

•  5 years of QA automation 2 years testing GenAILLMs using Python
•  Expertise in AWS Bedrock SageMaker Lambda boto3
•  Proficiency in deepchecks langchain crewai autogen wandb
•  Experience testing n8n workflows RAG prompts

Preferred Skills

•  AWS certification Machine LearningSolutions Architect
•  Familiarity with llamaindex n8n templates