INTRODUCTION TO EVERNORTH:

Evernorth Health Services India, established in Hyderabad in 2024, is an innovation hub for Evernorth Health Services, the pharmacy, care and benefits division of The Cigna Group. The innovation hub will support innovation-focused areas, such as generative AI, product development, process improvement, analytics, and software engineering across The Cigna Group and its businesses. Evernorth Health Services India builds on The Cigna Group's existing presence in India.

About Evernorth Health Services:

Evernorth Health Services (Evernorth) is the pharmacy, care and benefits solution division of The Cigna Group - a Fortune 16 global health company with 75,000 employees, 186 million customers in more than 30 countries and jurisdictions around the world. Evernorth exists to make the prediction, prevention, and treatment of illness and disease more accessible to millions of people. We do this by creating and connecting premier health services offerings, such as benefits management, pharmacy, care solutions, insights and intelligence.

About Cigna:

The Cigna Group is a global health company committed to improving the health and vitality of individuals and communities around the world and includes products and services marketed under its Cigna Healthcare and Evernorth Health Services subsidiaries. Cigna Healthcare is the health benefits provider of The Cigna Group, serving customers and clients through its U.S. Employer, U.S. Government, and International Health business. Evernorth Health Services is the pharmacy, care and benefits solution division of The Cigna Group.

This position will:

Ensure the quality, reliability, and compliance of Gen AI/Agentic AI solutions, leveraging AWS for data engineering and Azure OpenAI for LLM-based applications
Design, develop, and execute comprehensive test plans for AI/ML models, data pipelines, and system integrations
Collaborate with architects, developers, and data scientists to validate requirements and solution outputs
Maintain high standards for test documentation, defect tracking, and reporting
Advocate for best practices in AI/ML testing, including fairness, bias, and explainability
Continuously improve testing processes and tools to enhance solution quality
Coordinate with ServiceNow and Workday teams to validate end-to-end workflows and ensure seamless integration of AI components
Participate in joint testing efforts, focusing on the interfaces and data exchanges between Gen AI solutions, ServiceNow, and Workday
Develop and maintain automated and manual test cases for Gen AI/Agentic AI use cases
Validate outputs from Azure OpenAI LLMs for accuracy, relevance, fairness, and bias, using both quantitative and qualitative methods
Test AWS-based data pipelines for data integrity, transformation accuracy, and performance under various scenarios
Perform end-to-end testing of APIs and microservices that integrate AWS data sources with Azure OpenAI LLMs and HR systems
Conduct regression, performance, security, and compliance testing of AI solutions to ensure robustness and reliability
Document test results, track defects, and collaborate with developers to resolve issues efficiently
Ensure comprehensive test coverage for HR system integrations (e.g., Workday) and business-critical workflows
Participate in design and code reviews to provide a quality perspective and identify potential risks early
Work with ServiceNow and Workday teams to validate data exchanges and workflow triggers, ensuring AI outputs are correctly consumed and acted upon by downstream systems
Support user acceptance testing (UAT) and integration testing phases involving ServiceNow and Workday and other HR systems

Education:

Bachelor's degree in Computer Science, Engineering, or a related field

Experience:

2+ years of experience in software, AI/ML, or cloud testing roles

Required Qualifications:

Familiarity with AWS data engineering environments and test automation frameworks (e.g., PyTest, Selenium)
Experience with Prompt finetuning and hyperparameter tuning
Experience validating LLM outputs and AI/ML model performance
Understanding of data quality, privacy, and compliance requirements in cloud environments
Strong analytical skills and attention to detail
Proficiency in writing clear test documentation and defect reports
Experience working in cross-team environments and validating integrations with external platforms

Preferred Qualifications:

Certifications in AWS or Azure cloud platforms
Experience testing Gen AI solutions, LLMs, or HR systems
Knowledge of Azure OpenAI and LLM evaluation techniques
Exposure to MLOps and automated model validation pipelines
Strong communication and collaboration skills
Experience with agile development and QA methodologies
Familiarity with ServiceNow and Workday integration testing is a plus

Equal Opportunity Statement:

Evernorth is an Equal Opportunity Employer actively encouraging and supporting organization-wide involvement of staff in diversity, equity, and inclusion efforts to educate, inform and advance both internal practices and external work with diverse client populations.

Sr. Software Engineer

Senior Associate Automation and Performance Tester

Software Engr II

Sr Validation Engineer

Quality Engineer (Tester, Manual)

Senior Test Engineer