Sr Quality Assurance Spec

About FM:

FM is a 190-year-old, Fortune 500 commercial property insurance company of 6,000+ employees with a unique focus on science and risk engineering. Serving over a quarter of the Fortune 500 and major corporations globally, they deliver data-driven strategies that enhance resilience, ensure business continuity, and empower organizations to thrive.

FM India located in Bengaluru is a strategic location for driving FM's global operational efficiency that allows them to leverage the country's talented workforce and advance their capabilities to serve their clients better.

Role Title: Sr Quality Assurance Spec

Position Summary:

Contributes directly and provides consultation to one or more project teams and/or application support groups in the analysis, design, and execution of effective Quality Assurance procedures and defect prevention/detection processes for corporate and client area information systems, across multiple computing environments. Determines and reports the quality of a product release at any time by quantifying the degree to which it meets the defined and implied user requirements. This is the second level position within the Quality Assurance job family. Ultimately, the goal of this position is to ensure the system delivered will address the organization's business need or problem as defined in the requirements.

Job Responsibilities:

• Identifies detail business design requirements which need to be tested and determines what constitutes an appropriate test for each and every requirement. Identifies requirements that need clarification in order to develop an appropriate test. Develops test plans covering the aggregation of testing requirements identified.
• Develops and maintains specific test cases (i.e. test data, test processes, and test results) for component/assembly testing, integration testing, system testing, security and control testing, online help and user interface testing, conversion testing, and regression testing. Participates in code reviews to clarify requirements, validate test cases, and provide feedback to the development team.
• Plans, tests, and reports the results of manual and automated functional testing; identifies and tracks defects and interacts with development staff to isolate and resolve; retests to confirm defects have been corrected. Participates in defect management/triage. Validates functionality across system releases. Develops automated test scripts where appropriate.
• Determines compliance with test plans and procedures; tracks development of project artifacts necessary for Quality Assurance throughout the lifecycle; ensures that projects adhere to methodology and standard practices; mentors IS personnel on appropriate QA practices and procedures.
• Supports load, stress, performance, and reliability testing efforts and associated analysis.
• Ensures test environments are properly configured and available for each project as scheduled. Implements automated testing tools. Performs periodic system audits to ensure that only controlled versions of the software reside in the appropriate environments. Communicates deployment status to project team(s).

Skill and Experience:

• 3-5 years of experience required to perform essential job functions.
• Additional Experience Qualifier (optional): 3+ years of experience in systems quality environment.

TECHNICAL KNOWLEDGE:

• Knowledge of the relevant technical computing environment(s), including operating system, database management system, application development framework. | Understanding of test case management tools, test case generation techniques, and problem tracking/reporting systems. | In depth understanding of current business processes in one or more functional business areas.

TECHNICAL SKILLS:

• Proven ability to analyze business requirements and understand business activity and information models in order to develop appropriate test plans and experience with test case generation techniques. | Proven ability to perform functional, integration, and regression testing and to accurately evaluate and document the results. | Experience with automated testing tools.

SOFT SKILLS:

• Excellent analytical ability and communication skills, strong judgment, and the ability to work effectively with business personnel and IS management and staff

Must Have Skills:

• Spec-Based Quality Engineering: Review and validate machine-readable specs (Markdown, JSON, YAML) to ensure testability, clarity, completeness, and alignment to functional and non-functional requirements in collaboration with the product owners.
• AI-Generated Output Validation: Test and assess AI-generated code using automated tests, testing tools, documentation, and configs for correctness, consistency, and alignment to defined specs and acceptance criteria.
• AI-Aware Test Strategy Design: Design test strategies that account for non-deterministic outputs, including golden tests, assertion tolerance, and repeatability controls.
• Automated Testing Enablement: Build and maintain automated test suites (unit, API, integration, regression) that evaluate both human-written and AI-generated artifacts as appropriate.
• Human-in-the-Loop Quality Controls: Implement review gates, approval steps, and exception handling where AI output requires human validation before promotion or release.
• Quality Signals for AI Pipelines: Define and capture quality metrics such as defect leakage, rerun frequency, flaky outputs, and agent reliability to continuously improve specs and prompts.
• CI/CD Integration for Testing: Integrate AI validation steps into CI/CD pipelines, ensuring failures are visible, traceable, and actionable across teams.
• Data-Driven Defect Analysis: Analyze trends in AI-generated defects to identify gaps in specs, prompts, or agent behavior, feeding improvements back into shared standards.
• Collaboration on Shared Specs and Agents: Work closely with engineers, product owners, and platform teams to improve common specs, test agents, and reusable validation patterns.
• Responsible and Ethical AI Testing Mindset: Understand biases, hallucinations, and edge cases in AI outputs, and test for scenarios that could introduce functional, compliance, or operational risk.
• Transparency and Observability in Quality: Design, build and propagate quality dashboards based on the data collected from data-driven defect analysis
• Synthetic Testing Data: Collaborate with data governance and other teams in order to enable the use of and management of sy

Skills:

• QA Automation *CI/CD for Integration *Ability to validate AI-generated outputs Understanding or exposure to AI tools used in QA/automation

Education and Certifications:

• BS or equivalent in Computer Science or related discipline required

Work location: Bengaluru