Experience: 3.00 + years
Salary: Confidential (based on experience)
Expected Notice Period: 15 Days
Shift: (GMT+05:30) Asia/Kolkata (IST)
Opportunity Type: Office ()
Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: SH)
(*Note: This is a requirement for one of Uplers client - SH)
What do you need for this opportunity
Must have skills required:
and asynchronous workflows., Basic security testing awareness and OWASP Top 10 understanding., Contract testing / integration testing exposure (e.g., etc.)., Event-driven systems, Exposure to microservices, guardrail testing, Hallucination detection, Knowledge/exposure of AI/LLM testing and benchmarking techniques (prompt regression testing, latency/cost checks, Message Queues, output evaluation, Pact) and service virtualization/mocking tools., Performance and load testing experience using k6 / JMeter., 3+ years of proven experience in software testing/QA automation for Product-focused SaaS platforms in production., Boundary value analysis, Exploratory testing, Familiarity with logs/metrics/traces and debugging tools such as CloudWatch / Grafana / ELK (or equivalents)., Good proficiency in SQL and MongoDB (or similar NoSQL databases) for data validation and backend verification., Proven extensive experience in testing/QA of a software product (preferably Data Analytics and AI-based) with 1000+ active users., Strong fundamentals of software testing, UI and e2e flows using tools/frameworks
SH is Looking for:
The Role
We are looking for a Software Test Automation Engineer who has hands-on experience in testing production or production-like web/SaaS systems and can lead the testing automation initiatives for our Autopilot SaaS Platform implementation. This role will also work closely with the testing and engineering teams to design robust testing systems for analytics algorithms (physics-based / ML-based) and LLM-powered modules/agents.
You will play a key role in building a scalable, prevention-first quality culture by automating critical test coverage, validating complex data workflows, and improving release confidence across UI, APIs, pipelines, analytics outputs, and AI/LLM features.
Qualifications -
- 3+ years of proven experience in software testing/QA automation for Product-focused SaaS
platforms in production.
- Proven extensive experience in testing/QA of a software product (preferably Data Analytics and AI-based) with 1000+ active users.
- Strong fundamentals of software testing, including test design techniques, boundary value
analysis, equivalence partitioning, exploratory testing, and risk-based testing.
- Hands-on experience with test automation for APIs, UI and e2e flows using tools/frameworks
such as:
- API testing: Postman/Newman, PyTest/Requests, REST Assured, or equivalent
- UI/e2e testing: Selenium (preferred), Playwright/Cypress (good to have)
- Comfortable writing testing utilities/scripts in Python / JavaScript / TypeScript / Java.
- Experience with CI/CD-integrated automated testing (GitHub Actions, Jenkins, GitLab CI, etc.) and Git workflows.
- Good proficiency in SQL and MongoDB (or similar NoSQL databases) for data validation and
backend verification.
- Familiarity with logs/metrics/traces and debugging tools such as CloudWatch / Grafana / ELK (or equivalents).
- Strong aptitude to test and validate analytics algorithms, logic controls, output consistency, edge cases, and failure modes.
- Experience with AWS/Azure platforms. Familiarity with containerized environments (Docker) and test execution in cloud environments.
- Exposure to structured defect/test management workflows using Jira / TestRail (or equivalents).
- Excellent documentation, communication, and collaboration skills with a strong bias for clarity, prevention, and reproducibility.
- Ability to take ownership of automation initiatives and contribute to defining team-wide testing systems and standards.
Nice to Have -
- Performance and load testing experience using k6 / JMeter.
- Contract testing / integration testing exposure (e.g., Pact) and service virtualization/mocking
tools.
- Basic security testing awareness and OWASP Top 10 understanding.
- Exposure to microservices, event-driven systems, message queues, and asynchronous
workflows.
- Knowledge/exposure of AI/LLM testing and benchmarking techniques (prompt regression
testing, output evaluation, guardrail testing, latency/cost checks, hallucination detection, etc.).
- Experience designing test datasets, test harnesses, or evaluation pipelines for ML/analytics
modules.
- Domain knowledge in energy/IoT, hardware-in-loop testing, sensor/time-series data validation, or industrial SaaS systems.
What will we do together
- Drive the testing automation implementation for our Autopilot SaaS Platform, in
collaboration with the testing, engineering, product, and DevOps teams.
- Drive the manual testing initiatives/efforts where automation is not possible
- Design and maintain a scalable test automation strategy across:
- a. Web UI
- b. APIs / microservices
- c. Data pipelines / ETL-ELT workflows
- d. Analytics/algorithm outputs
- e. LLM-powered modules and agentic workflows
- Define and document the test cases of services/features being developed
- Build and maintain reliable automated test suites for smoke, sanity, regression, integration, and end-to-end scenarios.
- Develop automated validation systems for data-intensive and analytics features, including:
- a. Algorithm output validation (physics-based / ML-based logic checks)
- b. Time-series correctness and completeness checks
- c. Data quality (DQ) checks
- d. Idempotency and pipeline consistency verification
- e. Error handling / fallback behavior testing
- Work with the team to design testing systems for LLM/AI modules, including:
- a. Prompt/response regression testing
- b. Functional correctness checks for AI workflows
- c. Guardrails and boundary-case validation
- d. Hallucination-risk and groundedness-oriented test scenarios Latency, timeout, and reliability checks
- e. Version-to-version output comparison and benchmarking
- Enable production-aware testing practices such as canary/blue-green validation, feature-flag
rollout checks, log-based verification, and SLO-aware release checks.
- Integrate automated tests into CI/CD pipelines to improve release discipline and reduce escaped defects.
- Create and maintain test documentation including:
- a. Test strategy and test plans
- b. Traceability matrices
- c. Runbooks and release checklists
- d. RCA / bug analysis reports
- e. Automation framework usage guidelines
- Drive defect lifecycle end-to-end: triage, prioritization support, clear reproduction steps,
root-cause collaboration, and verification of fixes.
- Track and report key quality metrics (automation coverage, flaky tests, escaped defects, test
cycle stability, MTTR for bugs) and improve test effectiveness over time.
- Contribute to building a high-quality testing culture with a prevention-first mindset and practical engineering rigor.
Location
Noida, Uttar Pradesh, India
Compensation & Benefits
- Remuneration: A competitive remuneration with additional ESOPs.
- Opportunity to implement and master AI/LLM/algorithms-based, data-intensive advanced
analytics/AI platforms.
- Opportunity to learn and master big-data technologies.
- Opportunity to work in a conducive environment that challenges your limits and helps improve
your capacities.
- Opportunity to work with Swiss Research Institutions and closely collaborate with top global
tech researchers.
- Ample opportunities to learn and grow professionally. We conduct monthly professional &
personal productivity workshops.
- Conceptualize, write, and live your own startup story with full autonomy and under brilliant
mentorship.
How to apply for this opportunity
- Step 1: Click On Apply! And Register or Login on our portal.
- Step 2: Complete the Screening Form & Upload updated Resume
- Step 3: Increase your chances to get shortlisted & meet the client for the Interview!
About Uplers:
Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement.
(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).
So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!
