About Finantic.ai
Finantic.ai is an AI-first company building enterprise-grade agentic AI systems for finance and accounting. We work on deeply complex workflows, including lease management, rent administration, compliance, and financial automation, using advanced AI agents, orchestration systems, and scalable cloud infrastructure.
What you will own
- Design test strategies for AI agents and LLM-based systems; build evaluation frameworks to measure AI accuracy, precision, recall, F1 scores
- Create test datasets for invoice extraction, payment matching, GL coding, reconciliation with edge cases and adversarial inputs
- Build end-to-end test automation frameworks (Playwright, Cypress, Selenium) and API tests (Postman, REST Assured,pytest)
- Implement integration tests for accounting system integrations (Yardi, NetSuite, QuickBooks, JD Edwards) and performance/load tests (k6, JMeter)
- Build CI/CD test pipelines that run on every commit and implement regression testing for ML models
- Build synthetic test data generators for invoices, payments, leases and create anonymized production data for testing
- Define and track quality KPIs (test coverage, defect density, AI accuracy); build dashboards for test results
- Monitor AI accuracy in production, create alerts for degradation, and build A/B testing frameworks to compare model versions
What makes you a great fit
- 4+ years QA engineering experiencewith at least 2 years in test automation
- B.E./B.Techor M.E./M.Tech/M.S. degreein Computer Science or equivalent fromtop-tier universities
- Have worked at product companies with strong engineering culture
- Built frameworks using Selenium, Playwright, Cypress, or similar
- Deep experience with REST API testing (Postman,pytest, REST Assured)
- Strongprogramming skillsinPython, JavaScript, or Java (can write maintainable test code)
- Experience integrating tests into CI/CD pipelines (Jenkins, GitHub Actions, GitLab CI)
- Experience inwritingSQL queries tovalidatedata integrity
- Experience with load testing tools (k6, JMeter, Gatling)
- Automation-first, developer mindset, proactive, clear communicator
- Balance speed and quality, high ownership mindset, thrive in fast-paced environment
- AI/ML testing experience- tested LLM applications, RAG systems, or ML models - good to have
- Prefer who have built products from scratch that scaled as an early team member or a founder
- Good to havebuilt data validation frameworks and synthetic data generators
