Manager Quality Automation Engineering for Observability and AI
Job Description
Looking for details about our benefits You can learn more about them by clicking HERE
This Is Helix. Powered by You. At BMC Helix, we don't do ordinary. We're the AI-native engine behind the world's most forward-thinking IT organizations, helping them focus on what matters most. What are we passionate about We're here to reset the economics of enterprise IT and help others realize the ROI of AI. We are a mix of curious minds, creative thinkers, and courageous builders who believe tech should change the game—not just play it. We celebrate wins, support each other, and laugh a lot. We are the change makers. With decades of leadership and established trust in IT service and operations management, we're scaling with purpose—through organic innovation, strategic acquisitions, and relentless R&D. Our open-first Agentic AI platform empowers autonomous agents to drive real outcomes with speed, accountability, and precision. We are laser-focused on delivering real value to our customers by accelerating innovation and the application of applying agentic AI in digital service and operations management for IT organizations around the world.
The Helix product line includes industry-leading Digital Services and Operation Management products. We have many interesting SaaS products, in the fields of: Predictive IT service management, Automatic discovery of inventories, intelligent operations management, and more! We continuously grow by adding and implementing the most cutting-edge technologies and investing in Innovation! Our team is a global and versatile group of professionals, and we LOVE to hear our employees innovative ideas. So, if Innovation is close to your heart - this is the place for you!
We are looking for a highly skilled Manager of Quality Engineering for Observability and AI to lead our efforts in ensuring the quality and reliability of our observability solutions and AI-powered systems. This role will oversee the testing, validation, and optimization of AI-driven monitoring tools and observability platforms while ensuring that AI models and data pipelines meet the highest standards of performance, scalability, and accuracy.
The ideal candidate will have deep experience in quality engineering, observability, AI/ML, and performance monitoring.
Here is how, through this exciting role, YOU will contribute to BMC's and your own success:
BMC Helix maintains a strict policy of not requesting any form of payment in exchange for employment opportunities, upholding a fair and ethical hiring process.
At HELIX we believe in pay transparency and have set the midpoint of the salary band for this role at 4,542,800 INR. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs.
The salary listed is just one component of HELIX's employee compensation package. Other rewards may include a variable plan and country specific benefits.
We are committed to ensuring that our employees are paid fairly and equitably, and that we are transparent about our compensation practices.
(Returnship@BMC) Had a break in your career No worries. This role is eligible for candidates who have taken a break in their career and want to re-enter the workforce. If your expertise matches the above job, visit to [1] https://bmcrecruit.avature.net/returnship know more and how to apply. References Visible links 1. https://bmcrecruit.avature.net/returnship
This Is Helix. Powered by You. At BMC Helix, we don't do ordinary. We're the AI-native engine behind the world's most forward-thinking IT organizations, helping them focus on what matters most. What are we passionate about We're here to reset the economics of enterprise IT and help others realize the ROI of AI. We are a mix of curious minds, creative thinkers, and courageous builders who believe tech should change the game—not just play it. We celebrate wins, support each other, and laugh a lot. We are the change makers. With decades of leadership and established trust in IT service and operations management, we're scaling with purpose—through organic innovation, strategic acquisitions, and relentless R&D. Our open-first Agentic AI platform empowers autonomous agents to drive real outcomes with speed, accountability, and precision. We are laser-focused on delivering real value to our customers by accelerating innovation and the application of applying agentic AI in digital service and operations management for IT organizations around the world.
The Helix product line includes industry-leading Digital Services and Operation Management products. We have many interesting SaaS products, in the fields of: Predictive IT service management, Automatic discovery of inventories, intelligent operations management, and more! We continuously grow by adding and implementing the most cutting-edge technologies and investing in Innovation! Our team is a global and versatile group of professionals, and we LOVE to hear our employees innovative ideas. So, if Innovation is close to your heart - this is the place for you!
We are looking for a highly skilled Manager of Quality Engineering for Observability and AI to lead our efforts in ensuring the quality and reliability of our observability solutions and AI-powered systems. This role will oversee the testing, validation, and optimization of AI-driven monitoring tools and observability platforms while ensuring that AI models and data pipelines meet the highest standards of performance, scalability, and accuracy.
The ideal candidate will have deep experience in quality engineering, observability, AI/ML, and performance monitoring.
Here is how, through this exciting role, YOU will contribute to BMC's and your own success:
- Leadership & Team Management: Lead and mentor a team of quality engineers focused on AI systems, observability platforms, and monitoring tools, driving a culture of quality, collaboration, and continuous improvement.
- Quality Assurance Strategy for Observability & AI Systems: Develop and execute comprehensive quality engineering strategies for AI-powered observability solutions, ensuring that monitoring, logging, and alerting systems meet performance, reliability, and accuracy standards.
- Observability & AI Testing: Ensure the observability systems for AI/ML models and applications are well-tested and continuously monitored for performance, scalability, and reliability.
- Integration of Observability into AI Systems: Drive automation of testing for observability components such as metrics collection, alerting thresholds, and log generation to ensure high availability and real-time monitoring of AI systems.
- Collaboration & Cross-Functional Communication: Partner with AI, DevOps, SRE (Site Reliability Engineering), and product teams to ensure a holistic approach to quality and observability across AI systems.
- You have 12+ years of experience in Manual and automation testing/Engineering
- Strong knowledge of AI/ML testing methodologies, model evaluation metrics, and data pipeline testing.
- Proficiency in observability and monitoring tools (e.g., Prometheus, Grafana, ELK stack, Splunk) and frameworks for real-time metrics, alerting, and logging.
- Expertise in test automation (selenium - Java; Python), particularly for AI applications and observability systems.
- Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and their monitoring capabilities for AI-driven solutions.
- You have experience in Agile development model with exposure to Jira, confluence, etc.
- Certification in AI/ML (e.g., TensorFlow, machine learning certifications) or observability tools.
- Experience with real-time monitoring and anomaly detection systems in AI applications.
- Familiarity with AI fairness, explainability, and bias detection techniques in AI systems.
BMC Helix maintains a strict policy of not requesting any form of payment in exchange for employment opportunities, upholding a fair and ethical hiring process.
At HELIX we believe in pay transparency and have set the midpoint of the salary band for this role at 4,542,800 INR. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs.
The salary listed is just one component of HELIX's employee compensation package. Other rewards may include a variable plan and country specific benefits.
We are committed to ensuring that our employees are paid fairly and equitably, and that we are transparent about our compensation practices.
(Returnship@BMC) Had a break in your career No worries. This role is eligible for candidates who have taken a break in their career and want to re-enter the workforce. If your expertise matches the above job, visit to [1] https://bmcrecruit.avature.net/returnship know more and how to apply. References Visible links 1. https://bmcrecruit.avature.net/returnship
More Info
Key Skills
AI ML testing methodologies
model evaluation metrics
cloud platforms
Agile development model
data pipeline testing
observability and monitoring tools
