QA Manager/Lead ETL

Key responsibilities:

• Lead the QA strategy, planning, and execution for ADF-based data pipelines and workflows.
• Design and implementtest plans, test cases, and test automationfor data ingestion, transformation, and loading processes.
• Validate data accuracy, completeness, and integrity acrosssource systems, staging, and target data stores(e.g., Azure SQL, Synapse, Data Lake).
• Collaborate with data engineers, architects, and business analysts to understand data flows and ensure test coverage.
• Develop and maintainautomated data validation scriptsusing tools likePySpark, SQL, PowerShell, or Azure Data Factory Data Flows.
• Monitor and report ondata quality metrics, defects, and test coverage.
• Ensure compliance withdata governance, security, and privacy standards.
• Mentor junior QA team members and coordinate testing efforts across sprints.

Must have skills:

• At least 2 years in a manager role.
• Experience with Azure cloud.
• Testing file-based data lake solutions or Big data based solution.
• Worked on migration or implementation of Azure Data Factory projects.
• Strong experience inETL/data pipeline testing, preferably withAzure Data Factory.
• Proficiency inSQLfor data validation and test automation.
• Familiarity withAzure services: Data Lake, Synapse Analytics, Azure SQL, Key Vault, and Logic Apps.
• Experience withtest management tools(e.g., Azure DevOps, JIRA, TestRail).
• Understanding ofCI/CD pipelinesand integration of QA in DevOps workflows.
• Experience withdata quality frameworks(e.g., Great Expectations, Deequ).
• Knowledge ofPython or PySparkfor data testing automation.
• Exposure toPower BI or other BI toolsfor test result visualization.
• Azure Data Factory
• Exposure to Azure Databricks
• SQL/stored procedure on SQL Server
• ADLS Gen2
• Exposure to Python/ Shell script

Good to have skills:

• Exposure to any ETL tool experience.
• Any other Cloud experience (AWS / GCP).
• Exposure to Spark architecture, including Spark Core, Spark SQL, DataFrame, Spark
• Streaming, and fault tolerance mechanisms.
• ISTQB or equivalent QA certification.
• Working experience on JIRA and Agile
• Experience with testing SOAP / API projects
• Stakeholder communication
• Microsoft Office

Education Qualification:

• Bachelor's or master's Degree or equivalent Degree or related IT field

Certification If Any:

• Any Basic level certification in AZURE
• Snowflake Associate / Core