Job Title: Lead Data QA Automation Engineer (ETL | Snowflake | Python | AWS)
Experience: 8+
Location: Remote
Type: Contract
About The Role
We are looking for a
Lead Data QA Automation Engineer to design, develop, and drive test automation frameworks for our enterprise data ecosystem. The ideal candidate has a strong foundation in
ETL testing,
data validation, and
Python-based automation, with hands-on experience across modern data platforms like
Snowflake,
AWS, and
SQL Server.
You will collaborate closely with Data Engineers, BI Developers, and DevOps teams to ensure
end-to-end data quality, accuracy, and reliability across pipelines and analytics layers.
Key Responsibilities
Data Warehouse & Database Validation
- Write and execute complex SQL queries (joins, CTEs, window functions) to validate data integrity and transformations.
- Validate data migrations and transformations across heterogeneous systems (e.g., SQL Server Snowflake).
- Ensure schema, metadata, and aggregation accuracy during ETL processes.
- Conduct data reconciliation, completeness, and performance validation.
ETL & Data Pipeline Testing
- Review and validate ETL mappings, transformations, and business rules.
- Perform end-to-end validation of source-to-target data flows.
- Collaborate with Data Engineering teams on issue resolution and defect tracking.
- Test data pipelines developed using tools such as Informatica, Azure Data Factory, SSIS, or dbt.
Automation Framework Development
- Design and implement Python-based data validation frameworks using Pytest, unittest, or TestNG.
- Automate ETL and data reconciliation tests for scalability and reusability.
- Integrate data QA automation into CI/CD pipelines (GitLab, Jenkins, or GitHub Actions).
- Maintain version control and reporting via Git-based workflows.
Cloud & BI Ecosystem
- Work hands-on with Snowflake for query optimization, data validation, and automation integration.
- Utilize AWS services (e.g., S3, Lambda, Redshift) to validate cloud data workflows.
- Perform downstream validation of BI reports built in Tableau or Power BI to ensure end-to-end accuracy.
Required Skills
- Strong SQL expertise with complex query development and debugging.
- Proven experience in ETL automation testing and data warehouse validation.
- Proficiency in Python scripting for automation (Pytest, unittest, etc.).
- Experience with Snowflake, SQL Server, and AWS.
- Familiarity with CI/CD tools like GitLab, Jenkins, or GitHub Actions.
- Understanding of ETL tools (Informatica, ADF, SSIS, dbt).
- Exposure to Tableau, Power BI, or Looker for report validation.
Preferred Skills
- Experience developing or enhancing data quality automation frameworks.
- Familiarity with data quality tools or monitoring frameworks.
- Knowledge of data governance, data lineage, or metadata management concepts.
- Experience working in agile/scrum environments with data engineering teams.
Skills: aws,ci/cd,sql,python,snowflake testing,etl testing,snowflake,etl,data quality,qa automation,automation,aws data qa,etl automation tester,etl tester,data qa engineer,test automation framework,python automation
