We are seeking a detail-focused and highly skilled Data Quality Engineer (Automation) to join our data engineering team.
The candidate will bring expertise in ETL automation, data warehouse testing, and cloud data services, as well as hands-on knowledge of test automation frameworks and CI/CD methodologies.
Responsibilities
- Define and implement automated test scripts to validate ETL workflows and data pipelines
- Ensure end-to-end data validation, reconciliation, and testing across large data sets and DWH systems
- Collaborate with cross-functional teams, including data engineers, analysts, and stakeholders, to establish and meet data quality standards
- Create reusable and scalable test automation frameworks leveraging Python and SQL
- Embed automated tests into CI/CD pipelines to enable continuous testing and delivery cycles
- Ensure data transformation accuracy and consistency across various cloud platforms
- Contribute to Agile ceremonies, sprint planning, retrospectives, and backlog refinement
Requirements
- 5.5+ years of relevant experience
- Background in ETL automation and Data Warehouse/Data Lake testing
- Proficiency in SQL for data validation and automated testing purposes
- Skills in Python for scripting and framework development
- Familiarity with one or more Test Automation Frameworks
- Exposure to cloud data services, including Azure, AWS, and GCP
- Knowledge of CI/CD concepts, tools, and practices such as Jenkins, Git, and Azure DevOps
- Understanding of Agile or Scrum methodologies
Nice to have
- Familiarity with data observability or data quality tools such as Great Expectations or Deequ
- Understanding of data governance principles and metadata management practices
- Background in cloud platform certifications such as Azure, AWS, or GCP
