Search by job, company or skills

Data Quality Engineer

Data Quality Engineer

EPAM
3-5 Years
Not Disclosed

This job is no longer accepting applications

Job Description

We are seeking a highly skilled and detail-oriented Data Quality Engineer (Automation) to join our data engineering team.

The ideal candidate will have a strong background in ETL automation, data warehouse testing, and cloud data services, along with hands-on experience in test automation frameworks and CI/CD practices.

Responsibilities

  • Design, develop, and execute automated test scripts for validating ETL workflows and data pipelines
  • Perform end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
  • Collaborate with data engineers, analysts, and stakeholders to define test strategies and ensure data quality standards are met
  • Develop reusable and scalable test automation frameworks using Python and SQL
  • Integrate automated tests into CI/CD pipelines to ensure continuous testing and delivery
  • Validate data transformation logic and completeness across different cloud platforms (Azure, AWS, GCP)
  • Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and story grooming

Requirements

  • 3.5+ years of hands-on experience in Data Quality Engineering
  • Strong hands-on experience in ETL automation and Data Warehouse/Data Lake testing
  • Proficiency in SQL for data validation and test automation
  • Good knowledge of Python for scripting and framework development
  • Experience with one or more Test Automation Frameworks
  • Knowledge of Cloud Data Services, including Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), or GCP (BigQuery)
  • Understanding of CI/CD tools and practices (e.g., Jenkins, Git, Azure DevOps)
  • Familiarity with Agile/Scrum methodologies with a proven ability to contribute effectively
  • English language proficiency at an Upper-Intermediate level (B2) or higher

Nice to have

  • Experience working with data observability or data quality tools (e.g., Great Expectations, Deequ)
  • Basic understanding of data governance and metadata management concepts
  • Certification in cloud platforms (Azure/AWS/GCP)

More Info

Job Type:
Industry:
Employment Type:

Key Skills

CI CD tools

Cloud Data Services

ETL automation

Test Automation Frameworks

Data Lake testing

About Company

Similar Jobs

5-10 yrs
Pune, India
Skills:
data engineering , Databricks, Data Modeling, Azure Data Factory, Collibra, Google Cloud, Data Warehousing, data product, Deequ, Great Expectations, medallion architecture, data platform concepts, data mesh, Microsoft Purview, Reporting, enterprise data catalogs, data quality practices, Ataccama, ETL processes