Search by job, company or skills

Data Quality Engineer

Data Quality Engineer

EPAM
4-6 Years
Not Disclosed
Early Applicant
  • Posted a day ago
  • Be among the first 10 applicants

Job Description

We are looking for a Data Quality Engineer to build ETL/ELT solutions and DWH/DB systems at scale. You will create Python- and SQL-based test automation, validate DWH/Data Lake pipelines, and embed checks into CI/CD workflows across cloud data services.

Responsibilities

  • Design automated test scripts to validate ETL workflows and data pipeline behavior
  • Execute end-to-end data validation, reconciliation, and DWH/DB testing across large datasets
  • Collaborate with data engineers, analysts, and stakeholders to align test strategies with data quality standards
  • Build reusable, scalable test automation frameworks using Python and SQL
  • Integrate automated tests into CI/CD pipelines to enable continuous testing and delivery
  • Validate data transformation logic and completeness across Azure, AWS, and GCP platforms
  • Contribute to Agile ceremonies, including sprint planning, retrospectives, and story grooming

Requirements

  • Professional experience of 4-6 years in data quality engineering, including ETL automation and Data Warehouse/Data Lake testing
  • Strong command of SQL for data validation, reconciliation, and test automation routines
  • Hands-on knowledge of Python for scripting, utilities, and framework development
  • Practical experience with one or more Test Automation Frameworks
  • Working exposure to Cloud Data Services across Azure (ADF, ADB), AWS (Glue, Lambda, Redshift), and GCP (BigQuery)
  • Solid understanding of CI/CD tools and practices, including Jenkins, Git, and Azure DevOps
  • Familiarity with Agile/Scrum methodologies and iterative delivery

Nice to have

  • Experience with data observability or data quality tools such as Great Expectations or Deequ
  • Basic knowledge of data governance and metadata management concepts
  • Cloud certifications in Azure, AWS, or GCP

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

5-7 yrs
Bengaluru, India
Skills:
Cloud-based environments (AWS preferred), Appium, Selenium, Restful Apis, Sql, Microservices, Java, C#, Version Control Systems, Automation Frameworks, Python, CI/CD pipelines, Automation design patterns
7-10 yrs
Bengaluru, India
Skills:
snowflake , Power Bi, SAS, Pyspark, Jira, Sql, Confluence, Data Warehouse Testing, Data Lake, Informatica Powercenter, Python, Azure DevOps, Etl, Business Intelligence
3-5 yrs
Bengaluru, India
Skills:
Postgres, Robot Framework, Data Warehousing, JIRA, Mssql, Sql, Etl, Python Scripting, Agile Methodology, Oracle, Business Intelligence, AWS cloud services
5-7 yrs
Bengaluru, India
Skills:
Sql, Scala, Databricks, Informatica, Python, Databricks SQL, data analysis tools, ETL processes, data testing and validation techniques