Role Summary
We are looking for a
Data Quality Engineer to ensure
data accuracy, consistency, and reliability across enterprise data platforms.
The role involves working with large datasets, building and validating
data pipelines, and implementing
data quality frameworks within a modern cloud ecosystem using Microsoft Azure and Databricks.
Key ResponsibilitiesData Quality & Validation
- Design and implement data quality checks, validation rules, and monitoring frameworks.
- Ensure data accuracy, completeness, and consistency across systems.
- Identify and resolve data anomalies and quality issues.
Data Engineering & Processing
- Work with large-scale datasets using SQL and Databricks.
- Support ETL/ELT pipelines for data ingestion and transformation.
- Handle batch and near real-time data processing.
Data Architecture & Modeling
- Work with data lakes, data warehouses, and Lakehouse architectures.
- Apply data modeling concepts (dimensional and relational).
- Ensure alignment with data architecture standards.
Governance & Metadata
- Collaborate on data governance, metadata management, and lineage tracking.
- Work with tools like Collibra (preferred).
- Support compliance and regulatory requirements (especially in banking/finance domains).
Collaboration & Monitoring
- Work closely with data engineers, analysts, and business teams.
- Monitor data pipelines and ensure high data reliability and availability.
- Document data quality processes and standards.
Required Skills Core Skills
- Strong expertise in SQL and large dataset handling.
- Hands-on experience with Databricks.
- Experience with data quality tools and frameworks.
- Experience in ETL/ELT pipelines.
Data Platforms
- Experience with relational and NoSQL databases.
- Familiarity with cloud platforms like Azure.
Data Architecture- Understanding of:
- Data Warehouses
- Data Lakes
- Lakehouse Architecture
Nice to Have
- Programming: Python / Scala / Java
- Orchestration tools: Airflow, Control-M
- Tools like Collibra
- Knowledge of data governance and lineage
- Exposure to banking / regulatory environments
Certifications (Preferred)
- Azure Data / Cloud Certifications
- CDMP (Certified Data Management Professional)
- AWS Data Certifications
Skills: data governance,data lakes,sql,lakehouse architecture,python,java,nosql,data warehouse,collibra,elt,etl,cloud certifications,azure,databricks,cloud,cdmp,data quality
