Job Description

Location: Hyderabad / Kolkata

Experience: 7–11 Years

Employment Type: Full-Time

Company: Finarb Analytics Consulting Pvt. Ltd.

About Finarb

Finarb Analytics Consulting is a data, analytics, and AI consulting firm delivering enterprise solutions across data engineering, business intelligence, cloud modernization, and advanced analytics.

About the Role

We are looking for an experienced, hands-on Lead Data Quality Engineer to drive data validation, reconciliation, and quality automation across enterprise data platforms.

The ideal candidate will have strong expertise in SQL, ETL/ELT testing, data quality automation, and data warehousing, with experience in Azure-based environments and preferably Microsoft Fabric.

The role involves leading data quality initiatives, developing automated validation frameworks, ensuring data integrity during platform migrations, and mentoring junior engineers.

Key Responsibilities

Lead data quality engineering, validation, and reconciliation activities across enterprise data platforms.
Design and implement automated data quality testing frameworks using SQL and Python.
Develop complex SQL queries for source-to-target reconciliation, transformation validation, and data integrity checks.
Validate ETL/ELT pipelines, including full loads, incremental loads, CDC, and complex transformations.
Lead data validation and reconciliation during migration from SQL Server and Azure Data Factory to Microsoft Fabric.
Establish data quality standards, testing strategies, and automated monitoring processes.
Investigate production data discrepancies, perform root cause analysis, and implement preventive controls.
Collaborate with data engineers, architects, and BI developers to ensure data accuracy and reliability.
Mentor data quality engineers, conduct technical reviews, and drive engineering best practices.

Required Skills & Qualifications

7–11 years of experience in data quality engineering, ETL testing, or data warehouse testing.
Advanced SQL/T-SQL skills, including complex joins, CTEs, window functions, and query optimization.
Strong experience in ETL/ELT testing, source-to-target validation, and data reconciliation.
Hands-on experience developing automated data quality frameworks using SQL and Python.
Strong understanding of data warehousing, dimensional modeling, and transformation logic.
Experience with SQL Server, Azure Data Factory, and Azure data environments.
Proven ability to troubleshoot complex data discrepancies and production issues.
Experience leading technical teams, reviewing code, and establishing testing standards.
Bachelor's degree in Computer Science, Engineering, or a related field.

Good-to-Have Skills

Microsoft Fabric (Lakehouse, Warehouse, OneLake, Fabric Data Factory).
PySpark and Spark SQL.
Data quality tools such as Great Expectations, Soda, or dbt tests.
Delta Lake and medallion architecture.
Azure DevOps, Git, and CI/CD.
Experience with cloud data migration and modernization projects.
Power BI data validation and Microsoft Purview.

What We're Looking For

A technically strong, hands-on engineering lead who can independently design scalable data quality solutions, automate complex reconciliation processes, and ensure data accuracy across enterprise systems.

Candidates with experience in large-scale data migrations, automated testing frameworks, and Microsoft Fabric will be preferred.

Why Join Finarb