Quality Assurance Engineer

Hiring: QA Engineer Azure & Databricks (Data Platform)

Experience: 8+ Years

Location: Indore / Pune / Bengaluru

Joining: Immediate / Currently Serving (Feb Joiners Preferred)

Role Overview

We are looking for a Senior QA Engineer with strong experience in Azure Data Platforms and Databricks environments. The role involves testing data pipelines, Spark transformations, Delta Lake implementations, and Azure-based integrations while ensuring data quality, security, and reliability across environments.

Key Responsibilities

Define and maintain test strategies for Databricks notebooks, jobs, APIs, and Azure data pipelines.

Perform end-to-end testing of Spark/PySpark transformations and Delta Lake features (MERGE, schema evolution, time travel).

Implement data quality validations (completeness, accuracy, consistency, referential integrity).

Test Azure Data Factory, ADLS Gen2, Azure SQL, Event Hub/Kafka, and Key Vault integrations.

Validate IAM/RBAC, Unity Catalog permissions, and secure access patterns.

Integrate automated tests into CI/CD pipelines (Azure DevOps/GitHub Actions).

Support infrastructure validation (Terraform/Bicep plan reviews).

Create reusable test utilities using Python & SQL.

Monitor pipeline reliability using Azure Monitor & logging tools.

Required Skills

8+ years in QA/Test Engineering with strong exposure to Data Platforms.

Hands-on experience with Azure Databricks (Notebooks, Jobs, Delta Lake).

Strong Python & SQL for testing and data validation.

Experience testing ETL/ELT pipelines and batch/streaming workflows.

Hands-on with Azure Data Factory, ADLS Gen2, Key Vault.

CI/CD integration for automated data testing.

API testing (REST / Databricks Jobs API).

Understanding of data security, RBAC, and cloud best practices.

Good to Have

Unity Catalog & Data Governance testing

Structured Streaming / Delta Live Tables

Spark performance testing & optimization

Exposure to compliance standards (GDPR, PII masking)