Data Engineer with Databricks, AWS

Virtusa

5-8 Years

India

This job is no longer accepting applications

Job Description

'Data Engineer – AWS Databricks (Offshore)

Experience 5–8 years

Primary Responsibilities

Support data engineering activities for enterprise data modernization initiatives using AWS Databricks and Lakehouse architecture.
Analyze and validate existing data ingestion pipelines, CDC processes, AWS S3 landing zone, and Bronze layer datasets.
Perform source-to-Bronze and Bronze-to-Silver data validation, reconciliation, and data quality assessment.
Analyze existing transformation logic, including deduplication, standardization, cleansing, and business rule implementations.
Develop and maintain data transformation pipelines using Databricks, Spark, PySpark, and SQL.
Support implementation and validation of Silver and Gold layer data structures aligned with enterprise data models.
Perform data profiling to identify completeness, accuracy, consistency, and quality issues.
Develop SQL queries and validation scripts for data reconciliation and testing activities.
Collaborate with Data Modelers and Business Analysts to validate data structures, mappings, and business rules.
Support source-to-target mapping documentation and technical lineage documentation.
Troubleshoot data pipeline issues, performance challenges, and data quality defects.
Implement logging, error handling, monitoring, and operational support processes for data pipelines.
Participate in technical reviews, defect resolution, testing cycles, and production readiness activities.
Follow engineering standards, coding practices, version control, and deployment processes.

Mandatory Skills

AWS Databricks, Apache Spark, PySpark, SQL, Python, Data Engineering, ETL/ELT Development, Data Transformation, Data Validation, Data Profiling, AWS S3, Delta Lake, Data Warehouse Concepts.

Preferred Skills

Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, CDC processing, AWS Glue, Informatica, SSIS, Data Quality Frameworks, CI/CD, Git, Terraform, Power BI data model understanding.

More Info

Job Type:

Industry:

Function:

Employment Type:

About Company

Virtusa

Job ID: 151698187

Jobs by Skill - IT

Jobs by Skill - Non IT

International Jobs

Last Updated: 28-07-2026 06:24:59 PM

Homejobs in IndiaData Engineer with Databricks, AWS

Similar Jobs

Data Engineer - Databricks Focus

Allison Transmission

4-7 yrs

Pune, India

Skills:

Pyspark, Spark, Databricks, Sql, Python, GitHub Actions, Databricks Asset Bundles, Delta Lake, Unity Catalog

IN_Senior Associate_Data Engineer Databricks_Data and Analytics_Advisory_Hyderabad

PwC

5-8 yrs

Hyderabad

Skills:

Pyspark, Databricks, Sql, ELT, Etl, Agile, Data Warehousing, Spark SQL, Distributed Computing, Apache Spark, Delta Lake, Lakehouse architecture

Application Developer-AWS Cloud FullStack

IBM

4-6 yrs

Bengaluru, India

Skills:

Java, CSS, Kafka, Nodejs, HTML, Sql, Angular, Javascript, Zookeeper, Reactjs, Python, AWS, No-SQL

AWS+Java Full Stack

Tata Consultancy Services

5-10 yrs

Chennai, India

Skills:

PostgreSQL, Spring Boot, J2EE, Jira, Css3, Microservices, Angular, Spring, Jenkins, Git, React, JUnit, Javascript, Mockito, Core Java, MySQL, Html5, MongoDB, Restful Apis, Amazon Aurora

Lead Data Engineer | Databricks

Sonata Software

8-10 yrs

Bengaluru, India

Skills:

Github, Machine Learning, Metadata Management, Pyspark, BI, ELT, Terraform, Advanced Analytics, Azure DevOps, Apache Spark, Sql, Jenkins, Data Quality, Data Governance, Databricks, Azure, Kubernetes, Etl, lineage, Privacy, infrastructure automation, Databricks Workflows, Generative AI, Unity Catalog, DataOps, CI CD pipelines, Delta Lake, compliance frameworks