Senior Data Engineer

Position: Sr. Data Engineer

Location: Noida, Sector 132

Experience: Minimum 2.5 years

Joining Preference: Immediate Joiners

Job Summary

We are looking for a skilled and experienced Senior Data Engineer with strong expertise in the Azure Data Engineering ecosystem. The ideal candidate should have hands-on experience in designing and developing scalable data pipelines, batch and real-time data processing, and working with Azure data services. The candidate will be responsible for building robust data solutions, collaborating with cross-functional teams, and contributing to end-to-end data engineering projects.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and data processing

solutions on Microsoft Azure.

• Develop and manage ETL/ELT pipelines using Azure Data Factory (ADF).

• Work extensively with Azure Data Lake Storage (ADLS) and Azure Databricks.

• Implement batch and real-time data ingestion and processing solutions.

• Develop data transformation solutions using PySpark / Spark / Scala.

• Work with Delta Lake and Spark Structured Streaming.

• Design and work with Azure Synapse Analytics / Synapse Workspace.

• Work with Azure SQL Data Warehouse / Azure Synapse and Cosmos DB.

• Develop and maintain data models and optimize data processing workflows.

• Use Python and Shell scripting for automation and data engineering tasks.

• Work with Azure DevOps for source control, CI/CD, and deployment processes.

• Understand and work with basic Azure infrastructure and cloud concepts.

• Participate in end-to-end implementation of data engineering projects.

• Troubleshoot performance, data quality, and pipeline-related issues.

• Collaborate with technical teams, stakeholders, and clients to understand

requirements and deliver effective data solutions.

Required Skills

• Minimum 2.5 years of relevant experience in Data Engineering.

• Strong hands-on experience with:

o Azure Data Factory

o Azure Data Lake / ADLS

o Azure Databricks

o Azure Synapse Analytics

o PySpark / Spark / Scala

o Delta Lake

o Spark Streaming

• Strong understanding of batch and real-time data processing.

• Good knowledge of Azure SQL / SQL Data Warehouse and Cosmos DB.

• Good programming experience in Python.

• Knowledge of Shell scripting.

• Understanding of Azure DevOps, CI/CD, and Azure infrastructure concepts.

• Strong SQL and data manipulation skills.

• Ability to work independently as well as collaboratively in a team environment.

• Strong analytical, problem-solving, and communication skills.

Good to Have

• Azure or other relevant cloud certifications.

• Experience working on an end-to-end Azure Data Engineering project.

• Experience interacting directly with clients or stakeholders.

• Knowledge of data architecture and scalable cloud-based data solutions.