Role : Azure Databricks Data Engineer
Location : Bangalore
Experience : 5 to 7 Years
About The Role
We are looking for a highly skilled Azure Databricks Data Engineer with 57 years of experience in designing, developing, and optimizing enterprise-scale data engineering solutions on the Microsoft Azure Cloud Platform.
The ideal candidate should have strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Apache Spark (PySpark/Scala), ETL/ELT pipelines, and Data Engineering. Experience with SAP BW integration is an added advantage.
Key Responsibilities
- Design, build, and maintain scalable data pipelines using Microsoft Azure Data Services.
- Develop and optimize ETL/ELT workflows using Azure Databricks and Apache Spark.
- Integrate SAP BW data with Azure-based modern data platforms.
- Develop high-performance data processing solutions using PySpark and/or Scala.
- Implement efficient data models to support analytics, reporting, and business intelligence.
- Optimize data pipelines for scalability, reliability, and performance.
- Collaborate with cross-functional teams to gather business requirements and deliver robust data solutions.
- Follow best practices for coding standards, data governance, security, and performance optimization.
Required Skills
- Azure Databricks
- Microsoft Azure
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics
- Apache Spark
- PySpark
- Scala
- ETL & ELT Development
- Data Engineering
- Data Integration
- Data Modeling
- Performance Tuning & Optimization
- Azure Cloud Services
- SAP BW Integration (Preferred)
Required Experience
- 5 to 7 years of hands-on experience in Azure Databricks and/or SAP BW.
- Strong experience working within the Microsoft Azure ecosystem.
- Proven expertise in building enterprise-scale data engineering solutions.
- Excellent analytical, troubleshooting, and problem-solving skills.
- Strong communication and collaboration abilities.
- Experience working in Agile/Scrum environments.
Preferred Qualifications
- Experience with enterprise-scale cloud data platforms.
- Strong understanding of modern cloud data architecture.
- Knowledge of data governance and best development practices.
- Ability to work in a fast-paced enterprise environment.
(ref:hirist.tech)
