Search by job, company or skills

Data Engineer - Azure Databricks

Data Engineer - Azure Databricks

the it firm
5-7 Years
Not Disclosed

This job is no longer accepting applications

Job Description

Role : Azure Databricks Data Engineer

Location : Bangalore

Experience : 5 to 7 Years

About The Role

We are looking for a highly skilled Azure Databricks Data Engineer with 57 years of experience in designing, developing, and optimizing enterprise-scale data engineering solutions on the Microsoft Azure Cloud Platform.

The ideal candidate should have strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Apache Spark (PySpark/Scala), ETL/ELT pipelines, and Data Engineering. Experience with SAP BW integration is an added advantage.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines using Microsoft Azure Data Services.
  • Develop and optimize ETL/ELT workflows using Azure Databricks and Apache Spark.
  • Integrate SAP BW data with Azure-based modern data platforms.
  • Develop high-performance data processing solutions using PySpark and/or Scala.
  • Implement efficient data models to support analytics, reporting, and business intelligence.
  • Optimize data pipelines for scalability, reliability, and performance.
  • Collaborate with cross-functional teams to gather business requirements and deliver robust data solutions.
  • Follow best practices for coding standards, data governance, security, and performance optimization.

Required Skills

  • Azure Databricks
  • Microsoft Azure
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • Azure Synapse Analytics
  • Apache Spark
  • PySpark
  • Scala
  • ETL & ELT Development
  • Data Engineering
  • Data Integration
  • Data Modeling
  • Performance Tuning & Optimization
  • Azure Cloud Services
  • SAP BW Integration (Preferred)

Required Experience

  • 5 to 7 years of hands-on experience in Azure Databricks and/or SAP BW.
  • Strong experience working within the Microsoft Azure ecosystem.
  • Proven expertise in building enterprise-scale data engineering solutions.
  • Excellent analytical, troubleshooting, and problem-solving skills.
  • Strong communication and collaboration abilities.
  • Experience working in Agile/Scrum environments.

Preferred Qualifications

  • Experience with enterprise-scale cloud data platforms.
  • Strong understanding of modern cloud data architecture.
  • Knowledge of data governance and best development practices.
  • Ability to work in a fast-paced enterprise environment.

(ref:hirist.tech)

More Info

Job Type:
Industry:
Employment Type:

Key Skills

ETL ELT Development

Azure Data Lake Storage ADLS

Azure Data Factory ADF

Performance Tuning Optimization

SAP BW Integration

About Company

Similar Jobs

5-7 yrs
Bengaluru, India
Skills:
Spark SQL, Scipy, Pyspark, Azure Databricks, Numpy, Pandas, Azure Data Lake, Python, RDDs, Databricks Notebooks, MLflow, DataFrames, Synapse Analytics, Delta Lake, Blob Storage, Spark Pools
5-7 yrs
Bengaluru, India
Skills:
snowflake , Data Modeling, Sql, ELT, Apache Airflow, Git, MLops, Docker, Data Architecture, Gitlab, Databricks, Rest Apis, Azure, Kubernetes, Python, Etl, AWS, cdc, Airbyte, AI Coding Assistants
6-8 yrs
Bengaluru, India
Skills:
Pyspark, ELT, Azure Synapse, Azure Functions, Terraform, Python, Power Bi, Sql, Azure Data Factory, Databricks, Data Modeling, Mosaic AI, Medallion Architecture, Delta Live Tables, CI CD, LLMs, Logic Apps, GitHub CoPilot, Unity Catalog, ADLS, Gen AI, Azure Data Engineer, AI GenAI-driven innovation, Cost Optimization
3-5 yrs
Bengaluru, India
Skills:
Spark SQL, Pyspark, Data Warehousing, Sql, Dimensional Modeling, ELT, Devops, Git, Gcp, Databricks, Azure, Etl, AWS, Spark architecture, Data lake architectures, Delta Lake
7-14 yrs
Bengaluru, Hyderabad
Skills:
Azure Databricks, Data Modeling, SQL Server, Data Warehousing, Python Scripting, Cloud Solutions, Data Governance, Performance Tuning, ETL Processes, Spark Programming