Databricks Data Engineer

Unison Group New Zealand

Bengaluru, India

3-5 Years

Save

Posted 3 hours ago
Be among the first 10 applicants

Early Applicant

Job Description

Job Summary

We are seeking a skilled Databricks Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on modern cloud platforms. The ideal candidate should have strong experience with Apache Spark, Databricks, and cloud-based data engineering, along with a solid understanding of data warehousing and ETL processes.

Key Responsibilities

Design and develop scalable data pipelines using Databricks (Delta Lake, Spark, Notebooks)
Build and maintain ETL/ELT workflows for structured and unstructured data
Implement data ingestion frameworks from multiple sources (APIs, databases, streaming)
Optimize Spark jobs for performance, scalability, and cost efficiency
Work with Azure/AWS/GCP cloud services for data storage and processing
Develop and manage data models and data lakes/lakehouse architectures
Ensure data quality, governance, and security across pipelines
Collaborate with data scientists, analysts, and business stakeholders
Automate deployments using CI/CD pipelines
Monitor and troubleshoot production data pipelines

Required Skills & Qualifications

Bachelor's degree in Computer Science, Engineering, or related field
3+ years of experience in data engineering
Hands-on experience with Databricks
Strong programming skills in Python / Scala / SQL
Expertise in Apache Spark (PySpark preferred)
Experience with Delta Lake, Data Lake, Lakehouse architecture
Knowledge of Azure Data Factory, AWS Glue, or similar tools
Strong SQL and database skills (RDBMS, NoSQL)
Familiarity with data warehousing concepts (Star/Snowflake schema)
Experience with version control tools like Git

Preferred Skills

Experience with streaming technologies (Kafka, Structured Streaming)
Knowledge of Azure Synapse Analytics or Snowflake
Exposure to DevOps tools (Jenkins, Terraform, Docker)
Understanding of data governance and security frameworks
Certification in Databricks or Cloud platforms

Key Competencies

Strong problem-solving and analytical skills
Ability to work in Agile/Scrum environments
Excellent communication and collaboration skills
Attention to detail and commitment to data quality

More Info

Job Type:

Industry:

Function:

Employment Type:

About Company

Unison Group New ZealandJob Source: www.linkedin.com

Job ID: 147519809

Jobs by Skill - IT

Jobs by Skill - Non IT

International Jobs

Last Updated: 16-05-2026 02:08:34 AM

Homejobs in Bengaluru / BangaloreDatabricks Data Engineer

Similar Jobs

Senior Databricks Data Engineer

Artech Infosystems Private Limited

5-8 yrs

₹ 23 - 26 LPA

Hyderabad, Bengaluru, Noida

Skills:

Azure, aws, Databricks

Lead Databricks Data Engineer

Qualcomm

7-9 yrs

Bengaluru, India

Skills:

data engineering , Data Modelling, Data Structures, Data Governance, Sql, Nosql, Security Compliance, Databricks, Python, AWS, Acceldata, AI assisted development, Data quality monitoring, Data Analysis, Fivetran, Cost Optimization, Pipeline observability

Azure Databricks- Data Engineer- Chennai

Tredence Inc.

6-8 yrs

Bengaluru, India

Skills:

Data Management, Cloud Services, Data Warehouse, Sql Db, ELT, Azure Synapse, Data Extraction, Azure Data Factory, Databricks, Data Integration, Etl, workflow orchestration, serverless infrastructure, ADLS, Azure services, Event-driven cloud platform, Azure Cloud Data Engineering components