Search by job, company or skills

Databricks Data Engineer

Databricks Data Engineer

Unison Group New Zealand
6-10 Years
Not Disclosed
Early Applicant
  • Posted a month ago
  • Be among the first 20 applicants

Job Description

  • We're seeking a hands-on experience in Databricks with deep technical expertise in building and optimizing Lakehouse-based data and AI solutions.
  • In this role, you'll design, develop, and operationalize Delta Lakehouse architectures using Databricks, driving real-world outcomes for enterprise customers. You'll take ownership of implementation tasks, lead technical delivery, and mentor engineering teams in best practices across data engineering, governance, and AI.

Key Responsibilities

  • Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala.
  • Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
  • Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments.
  • Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
  • Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch.
  • Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI.

Required Skills & Experience

  • 6 to10 Years for Strong hands-on experience with Databricks, including workspace setup, notebooks, clusters, and job orchestration.
  • Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
  • Proficiency in Python or Scala for data engineering and ML workflows.
  • Strong understanding of AWS, Azure, or GCP cloud ecosystems.
  • Experience with Terraform automation, DevOps, and MLOps practices.

Familiarity with monitoring and governanceframeworks for large-scale data platforms.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

5-8 yrs
SGD 0.9 - 1.2 LPA
Singapore
Skills:
snowflake , Spark SQL, Pyspark, Sql, Google Cloud, Terraform, Databricks, Azure, Python, AWS, Databricks SQL, CI CD, Infrastructure-as-code, Unity Catalog, Lakeflow Delta Live Tables
10-13 yrs
SGD 0.72 - 1.08 LPA
Singapore, Ubi
Skills:
Performance Tuning, Apis, Mq, Data Warehouse Concepts, Sql, Dimensional Modeling, ELT, Sdlc, Databricks, Azure, Python, Etl, Integration methods, Data Mapping, Job cluster management, pipeline development
3-6 yrs
SGD 0.66 - 0.96 LPA
Singapore
Skills:
data masking , access control management , Data Lineage, Etl Tools, Databricks, Api, Data Governance, Data Quality Checks, Design-Build, Analytics Support, Design, pipeline development, Regulatory Compliance, requirements from stakeholders, Snowflake Cloud Data Warehouse, Monitoring
3-6 yrs
SGD 0.77 - 0.85 LPA
Singapore
Skills:
data engineering , production deployment , Data Management, Pyspark, Apache Spark, AWS Glue, Sql, Cloud Storage, Data Pipeline, Data Lake, Batch Management, Databricks, AWS, Data Transformation, Enterprise Storage System, Analytical and Problem-Solving Skills, Data Quality Management, Technical Writing, Distributed Platforms, Error Handling
3-6 yrs
SGD 0.72 - 0.98 LPA
Singapore
Skills:
Apis, Pyspark, Apache Spark, Data Quality, Tableau, Json, Sql, Xml, Databricks, Data Modelling, Performance optimization, Event or near-real-time ingestion, Delta Live Tables, Auto Loader, Unity Catalog, Git-based tools, Data warehouse integration, Delta Lake, CI/CD, Structured Streaming, Databricks Workflows