Search by job, company or skills

Lead Data Engineer

aurumjin consulting pte. ltd.
3-6 Years
SGD 1.08 - 1.5 LPA
Singapore
Early Applicant
  • Posted 2 days ago
  • Be among the first 10 applicants

Job Description

  • Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data.
  • Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data.
  • Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch.
  • Collaborate with data engineers, data scientists, and other stakeholders to understand requirements and translate them into technical specifications and solutions.
  • Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques.
  • Optimize data engineering workflows for containerized deployment and efficient resource utilization.
  • Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability.
  • Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements.
  • Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure.

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Data Engineering
Employment Type:
Full time

Job ID: 152498415

Last Updated: 19-08-2026 05:05:22 PM
Homejobs in SingaporeLead Data Engineer

Similar Jobs

Lead Data Engineer

lionsbot international
Singapore

Skills:

geospatial data , schemas , S3, PostgreSQL, Kafka, Indexes, Neo4j, Elasticsearch, Database Design, Python, AWS, Java, RDS, Sql, Gcp, ROS, Influxdb, Azure, message-queue systems, time-series databases, Go, OLAP engines, event-driven data, EKS, OpenRMF, data models, CDC pipelines, TimescaleDB, Quickwit

Lead Data Engineer

epergne solutions
Singapore

Skills:

Data Modelling, Spark, Data Governance, Databricks, Data Integration, Python, Sql, ELT, Etl, data contracts, data quality frameworks

Senior/Lead Data Engineer

charles & keith group
Singapore

Skills:

Sql, Python, Spark, Flink, Alibaba Cloud, Hologres, MaxCompute, DataWorks

Lead Data Engineer

Aon
Singapore

Skills:

Sql, Databricks, Etl, ELT, Python, Data Warehousing, Apache Spark, Data Modelling, Pyspark

Technical Manager/ Data Project Manager (Lead Data engineer)

Unison Group New Zealand
Singapore

Skills:

Spark SQL, Hadoop Ecosystem, Pyspark, Data Modeling, Sql, Gcp, Azure, Python, AWS, Data Lakes, ETL ELT frameworks, DevOps practices, Lakehouse architectures, CI CD, Performance tuning and optimisation, Data migration strategies, Distributed data processing frameworks, Data integration patterns, Real-time processing

Beware of Scammers

We don’t charge money for job offers

Know More