Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

Expleo Group
  • Posted 10 hours ago
  • Be among the first 10 applicants

Job Description

Data Engineer / DataOps / IoT Expert

8–9 YEARS

  • 1 FTE
  • BANGALORE

▪ Designs, implements and operates the industrial data lakehouse — Spark, Iceberg, MinIO, InfluxDB, PostgreSQL

▪ Builds end-to-end data pipelines: ingestion, quality, validation and governance

▪ Implements and maintains data gateways for machine and sensor connectivity

▪ Deploys advanced AI components — Qdrant, Neo4j, BrainCube analytics integration

▪ Delivers clean, reliable data flows for advanced analytics; optimizes data infrastructure with DevOps and application teams

Responsibilities

  • Designs and runs the lakehouse + end-to-end data pipelines.
  • Owns ingestion, data quality, validation and governance.
  • Stands up and maintains data gateways for machines and sensors.
  • Feeds clean, reliable data to the analytics and dashboard layers.
  • Works with DevOps to optimize the data infrastructure.

Qualifications

IIoT , time-series / telemetry data, manufacturing analytics, OEE.

Essential Skills

  • Must-have: lakehouse + streaming, ideally time-series ( InfluxDB / IIoT telemetry) — not just batch BI.
  • The Iceberg + Spark + MinIO combo is specific; open-table-format experience really stands out.
  • Ask how they'd tame a chatty sensor firehose plus late-arriving data.

Desired Skills

  • Neo4j / Qdrant is nice-to-have (it feeds the AI/analytics layer), not a gate.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Iceberg

Qdrant

MinIO

BrainCube

About Company

Similar Jobs

8-12 yrs
Bengaluru, India
Skills:
Spark SQL, Csv, Pyspark, Json, Cursor, Sql, Sftp, Databricks, Rest Apis, AWS, Parquet, GitHub Copilot, Delta Lake, Windsurf
8-10 yrs
Bengaluru, India
Skills:
Java, Github, Unix, Apache Spark, Agile Scrum, Kafka, Sql, Redis, Apache Airflow, Git, Docker, Linux, Databricks, Rest Apis, Python, Kubernetes, Aws S3, Jenkins CI-CD, Monitoring Observability Tools, Delta Lake
6-10 yrs
Bengaluru, India
Skills:
snowflake , Azure Data Factory (ADF), Pyspark, Apache Spark, Azure Databricks, Sql, Jenkins, Git, Azure Synapse Analytics, Microsoft Azure, Cosmos DB, Python, Azure DevOps, ADLS Gen2, Azure SQL Database, Delta Lake, CI/CD deployment pipelines
7-9 yrs
Bengaluru, India
Skills:
data warehouses , Storm, Spark, Relational Database, Kafka, Python, AWS, KStreams
10-12 yrs
Bengaluru, India
Skills:
Azure Data Factory, Power Bi, Spark, Python, Sql, Synapse, DevOps practices, MS Fabric, Microsoft Azure Data Lake