Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

easpire technolabs inc.
8-10 Years
Not Disclosed
Early Applicant
  • Posted a day ago
  • Be among the first 10 applicants

Job Description

Job Title :: Senior Data Engineer – Tick Data

Location: Mumbai

Experience: 8+ Years

Function: Innovation

Job Overview :

We are looking for an experienced Senior Data Engineer with strong expertise in KDB+/q and financial market tick data to design, develop and manage high-performance data engineering solutions.

Key Responsibilities:

  • Design and maintain real-time and batch data ingestion pipelines for financial market tick data.
  • Work with KDB+/q, ClickHouse and other time-series databases.
  • Handle trades, quotes, order book (L2) and historical market data.
  • Implement data quality checks to identify missing, duplicate, incorrect and inconsistent market data.
  • Develop time-series analytics, including OHLC, VWAP, spreads, volatility and liquidity metrics.
  • Optimise database performance, query execution and high-volume data processing.
  • Work with streaming technologies such as Kafka and Solace.
  • Collaborate with trading, quantitative research and risk teams.
  • Monitor production systems, troubleshoot data issues and ensure smooth pipeline operations.

Required Skills & Experience:

  • 8+ years of experience in Data Engineering, preferably within financial markets or capital markets.
  • Strong hands-on experience in KDB+/q.
  • Experience with KDB+ architecture, including Tickerplant, RDB, HDB and Gateway.
  • Hands-on experience with ClickHouse or similar time-series databases.
  • Strong understanding of real-time and historical market data ingestion.
  • Knowledge of market data feeds and protocols such as FIX, ITCH, OUCH and PCAP.
  • Strong programming skills in Python and SQL.
  • Experience with Kafka, Solace or similar messaging technologies.
  • Good understanding of Linux, Shell Scripting, Git and CI/CD.
  • Knowledge of capital markets, trading workflows and exchange operations.

Good to Have:

  • Experience with KX Dashboards, Grafana, Tableau or Power BI.
  • Exposure to AWS, Azure, GCP, Docker or Kubernetes.
  • KX/KDB+ certifications.

Interested candidates can share their updated CV at [Confidential Information] or connect via LinkedIn.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

5-8 yrs
Navi Mumbai, Mumbai, India
Skills:
snowflake , Data Modelling, BigQuery, Power Bi, Tableau, Redshift, Sql, ELT, Git, Gcp, Databricks, Azure, Python, Etl, AWS, Data Ingestion, Airflow, Apache Iceberg, dbt, Delta Lake, CI/CD, Fivetran
5-8 yrs
Mumbai, India
Skills:
Java, Cassandra, Scala, Big Data, Kafka, Sql, Nosql, Hive, RDBMS, Presto, Spark, MongoDB, Python, HDFS
7-9 yrs
Mumbai, India
Skills:
Elk, Pyspark, PostgreSQL, Prometheus, Kafka, Grafana, Nosql, Numpy, Celery, Docker, Terraform, Neo4j, Flask, Oracle, Python, Pytest, Graphql, Cloudformation, Sql, Django, Jenkins, Pandas, FastAPI, Apache Beam, Kubernetes, JanusGraph, unittest, Flink, GitHub Actions, Bitbucket Pipelines, OpenTelemetry, asyncio, Pulsar
8-10 yrs
Mumbai, India
Skills:
Sql, Data Cleaning, Tableau Desktop, Tableau Server, Etl, Dashboard Development, Data Analysis
7-9 yrs
Mumbai, India
Skills:
Data Warehouse, AWS Fargate, Java, AWS Glue, Aws Rds, Etl, Python, MS SQL, PostgreSQL, Snowflake SnowPro Core Certification, AWS Solution Architect Associate, BI Qlik, AWS Data Engineer Specialty, Advanced Data Analytics