Search by job, company or skills

Quest Global

Data Engineering- Tech Lead

new job description bg glownew job description bg glownew job description bg svg
  • Posted 14 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Requirements

At Quest Global, it's not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better placeto make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.

Key Responsibilities

Technical Leadership

  • Own end-to-end data platform architecture (batch + streaming)
  • Design scalable, low-latency pipelines for high-volume data
  • Lead development using Spark / PySpark / SQL / Kafka
  • Drive performance optimization and cost efficiency
  • Review designs, code, and data models for best practices
  • Ensure data reliability, quality, and SLA adherence

People & Delivery Leadership

  • Lead, mentor, and grow a team of data engineers
  • Plan sprint execution, capacity, and delivery commitments
  • Drive engineering excellence through standards and reviews
  • Partner with Product, ML, and Analytics teams
  • Handle technical escalations and production issues

Platform & Governance

  • Define data standards, schema evolution, and lineage
  • Implement monitoring, alerting, and observability
  • Drive adoption of CI/CD, automation, and DevOps practices
  • Ensure security, compliance, and access controls

Required Skills

Core Technical

  • Expert in Python / Scala
  • Strong Spark / PySpark (batch & structured streaming)
  • Advanced SQL and query optimization
  • Streaming systems: Kafka / PubSub
  • Data stores: Hive, HDFS, Parquet, ORC
  • OLAP systems: Druid / BigQuery / ClickHouse
  • NoSQL: HBase / Cassandra / Aerospike

Cloud & Platform

  • Hands-on experience with GCP / AWS
  • Workflow orchestration: Airflow / Dagster
  • Docker and Kubernetes fundamentals
  • Experience with multi-DC or hybrid architectures

Good to Have

  • Experience in AdTech / DSP / MMP / RTB platforms
  • ML feature pipelines and offline/online feature stores
  • Experience handling billions of events/day
  • Exposure to RocksDB, stateful stream processing
  • Architecture review and tech roadmap ownership

Leadership & Soft Skills

  • Strong technical decision-making
  • Ability to balance hands-on coding + team leadership
  • Excellent stakeholder communication
  • Ownership mindset and bias for action

Business Impact

  • Drive scalable data foundations for analytics and ML
  • Improve system reliability and data trust
  • Enable real-time insights and optimization

We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.

We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 139374163