Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

Shaadi.Com
2-4 Years
Not Disclosed

This job is no longer accepting applications

Job Description

At Shaadi.com, we're not just building a platform — we're playing Cupid for millions across the world! Behind every successful match, swipe, and connection lies a continuous stream of data. With over 100+ million records generated daily, we rely on rock-solid data engineering to power real human stories, smart recommendations, and seamless user experiences.

If you love building heavy-duty pipelines, taming data lakes, and turning raw data streams into matchmaking magic, this is your sign to join our team!

What You'll Do (Your Daily Quests)

Build High-Volume Pipelines: Design, build and maintain scalable data pipelines (real-time and batch) and large-scale distributed systems that ingest, process and organize large volumes of data.

Architect Data Lakes & Warehouses: Manage scalable data architecture across AWS (S3, Redshift, Glue) so our Data Science, Product, and Analytics teams have clean, queryable data at their fingertips.

Stream in Real-Time: Work with streaming frameworks like Kafka to move event data instantly — making sure live activity, recommendations, and notifications happen without a hitch .

Data Zen & Quality Control: Clean, structure, and optimize raw datasets. Monitor data drift, system performance, and maintain immaculate data reliability .

Cross-Functional Collaboration: Partner with Product, Backend Engineering and Data Science teams to build features that directly impact business metrics and user happiness .

What You Bring (Your Tech Superpowers)

Coding Mastery: 2–4 years of hands-on experience in Python (Java or Go is a great plus!) with advanced SQL wizardry .

Cloud & Big Data: Solid experience with AWS services (Redshift, S3, Glue, CloudFormation, or ECS) and modern data lake setups.

Streaming & Messaging: Hands-on experience or deep understanding of the Kafka ecosystem (or AWS Kinesis).

ETL & Data Modeling: Proven track record of writing efficient, complex ETL/ELT jobs and understanding microservices architectures.

Dev Tools: Comfortable with Git version control, CI/CD pipelines, and writing optimized queries.

Bonus Points & Culture

Nice to Have: Familiarity with Elasticsearch, Snowplow, or Docker , and curiosity about how data feeds into ML models & recommender systems .

Real Human Impact: Your pipelines directly power products that help millions find their life partners.

Scale & Growth: Work on complex, high-velocity data problems that will rapidly elevate your engineering career.

Great Vibe: Collaborative teams, vibrant office culture, and brainstorming overchai!

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

5-8 yrs
Mumbai, India
Skills:
Java, Cassandra, Scala, Big Data, Kafka, Sql, Nosql, Hive, RDBMS, Presto, Spark, MongoDB, Python, HDFS
3-5 yrs
Mumbai, India
Skills:
Ssas, Pyspark, ECS, SQL Server, Adobe Analytics, Sql, Apis, Data Modeling, Cloud Technologies, Python, Etl, ELT, Iceberg, Airflow, AI LLM-based solutions, Generative AI, RAG, AI agents
6-8 yrs
Mumbai, India
Skills:
Spark SQL, Gcp, Databricks, Azure, Python, AWS, Medallion Architecture, Delta Live Table
5-7 yrs
Mumbai, India
Skills:
Sql, ELT, Data Modeling, Pyspark, Etl, AWS, Data Architecture, Python, Azure, Gcp, Scala, Git, Spark, Azure DevOps, cloud-based data platforms
5-7 yrs
Mumbai, India
Skills:
BigQuery, Pyspark, Data Warehousing, Data Modeling, Dataproc, Sql, Jenkins, Cloud Storage, Git, Gcp, DataFlow, Pub Sub, ETL frameworks, GitHub Actions, CI CD pipelines