- Location: Bangalore
- Work Schedule: Monday to Friday
- Work Mode: On-site
- Experience: 4 -6 Years
About
As a Senior Data Engineer (Tech Lead), you will own the architecture and development of large-scale data systems that power a people intelligence platform.You will lead technical decision-making for the data team, build scalable pipelines, and ensure high-quality, reliable data across the product.
This role is ideal for someone who enjoys solving complex data problems, taking ownership, and mentoring engineers in a fast-paced startup environment.
Key Responsibilities
- Design and build large-scale ETL/ELT pipelines
- Own data pipeline architecture and scalable system design
- Lead advanced data modeling and data warehousing initiatives
- Build and maintain web scraping and crawling infrastructure
- Identify, evaluate, and onboard new data sources end-to-end
- Perform data research, mining, merging, and enrichment
- Evaluate data quality and reliability across sources
- Design deduplication, merging, and enrichment strategies
- Develop and maintain backend services using Python and Django
- Build and debug RESTful APIs
- Work with AWS (S3, EC2) for data processing and storage
- Use Apache Airflow with PySpark / Hadoop / Dask
- Leverage Elasticsearch for search-based data mining
- Build streaming or messaging workflows using Kafka
- Provide architectural direction and technical leadership
- Manage and mentor a team of 24 engineers
- Collaborate with Product and Business stakeholders
What We're Looking For
- 46 years of experience in data engineering or backend-heavy data roles
- Strong expertise in data modeling and data warehousing
- High proficiency in Python and backend system design
- Experience designing scalable, reliable data platforms
- Prior experience leading or mentoring engineers
- Strong communication and stakeholder management skills
- High ownership and execution mindset
Mandatory Tech Stack
- Python, Django, MongoDB
- AWS (S3, EC2)
- Apache Airflow (PySpark / Hadoop / Dask)
- Elasticsearch
- Kafka
- Scrapy, BeautifulSoup, Selenium
- RESTful APIs, Git/GitHub
Preferred Skills
- Cloud platform experience
- Data quality and validation frameworks
- Infrastructure-as-code
Preferred Tech Stack
- Docker, CloudWatch
- Third-party data APIs and marketplace integrations
Why Join Us
- Own and shape the core data platform
- High-impact, high-ownership role
- Opportunity to lead and grow a strong data engineering team
- Fast-moving, execution-first startup culture
Skills: airflow,elasticsearch,aws,django,kafka,python,datamodeling
