Role: Data/DB Engineer Lead (AWS / 5+ years of experience)
Location: Ahmedabad, Pune
Years of Experience: 9 to 15 yrs
Notice: Looking for 0-30 Days Joiner
Introduction
Our team builds a data platform that reliably collects, processes, and retrieves large-scale IoT data based on AWS. We are seeking a senior engineer who can work on unobstructed flow even among billions of data records, push data storage performance to the limit, and technically efficiently manage service growth.
Key Responsibilities
- High-availability data pipeline design: AWS MSK (Kafka), end-to-end data streaming architecture design and operation using Logstash
- Storage optimization and sharding strategies: Optimizing large-scale search performance through OpenSearch's index design, sharding, and lifecycle (ISM) management
- Data Modeling and Partitioning: Table partitioning and data modelingin PostgreSQL/MySQL, architecture guide for efficient querying
- Performance Tuning and Guidance: Perform SQL optimization across services and spreading technical best practices to backend development teams
- Release Management: Review deployment details and validate details before deployment to ensure zero-error deployments without roll back needs.
- Infrastructure automation: DBschema versioning (such as Flyway) and deployment process automation systems
Requirements
- Over 5 years of experience in data engineering or related backend development
- Extensive experience in operating infrastructure handling large-scale traffic in AWS cloud environments
- Strong capabilities in building real-time data pipelines and troubleshootingusing Kafka
- Experience in OpenSearch (Elasticsearch)
- Deep understanding of theinternal structure of RDBMS (PostgreSQL/MySQL) and ability to tune complex queries
Preferred Qualifications
- Seamless technical collaboration capabilities: Communicationskills to discuss infrastructure optimization with DevOps engineers and provide efficient data modeling and query guides to backend developers
- Global collaboration skills: Able toshare technical documents with engineers across the globe and conduct work via video conferences during collaborative work sessions
- IoT Domain Experience: Experience inhandling large-scale device messages and building data pipelines
- Ensuring data stability: Experience in designing logic to prevent data loss during failures and ensure consistency verification
- 4 years of bachelor's degree or higher in Computer Science or equivalent discipline
What We Offer:
- Competitive Salary
- Work Life Balance
- Professional Development
- Innovative Work Environment.
- Recognition and Rewards
