We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure. You will play a critical role in ensuring data reliability, quality, and availability to support our business needs. You will get to work on cutting-edge data infrastructure with a real-world impact.
Responsibilities
- Design, develop, and maintain scalable data pipelines using cloud services (GCP, AWS, or Azure).
- Implement data ingestion, transformation, and storage solutions.
- Ensure data quality, integrity, and security across all data systems.
- Monitor and troubleshoot data pipelines to identify and resolve issues.
- Has to ensure a 99.999% uptime & performance SLAs of the production environment.
- Collaborate with data scientists and other stakeholders to understand data requirements.
- Optimize data pipelines for performance, reliability, and cost-effectiveness.
- Create and maintain clear documentation of data flows, system architecture, and operational procedures.
Requirements
- B. Tech. / M. Tech. degree or higher educational qualification.
- 3+ years of experience in Data Engineering or related roles.
- Must have worked in production deployments, including managing scalable data pipelines that process high-volume, real-time data.
- Proficiency with cloud services such as GCP, AWS, or Azure is required.
- Hands-on experience with Distributed Stream Processing Technology ecosystem, including Apache Kafka, Flink, or Beam, etc.
- Strong Programming skills in languages such as Python, Scala, or NodeJS.
- Experience with SQL, NoSQL & especially Timeseries databases.
- Experience with parallel programming & distributed data processing.
- Solid understanding of data warehousing concepts and technologies.
- Ability to design and implement data architectures.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Experience developing data pipelines & processing services, with a deeper understanding of the Quality Controls.
- Knowledge of IoT data and related technologies.
- A Google Cloud Certified Professional Data Engineer will be given preference.
This job was posted by Khushboo Deshwali from Datoms.
