Manager - Information Technology, Data Engineering

Fresher

Save

Early Applicant

Job Description

Design, build and maintainreal-time and batch data pipelinesusing Python, PySpark, and AWS services.
Architect and managecloud infrastructurewith a focus on scalability, cost-efficiency, and performance (AWS Glue, Lambda, S3, Athena).
Implement and optimizeETL/ELT workflows, ensuring data quality and reliability.
Integrate data from diverse sources, including APIs (REST/GraphQL), into centralized data warehouses.
Work with streaming technologies likeKafka or Amazon Kinesisto handle high-throughput, low-latency data ingestion.
Lead data modeling efforts and contribute to the design ofenterprise data warehousesanddata lakes.
Collaborate with product, engineering, and analytics teams to identify data needs and translate them into scalable solutions.
Mentor junior data engineers and contribute to best practices, code reviews, and process improvements.
Drive innovation by evaluating and implementing emerging tools such asAirflow, dbt, Docker, Kubernetes, orMLOps platforms.