Job Title: Data Engineer - Python & ETL (Big Data)
Experience: 8+ Years
Job type: C2H
Location: Chennai / Bangalore
Notice Period: Immediate to 15 Days
Job Description:
- Hands-on experience in data engineering, specializing in building scalable and efficient data solutions.
- Strong proficiency in Python, Java, or Scala, along with Shell scripting and SQL, developing large-scale ETL/ELT pipelines.
- Expertise in Big Data Ecosystem components such as Hive, Spark, HDFS, and working knowledge of Hadoop-based environments.
- Practical experience with modern data stack tools and components including Airflow and Iceberg.
- Solid understanding of APIs, microservices architecture, and DevOps/CI/CD practices, with experience working with Docker, Kubernetes, and Terraform.
- Ability to design, develop, and optimize complex data pipelines, ensuring reliability and performance.
- Strong problem-solving skills and ability to work in a fast-paced, collaborative environment.
