About The Opportunity
Join a dynamic team in the Big Data sector within the technology services industry based in India. We are dedicated to delivering innovative big data solutions and leveraging state-of-the-art data engineering practices to drive business insights and efficiencies. This is an on-site role at our India location, ideal for professionals eager to contribute to impactful data projects in a collaborative environment.
Role & Responsibilities
- Design, develop, and maintain scalable big data pipelines and architectures.
- Implement data ingestion, processing, and storage solutions using Hadoop, Spark, Kafka, and other related technologies.
- Collaborate with data scientists and analysts to optimize data flow and improve analytical outcomes.
- Ensure data quality and integrity by implementing validation and monitoring solutions.
- Document technical specifications and contribute to best practices in data engineering.
- Support production deployments and troubleshoot issues to ensure high availability and performance.
Skills & Qualifications
- Must-Have
- Proficiency in Apache Hadoop, Spark, Kafka
- Strong programming skills in Python and Scala
- Experience with data warehousing, ETL processes, and SQL/NoSQL databases
- Familiarity with Linux operating systems and cloud platforms
- Ability to troubleshoot and optimize large-scale data systems
- Excellent problem-solving skills and attention to detail
- Preferred
- Knowledge of data governance and security practices
- Experience with containerization tools like Docker or Kubernetes
- Certifications in Big Data technologies or cloud platforms
Benefits & Culture Highlights
- Collaborative work environment fostering innovation
- Opportunities for professional growth and certification
- Engagement in cutting-edge big data projects impacting diverse industries
Skills: scala,apache spark,sql,apache hadoop,python,hive,kafka
