We are seeking a highly skilled and experienced Senior Big Data Developer to join our team in Bangalore / Hyderabad / Chennai. The ideal candidate will have a strong background in software development with a focus on large-scale, data-centric applications. You will work with cutting-edge technologies in the Hadoop ecosystem, including Spark, Scala, Hive, and Go, and be responsible for designing and implementing scalable data pipelines in both real-time and batch processing environments.
Key Responsibilities:
- Design, develop, and optimize big data pipelines using Spark, Scala, and Hive
- Leverage Core Java and Go to build robust data processing applications
- Work with large-scale datasets in real-time and batch mode
- Implement automation for data ingestion, job execution, and validation
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions
- Ensure adherence to data security protocols within the Hadoop ecosystem
- Apply best practices in CI/CD, version control, and issue tracking
- Contribute to the design and architecture of data platforms
- Document technical solutions and processes clearly and concisely
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Electrical Engineering, Information Systems, or a related technical discipline (Advanced degree preferred)
- 6 to 10 years of experience in software development with a strong focus on data-centric applications
- At least 4+ years of hands-on experience working with Hadoop ecosystem, Apache Spark, Scala, Hive, Core Java, Go programming language
- Strong knowledge of Hadoop ecosystem security
- Solid understanding of database concepts and data modeling
- Experience in automating job execution and validation processes
- Proficiency in CI/CD processes, version control (e.g., Git), and bug tracking tools (e.g., JIRA)
- Expertise in Object-Oriented Programming and best practice software development methodologies
