Job Title: Big Data Developer (Manager)
Location: Pune
Experience: 3-5 years
Job Description:
Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.
Key Responsibilities:
- Design, develop, and maintain big data solutions using Java and Apache Spark.
- Develop and manage APIs for data ingestion, processing, and extraction.
- Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions.
- Optimize and tune big data workflows for performance and scalability.
- Implement data engineering best practices to ensure data quality, integrity, and security.
- Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed.
- Troubleshoot and resolve issues related to data processing and workflows.
- Stay updated with the latest trends and advancements in big data technologies and tools.
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 4-8 years of experience in big data development and data engineering.
- Proficiency in Java and experience with Apache Spark.
- Experience in API development and integration.
- Strong understanding of data engineering principles and big data concepts.
- Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka.
- Experience with SQL and NoSQL databases.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Experience with cloud platforms such as, Spark, Data/Delta lakes, Modern Data stack.
- Knowledge of containerization technologies like Docker and Kubernetes.
- Experience with continuous integration and continuous deployment (CI/CD) pipelines.
- Familiarity with machine learning frameworks and libraries.
Benefits:
- Competitive salary and benefits package.
- Opportunity to work with cutting-edge technologies in a dynamic and collaborative environment.
- Professional growth and development opportunities.
