We are actively seeking a highly skilled Big Data Developer to join our client's team through Acme Services. This role is crucial for designing, developing, and implementing robust big data solutions within a complex ecosystem. The ideal candidate will possess a good understanding of the Hadoop ecosystem, familiarity with Cloudera/Hortonworks distributions, and excellent knowledge of ETL pipelines, database, and reporting model design. In-depth and working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands is essential, along with experience in DevOps implementation and hands-on proficiency with Python/Scala/Java.

Key Responsibilities

Big Data Ecosystem Management: Apply a good understanding of the Hadoop ecosystem and familiarity with Cloudera/Hortonworks distributions to manage and optimize big data environments.
ETL Pipeline Development: Design and implement robust ETL pipelines, ensuring efficient data ingestion, transformation, and loading processes.
Data Modeling & Reporting: Leverage excellent knowledge of database & reporting model design to create scalable and performant data structures for analytics and reporting.
Big Data Tooling: Utilize in-depth & working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands for data processing, streaming, and orchestration.
DevOps Implementation: Contribute to and support DevOps implementation efforts for big data solutions, enhancing continuous integration and deployment.
Programming & Scripting: Develop and maintain big data applications and scripts using Python, Scala, or Java.
Troubleshooting & Optimization: Identify and resolve performance bottlenecks and technical issues within the big data ecosystem.

Skills

Good understanding of the Hadoop ecosystem.
Familiarity with Cloudera/Hortonworks distribution.
Excellent knowledge of ETL pipelines, Database & Reporting model design.
In-depth & working knowledge of Spark, Hive, NiFi, Kafka, and Hadoop commands.
Experience in DevOps implementation.
Hands-on proficiency with Python/Scala/Java.

Qualifications

Proven experience as a Big Data Developer.
Demonstrable expertise across the specified big data technologies and concepts.
Ability to design and implement complex data solutions.
Strong problem-solving and analytical skills.

Bigdata Developer

Bigdata Developer_PB

Bigdata and Hadoop and Spark Developer

GCP Data Developer- BigData, ETL