Hiring a Cloud Big Data Engineer

Responsibilities:

• Work with Big Data ecosystems, including Hadoop (HDFS, Hive), Apache Spark, and Elastic Search.
• Design and implement data pipelines using Python, PySpark, and distributed file formats (JSON, Parquet, AVRO, ORC).
• Debug, schedule, and optimize jobs in production environments.
• Collaborate on cloud-based solutions, leveraging Azure capabilities.
• Write clean, maintainable code using frameworks like Django and work on Shell scripting in a Linux/UNIX environment.