Apache Spark E0

We are looking for a motivated Apache Spark Developer (Entry Level) to join our data engineering team. The ideal candidate will learn to design, develop, and maintain large-scale data processing applications using Apache Spark and related big data technologies.

Key Responsibilities:

• Assist in developing batch and real-time data processing pipelines using Apache Spark.
• Write efficient Spark jobs using Scala, Java, or Python (PySpark).
• Work with data engineers and analysts to understand data requirements.
• Optimize Spark jobs for performance and scalability.
• Participate in data cleansing, transformation, and aggregation tasks.
• Learn and apply best practices for coding, testing, and debugging.
• Support the deployment and monitoring of Spark applications.

Key Skills Required:

• Understanding of Spark architecture and components (RDD, DataFrame, Dataset)
• Basic experience or training in Spark programming (Scala/Java/Python)
• Spark SQL and DataFrame API
• Knowledge of batch and streaming data processing