spark,python(pyspark developer)
Early Applicant
Quick Apply
- Posted 7 days ago
- Be among the first 30 applicants
Job Description
The developer must have sound knowledge in Apache Spark and Python programming.
Deep experience in developing data processing tasks using Pyspark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.
Create Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods.
Design data processing pipelines to perform batch and Realtime/stream analytics on structured and unstructured data.
Spark query tuning and performance optimization Good understanding of different file formats (ORC, Parquet, AVRO) to optimize queries/processing and compression techniques.
SQL database integration.
Hands on expertise in cloud services like AWS.
Mandatory skills
Spark, Python
Desired skills
Spark, Python.
More Info
Date Posted: 17/07/2025
Job ID: 121829065
Report Job
About Company
At Fusion Plus Solutions Inc, we believe that it’s an exceptional company - a company of people proud of the work they do and the solutions they provide. By understanding what drives our specialty industries, becoming involved in our communities on a professional and personal basis, following a disciplined process of identifying quality candidates, partnering with employers to understand their core business and their employment requirements, and delivering exceptional service, we achieve great results for all concerned.
Last Updated: 17-07-2025 00:38:06 PM
