Scala,Spark
Scala,Spark
Magna Infotech LimitedThis job is no longer accepting applications
Job Description
Create Scala/Spark jobs for data transformation and aggregation.
Produce unit tests for Spark transformations and helper methods.
Write Scaladoc-style documentation with all code.
Design data processing pipelines.
Produce unit tests for Spark transformations and helper methods.
Write Scaladoc-style documentation with all code.
Design data processing pipelines.
Spark, Kafka Streaming
Scala programming
AWS, Big Data Hadoop, Hive, Python
Java experience is a plus
Hands on Spark/Scala programming experience
Participating in agile development projects for batch and real time data ingestion.
Integration with AWS/Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions.
Working with business and peers to define, estimate, and deliver functionality.
Scala programming
AWS, Big Data Hadoop, Hive, Python
Java experience is a plus
Hands on Spark/Scala programming experience
Participating in agile development projects for batch and real time data ingestion.
Integration with AWS/Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions.
Working with business and peers to define, estimate, and deliver functionality.
More Info
Job Type:
Industry:
Function:
Employment Type:
About Company
Magna Infotech (A Division of Quess Crop)
About Recruiter
PavanChary
0 Active Jobs
Skills:
Scala, Python, Sql, AWS, Airflow
Skills:
Oracle, Sql, SQL Server, Data Modeling, Data Warehousing, Apache Spark, Tableau, Power Bi, AWS, MySQL, Data Governance, Python, Azure, Data Integration, Data lakes, Big data platforms
Skills:
.Net Core, Object-Oriented Programming (OOP), Spark, Nunit, Rabbitmq, Pyspark, PostgreSQL, Restful Apis, Xunit, Python, Dapper, Sql