T
Pyspark Developer
T
- Posted 12 hours ago
- Be among the first 10 applicants
Job Description
About the Role
PySpark and Spark SQL Working with Dataframes using different APIs Spark Functions Advanced Data transformations Good knowledge in SQL Applying UDFS Error handling, logging and monitoring Unix, Scheduling Tool Performance Tuning & Generic process development
Must have 5-10 Years of experience
Location: Bengaluru, Pune, Hyderabad, Kolkata, Chennai
Responsibilities
- PySpark and Spark SQL
- Working with Dataframes using different APIs
- Spark Functions
- Advanced Data transformations
- Good knowledge in SQL
- Applying UDFS
- Error handling, logging and monitoring
- Unix, Scheduling Tool
- Performance Tuning & Generic process development
- Banking Domain Knowledge
More Info
Key Skills
Logging and monitoring
Dataframes
Unix Scheduling Tool
Generic process development
Advanced Data transformations
Error handling
UDFS
Spark Functions
About Company
Skills:
Hadoop, Pyspark, Scala, Mapreduce, Unix Shell Scripting, Hive, Spark, Tensorflow, Python, Pytorch, scikit-learn, SparkML
Skills:
Spark SQL, Unix, Data Modeling, Pyspark, Apache Spark, Yarn, Sql, Hadoop Ecosystem, Hive, Linux, Data Warehousing, Python, Etl Development, HDFS, DataFrames
Skills:
Pyspark, Oops, Debugging, Concurrency, Git, Core Python, Data Pipeline, Exception Handling, Data Loading, Performance Optimization, Apply Map Functions, Decorators, Parallel Processing, Window Functions, Spark Architecture, Lambda Functions, DB Connectivity, Error Handling