Spark SQL, Pyspark, Sql, Performance Tuning, Logging and monitoring, Dataframes, Unix Scheduling Tool, Generic process development, Advanced Data transformations, Error handling, UDFS, Spark Functions

Spark SQL, Unix, Data Modeling, Pyspark, Apache Spark, Yarn, Sql, Hadoop Ecosystem, Hive, Linux, Data Warehousing, Python, Etl Development, HDFS, DataFrames

data wrangling , slicing , Data Loading, concurrency, Exception Handling, Debugging, Numpy, Pyspark, Pandas, Python, Apis, Git, Restful Services, Oop, dataframes, Lambda Functions, applymap, unit tests, DB connectivity, Decorators, error handling, Parallel Processing, apply map functions, aggregations