Spark SQL, Pyspark, Sql, Performance Tuning, Logging, Dataframes, Unix Scheduling Tool, Advanced Data transformations, Error handling, UDFs, Spark Functions, Monitoring

Spark SQL, Agile Methodologies, Pyspark, Performance Tuning, Apache Spark, Data Warehousing, Azure Databricks, Sql, Query Optimization, Spark Core, Git, Hive, Hadoop Ecosystem, Python, AWS EMR, RDDs, HDFS, DataFrames

Hadoop, Pyspark, Scala, Kafka, Data Modeling, HBase, ELT, Hive, Etl, Airflow, HDFS, Spark optimization