Spark SQL, Pyspark, Sql, Performance Tuning, Logging, Dataframes, Unix Scheduling Tool, Advanced Data transformations, Error handling, UDFs, Spark Functions, Monitoring

Hive, Hadoop, Pyspark, Spark, Data Warehousing, Unix Shell Scripting, Sql, Etl, BigData technologies, HDFS

Java, Performance Tuning, Pyspark, Kafka, Sql, ELT, Query Optimization, Apache Airflow, Data Quality, Git, Data Governance, Python, Etl, Apache Iceberg, DevOps practices, data modeling techniques, data transformation frameworks, large-scale structured and unstructured datasets, Spark-based data processing, data partitioning, metadata

data wrangling , slicing , Numpy, Pandas, Concurrency, Git, Restful Services, Oop, Pyspark, data pipeline, Debugging, Apis, Core Python, Data Loading, Gen AI, dataframes, DB connectivity, application unit tests, Decorators, apply map functions, Vector operations, applymap, Lambda Functions, error handling, aggregations