Hive, Hadoop, Pyspark, Apache Spark, Python Programming, Sql, ETL pipeline development and optimization, Big Data processing

Java, Performance Tuning, Pyspark, Kafka, Sql, ELT, Query Optimization, Apache Airflow, Data Quality, Git, Data Governance, Python, Etl, Apache Iceberg, DevOps practices, data modeling techniques, data transformation frameworks, large-scale structured and unstructured datasets, Spark-based data processing, data partitioning, metadata

data wrangling , slicing , Numpy, Pandas, Concurrency, Git, Restful Services, Oop, Pyspark, data pipeline, Debugging, Apis, Core Python, Data Loading, Gen AI, dataframes, DB connectivity, application unit tests, Decorators, apply map functions, Vector operations, applymap, Lambda Functions, error handling, aggregations

Pyspark, Python

Spark SQL, Agile Methodologies, Pyspark, Performance Tuning, Apache Spark, Data Warehousing, Azure Databricks, Sql, Query Optimization, Spark Core, Git, Hive, Hadoop Ecosystem, Python, AWS EMR, RDDs, HDFS, DataFrames