Pyspark, Python Scripting, S3, Lambda, Database Technologies, Iam, Sqs, Sns, Big Data, AWS EMR, Spark UI Optimization

Github, Apache Spark, AWS Glue, Amazon Redshift, Data Lake, Data Warehousing, Python, Etl, Apache Iceberg, Amazon Athena, JSON processing, API integrations

snowflake , Python, Sql, AWS, Etl

snowflake , Kafka, Sql, Kinesis, Terraform, Docker, ECS, Kubernetes, Python, Airflow, Airbyte, AWS core services, EKS, dbt

Sql, Aws S3, Lambda, Api Gateway, Kafka, Linux, Python, Redshift, Crawler, AWS Cloud platform, Athena, Dynamic DB, Glue

Data Lake, S3, Pyspark, Lambda, Shell Scripting, Sql, Ec2, AWS SNS, Python, Etl, Athena, AWS Services – EMR, Git Version Control, Glue, Spark Job Optimization

Deduplication, Sql, Python, Terraform, Pyspark, Spark, AWS data services, SCD Type 2, incremental processing, Lakehouse Medallion architecture, cdc, historical processing

Spark, Data Modeling, Big Data Technologies, Java, Aws S3, Python, Scala, Hadoop, data warehousing solutions, ETL processes

Spark, Pyspark, Performance Tuning, Data Modeling, Sql, Python, Airflow, AWS Step Functions, Amazon Redshift Athena, Amazon S3 Data Lake, AWS data services, Optimization, AWS Glue ETL ELT Catalog Crawlers, Lambda EMR

Pyspark, AWS Glue, Data Lake, Redshift, Sql, Python