data engineering , snowflake , Pyspark, Cassandra, Big Data Engineering, Data Pipelines

data engineering , S3, Agile Methodology, Pyspark, Bug Tracking Tools, Devops, AWS, EMR Serverless, Multiple programming languages, AirFlow, Low code toolsets, Development and testing tools, Glue catalog, Athena, wikis

Pyspark, Scala

S3, Github, Pyspark, AWS Glue, Kafka, Kinesis, Docker, Shell scripting, Python, AWS, Spark SQL, Hadoop, Scala, Data Profiling, Sql, Hive, ECS, Spark, Data Warehousing, Etl, Airflow, Miro, HDFS, EKS

Spark SQL, Adf, Pyspark, ELT, RDBMS, MySQL, Postgres, Etl, orc, Airflow, Parquet, Spark on Kubernetes, AWS EMR, Data Lakes, Databricks Workflows

Data Quality, Pyspark, Sql, Python, Etl, Oracle databases, Data Validation, governance frameworks

Pyspark, Scala, Spark SQL, Apache Kafka, Big Data, ETL Processes

Pyspark, Scala, Python, Hive, Unix Shell Scripting, Mapreduce