Hive, Sql, AWS, HDFS

data quality assurance , Distributed Computing, Pyspark, Etl, data pipelines, validation techniques, cloud-based data platforms, big data processing

Sparksql, Data Warehousing Concepts, Sql, Hive, Big Data Technologies, Bash, Python, Hadoop, Pyspark, DataFrame, Airflow

stream processing , snowflake , Pyspark, Apache Spark, Apache Airflow, Apache Kafka, Databricks, Advanced Sql, Python, Big Data Architecture, ETL Pipeline Development, Data Quality Validation

S3, Emr, Redshift, Sql, Lambda, Kinesis, Pytorch, Spark, AWS, FireHose, Glue, IAM roles and permissions

Apache Airflow, PostgreSQL, Data Warehousing, Apache Spark, Data Modeling, Database Management Systems, Sql, ETL processes, pipeline optimization

Terraform, Cloudformation, Cassandra, Dynamodb, Apache Kafka, Apache Spark, MongoDB

snowflake , Sql, ELT pipelines, Matillion

Data Modeling, Pyspark, Data Extraction, Sql, Azure Synapse, Data Quality, Azure ML, Azure Data Factory, Databricks, Data Security, Azure DevOps, Etl, FiveTran, Git-based workflow, GCP Cloud Composer, Vertex AI, GCP BigQuery, GCP Cloud Run, GCP DLP