Apache Airflow, Hadoop, Spark, Apache Beam, Python, Google DataProc, dbt, Google DataFlow, Google Cloud Ecosystem, Google Cloud Storage

Data Modeling, Pyspark, ELT, Python, Spark SQL, Sql, Azure Data Factory, Data Warehousing, Etl, cdc, OneLake, Warehouse, Lakehouse Architecture, Azure Data Lake Storage Gen2, Azure Monitoring, Microsoft Fabric Data Pipelines, Microsoft Purview, watermarking techniques, Microsoft Azure Fabric, Incremental loads, Azure Blob Storage, Lakehouse, Stored Procedures, performance optimization, Pipeline monitoring

S3, Aws Lambda, T-sql, Pyspark, Scala, AWS Glue, SQL Server, Sparksql, SSIS, Iam, Databricks, Python, AWS

Data Warehousing Concepts, Google Cloud Platform Architecture, ETL processes, Python Programming Language, Data quality frameworks, Data integration tools

Version Control, OLAP, Tableau, Data Lake, Yarn, Sql Tools, Shell, Gcp, Debugging, Spark, Cloud Services, Vertica, Python, Etl, AWS, Data Analysis, Dremio, Monitoring, Relational Databases, wrangling tools, Troubleshooting, Agile data structures, Apache Superset

snowflake , Cloud Formation, Data Warehousing Concepts, Sql, High Availability Systems Data, Cloud Platforms AWS, dbt, Data Modelling Dimensional Relational, Infrastructure-as-Code tooling Terraform, Orchestration tools for CI CD, Python Data Engineering

data engineering , graph databases , object storage , AWS Glue, Data Modeling, Warehousing, column-family databases, data stores, key-value stores, IAM roles and permissions, non-relational databases, ETL pipelines

Spark, Kafka, Data Warehousing, Python, Sql, AWS, ELT, Etl, Airflow, dbt, Flink