data engineering , ETL process design, cloud-based data storage and processing platforms, Snowflake Data Warehouse, optimizing data workflows, data pipeline architecture

Git, Pyspark, Databricks, Azure, Sql, Delta Lake

Pyspark, Azure Data Factory, Azure Functions, Azure Databricks, Sql, Synapse, ADLS, Databricks notebooks using Python

apache subversion , DBT (Data Build Tool), Pyspark, Scala, Data Modeling, Sql, Apache Airflow, Jenkins, Git, Spark, Databricks, Data Governance, Python, Data Quality standards, Data AI solutions, CI/CD pipelines, Data ingestion frameworks, Data warehouse architectures, ETL/ELT processes

BigQuery, Pyspark, Dataproc, Sql, Apache Kafka, DataFlow, Python, Airflow, Cloud Functions, Astronomer, Pub Sub, Cloud Composer, Scheduled Query, Terraform scripting, Monitoring Tools Dashboard, GCP services

S3, Aws Redshift, Pandas, Pyspark, AWS Glue, Python, Sql, Etl, ELT