Spark SQL, Scipy, Pyspark, Azure Databricks, Numpy, Pandas, Azure Data Lake, Python, RDDs, Databricks Notebooks, MLflow, DataFrames, Synapse Analytics, Delta Lake, Blob Storage, Spark Pools

Data Architecture, data modeling principles, Databricks Unified Data Analytics Platform, ETL processes, scripting and automation, cloud-based data storage and processing solutions

file formats , Logging, Pyspark, Data Modeling, Redshift, Sql, Git, Data Quality, Spark, Python, AWS, Apache Iceberg, DBT Cloud, Monitoring, alerting, Lakehouse Data Lake architectures, partitioning, observability

Git, Oracle Pl Sql, Pyspark, Python

Pyspark, Azure Synapse Analytics, Apache Spark, Azure Databricks, Python, Sql, Databricks Unity Catalog, Azure Data Lake Storage ADLS, Delta Lake, Azure SQL Database, Azure Data Factory ADF

Large Language Models (LLMs), Pyspark, Dimensional Modeling, Kafka, ELT, Apache Airflow, Docker, Terraform, Python, AWS, Apache Spark, Sql, Git, Gcp, Data Warehousing, Databricks, Azure, Kubernetes, Etl, Apache Iceberg, Apache Hudi, Generative AI, Delta Lake, CI/CD

Azure Data Factory, Pyspark, Azure Synapse Analytics, Apache Spark, Azure Databricks, Data Warehousing Concepts, Sql, Python, Azure DevOps, Azure Data Lake Storage, ETL ELT Pipeline Development

Docker, Pyspark, SQL Server, Databricks, Restful Apis, Kubernetes, Azure DevOps, Azure Container Registry, Azure Key Vault, Azure Blob Storage, Azure Kubernetes Service