Spark SQL, Scipy, Pyspark, Azure Databricks, Numpy, Pandas, Azure Data Lake, Python, RDDs, Databricks Notebooks, MLflow, DataFrames, Synapse Analytics, Delta Lake, Blob Storage, Spark Pools

file formats , Logging, Pyspark, Data Modeling, Redshift, Sql, Git, Data Quality, Spark, Python, AWS, Apache Iceberg, DBT Cloud, Monitoring, alerting, Lakehouse Data Lake architectures, partitioning, observability

Pandas, Agile Software Development, AWS Glue, Dynamodb, Python, Azure DevOps, Amazon Athena, AWS Step Functions

Docker, Pyspark, SQL Server, Databricks, Restful Apis, Kubernetes, Azure DevOps, Azure Container Registry, Azure Key Vault, Azure Blob Storage, Azure Kubernetes Service

Apache Spark, Sql, Apache Airflow, Git, Gcp, FastAPI, Azure, Python, AWS, LLMs, AI GenAI concepts, Vector Databases, semantic search, Knowledge Graphs

snowflake , Sql, Python, Gen AI, data engineering design patterns, Automation integration, Microsoft DevOps, Matillion, Streamsets

data wrangling , SAS, Sql, Python, Data development lifecycles

Yaml, Data Modeling, PostgreSQL, Sql, Data Quality, Git, MySQL, Data Architecture, System Design, Python, Airflow, ETL tooling