Spark SQL, Scipy, Pyspark, Azure Databricks, Numpy, Pandas, Azure Data Lake, Python, RDDs, Databricks Notebooks, MLflow, DataFrames, Synapse Analytics, Delta Lake, Blob Storage, Spark Pools

Spark SQL, Java, Pyspark, Scala, Apache Spark, Multithreading, Google Cloud, Spark Streaming, Distributed Computing, Apache Kafka, Azure, Python, AWS, DataFrames

Docker, Pyspark, SQL Server, Databricks, Restful Apis, Kubernetes, Azure DevOps, Azure Container Registry, Azure Key Vault, Azure Blob Storage, Azure Kubernetes Service

agent development , Agentic Design, ETL processes, Data pipeline architecture, Python Programming Language, Data storage solutions

Google Cloud Platform (GCP), Google Cloud Storage (GCS), Java, BigQuery, Dataproc, Sql, Git, Shell scripting, DataFlow, Python, Airflow, Cloud Functions, ETL/ELT pipelines, Cloud Composer, Cloud Run, Unix environments, CI/CD pipeline implementations