Spark Streaming, Databricks, Sql, Apache Spark, Pyspark, Kafka, Spark SQL, Python, Azure, Git, Azure DevOps, Spark optimization, Big Data tools, Data Lakes, Event Hubs, Databricks Lakehouse, Delta

Pyspark, Apache Spark, Automation, Data Quality, Gitlab, Databricks, Data Governance, Python, CI CD Pipelines, AI ML Workflows, LLMOps, RAG Pipelines, Vector-Space Architectures, Vector Search, SQL Optimization, metadata, Delta Lake, Spark Performance Optimization, Databricks REST APIs, Distributed Data Processing, Scalable Data Platform Architecture

Azure, aws, Databricks