snowflake , Pyspark, Apache Kafka, Apache Spark, Azure Databricks, Databricks, Sql, Data Quality Validation

AWS, Databricks, Python, Devops, Spark

Databricks, Apache Spark, Pyspark, Gitlab, Automation, Data Quality, Python, Data Governance, metadata, Vector Search, CI CD Pipelines, Scalable Data Platform Architecture, AI ML Workflows, LLMOps, Vector-Space Architectures, Delta Lake, SQL Optimization, Databricks REST APIs, Spark Performance Optimization, RAG Pipelines, Distributed Data Processing

Spark Streaming, Databricks, Sql, Apache Spark, Pyspark, Kafka, Spark SQL, Python, Azure, Git, Azure DevOps, Spark optimization, Big Data tools, Data Lakes, Event Hubs, Databricks Lakehouse, Delta