Pyspark, Sql, REST, Streaming, Cloud Architecture, Databricks, Asynchronous programming, Python, Ocr, Generative AI, data pipelines, LLMs, MLflow, dependency management, performance optimisation, document ingestion, Delta Lake, metadata extraction, model serving