Apache Spark, Kafka, Apache Airflow, Pandas, Elasticsearch, MongoDB, pgvector, Polars, Vector databases, Qdrant, NoSQL databases, Data models and storage architectures, Distributed data systems, Data processing performance and optimisation, Data pipelines, Milvus

Github, Machine Learning, Metadata Management, Pyspark, BI, ELT, Terraform, Advanced Analytics, Azure DevOps, Apache Spark, Sql, Jenkins, Data Quality, Data Governance, Databricks, Azure, Kubernetes, Etl, lineage, Privacy, infrastructure automation, Databricks Workflows, Generative AI, Unity Catalog, DataOps, CI CD pipelines, Delta Lake, compliance frameworks

snowflake , Databricks, Power Bi, Python, Sql, Microsoft Fabric

Azure, Databricks, Azure Sql, Python, Sql, Spark

Java, Scala, Shell Scripting, Sql, Jenkins, Ansible, DataFlow, Python, Google BigQuery, Tableau APIs, Cloud Composer, Google Cloud Storage, Google Pub Sub

Orchestration, S3, Metadata Management, Pyspark, PostgreSQL, Automated Testing, Data Modeling, Lambda, Advanced Sql, Python, RDS, release management, Dynamodb, SQL Server, Redshift, Data Quality, ECS, transformation standards, CI CD, AWS data services, ETL best practices, data cataloging, Step Functions, Monitoring, large-scale data processing, Glue