Java, BigQuery, Hadoop, C++, Scala, Kafka, Hive, MLops, Spark, Databricks, Python, Kubernetes, Airflow, Go, HDFS, Delta Lake, CI/CD

snowflake , change data capture , Github, Databricks, Azure, Python, Sql, Data quality reconciliation, Event processing, CI CD

snowflake , Spark, Databricks, Sql, Python, Airflow, Microsoft Fabric, Azure data services

composer , Google Cloud Platform (GCP), Github, BigQuery, Pyspark, Dataproc, Sql, ELT, Cloud Storage, Python, Etl, Pub Sub, Cloud Run, data fusion, CI/CD

bigtable , Pyspark, PostgreSQL, Kafka, Avro, Cloud Storage, Terraform, Docker, Elasticsearch, Python, Spark SQL, Java, BigQuery, Google Cloud Platform, Scala, Apache Spark, Dataproc, Sql, Oop, DataFlow, Kubernetes, Airflow, Pub Sub, Cloud Composer, Parquet

Pyspark, Sql, Terraform, Gitlab, Databricks, Azure cloud services, Python, Azure DevOps, MERGE INTO, GitHub Actions, DataOps, Delta Lake, CI/CD

Orchestration, Pyspark, Data Warehousing, Kafka, Data Modeling, ELT, Streaming, Python, AWS, Sdp, Apache Spark, Sql, Databricks, Etl, data integration patterns, Debezium, Lakehouse architecture, Lakeflow Connect, cloud-native data services, Schema Registry, Auto Loader, production-grade data pipelines, Unity Catalog, Spark Declarative Pipelines, Karapace, Databricks Asset Bundles, Kafka Connect, Delta Lake, CI/CD

Mqtt, Cloud Devops, SSIS, Sql, Data Integration, Devops, Git, Azure Data Factory, Databricks, Microsoft Azure, Python, Data Engineering Architecture, Data Lakes, CI CD

Kibana, S3, PostgreSQL, Elk Stack, ELT, Lambda, MySQL, Elasticsearch, Python, AWS, Mariadb, Dynamodb, Logstash, Sql, MongoDB, Etl, data pipelines, Kinesis Data Streams, no-SQL databases, Neptune DB, event-driven data architectures, Data Firehose, Fargate, Lake Formation, data APIs

Sql, Python, Airflow, Parquet, WebDataset, GPU workloads, large-scale audio video or multimodal data pipelines, quality validation, AWS – S3, Delta Lake, Apache Hudi, data ingestion