Apis, Node.js, Distributed Systems, AWS, Engineering Management

Azure Data Factory, Pyspark, Sql, Spark SQL performance tuning, Delta Lake, Azure Data Lake Storage Gen2, Microsoft Azure Databricks, CI CD, Git-based workflows, Spark architecture

Pyspark, Kinesis, Terraform, Python, Emr, Pulumi, Apache Kafka, Databricks, DataFlow, Aws S3, Apache Iceberg, Pub Sub, High-Throughput Message Bus, Apache Atlas, Azure ADLS Gen2, Event Hubs, Apache Hudi, MCP Server Foundation, Multi-Cloud Enablement, Unity Catalog, Synapse, DataHub, Glue, Delta Lake, GCP BigQuery, Athena

Rabbitmq, Data Security, Kafka, Infrastructure Management, ETL frameworks, Airflow, large-scale messaging systems, dbt, workflow or orchestration frameworks, metrics stores

Java, REST, Pyspark, Scala, Apache Spark, Kubernetes, ELT, Etl, Microservices

Golang, Presto, Spark, Python, Iceberg, Trino, Delta Lake

compaction , S3, Kafka, Data Modeling, Typescript, Docker, Terraform, Python, AWS, Cloudformation, Data Quality, ECS, Spark, Kubernetes, Data lakes, Apache Iceberg, Access Control, Data observability, Go, Flink, Partitioning, Streaming pipelines, Data ingestion frameworks, Lakehouse architecture, Data serving layers, Schema evolution, Governance, Data isolation, Pipeline monitoring

snowflake , Java, Apache Spark, Kafka, Json, Avro, Sql, Databricks, Sybase Iq, Kubernetes, Python, Parquet, Apache Iceberg, CI CD tooling, Hadoop ecosystem technologies

bigtable , Java, BigQuery, PostgreSQL, Scala, Sql, Redis, Spark, Apache Kafka, MongoDB, DataFlow, Python, datastream, Airflow, Debezium, Pub Sub, CDC tools, dbt, GCS, GCP stack, Spanner