Github, Workflows, Pyspark, Apache Spark, Sql, Bitbucket, Apache Kafka, Gitlab, Databricks, Python, Delta Lake on Databricks, Data Quality Validation

data engineering , snowflake , Github, Pyspark, Apache Spark, Sql, Bitbucket, Apache Kafka, Gitlab, Databricks, Python, Delta Lake on Databricks, Data Quality Validation

Pyspark, Sql, Apache Airflow, Numpy, Git, Pandas, Docker, Terraform, Python, Airflow, ClickHouse, dbt, Dagster, Podman, Pentaho

Spark SQL, Hadoop, Scala, Apache Spark, Kafka, HBase, Redshift, Spark Streaming, Hive, Spark, HDFS, Kafka Connect

Pyspark, Scala, Azure Databricks, Sql, Azure DevOps

snowflake , Devops, Google Cloud Platform, Pyspark, Databricks, Azure, Python, Sql, AWS, Airflow, dbt

Cloudformation, Node.js, Jenkins, Lambda, Typescript, Terraform, Docker, ECS, Python, AWS, Datahub, ECR, Glue

data engineering , Capacity Management, Pyspark, Azure Integration, Data Modeling, Sql, Notebooks Spark, Delta format, Pipelines, Fabric Expertise, Semantic models, Dataflows Gen2, Managed Identity, Data validation frameworks, Secure integration patterns, Lakehouse architecture, Event Hub Service Bus, ETL ELT design