Github, Workflows, Pyspark, Apache Spark, Sql, Bitbucket, Apache Kafka, Gitlab, Databricks, Python, Delta Lake on Databricks, Data Quality Validation

data engineering , snowflake , Github, Pyspark, Apache Spark, Sql, Bitbucket, Apache Kafka, Gitlab, Databricks, Python, Delta Lake on Databricks, Data Quality Validation

Hadoop, Scala, Pyspark, Avro, Unix Shell Scripting, Jenkins, Git, Hive, Spark Streaming, RDBMS, Bitbucket, Apache Kafka, orc, Parquet, NoSQL databases, HDFS, Spark framework

Pyspark, Scala, Azure Databricks, Sql, Azure DevOps

snowflake , BigQuery, PostgreSQL, Data Modeling, Redshift, Sql, ELT, Data Quality, Gcp, Python, Etl, Airflow, Dagster, dbt

snowflake , Sql, AWS Glue, Python, Lambda, Redshift, dbt

S3, Cloudformation, AWS Glue, Kafka, Node.js, Redshift, Jenkins, Lambda, Typescript, Terraform, Docker, Elasticsearch, ECS, Python, AWS, Secrets Manager, SQS FIFO queues, SSM Parameter Store, MSK, OpenSearch, DataHub, ECR

data engineering , Capacity Management, Pyspark, Azure Integration, Data Modeling, Sql, Notebooks Spark, Delta format, Pipelines, Fabric Expertise, Semantic models, Dataflows Gen2, Managed Identity, Data validation frameworks, Secure integration patterns, Lakehouse architecture, Event Hub Service Bus, ETL ELT design