data engineering , Spark, Databricks, Emr, Airflow, AWS data services, Micro-services architecture, Streaming pipelines, Athena

snowflake , Data Warehousing, Kafka, Automated Testing, ELT, Docker, Python, Azure DevOps, AWS, Data Modelling, Sql, Devops, Data Quality, Git, Databricks, Kubernetes, Etl, data lakes, Security, MDM, Event Hubs, metadata lineage, production reliability, GitHub Enterprise, DataOps, dbt, CI CD pipelines

Sql, Databricks, AWS IAM, Aws Redshift, AWS Glue, Aws S3, Aws Lambda, Pyspark, Python, AWS CodePipeline, Jenkins, AWS CloudWatch, GitHub Actions, Kinesis Analytics, Spark Performance Tuning, Kinesis Firehose, Amazon Kafka, Delta Lake, Amazon Kinesis Data Streams, AWS Lake Formation, Structured Streaming

Spark SQL, Pyspark, Data Warehousing, Sql, Dimensional Modeling, ELT, Devops, Git, Gcp, Databricks, Azure, Etl, AWS, Spark architecture, Data lake architectures, Delta Lake

data engineering , Scala, Spark, Kafka, AWS, Real-time Processing