Spark SQL, Git, Azure Data Factory, Pyspark, Sql, Delta Lake, Azure Data Lake Storage Gen2, Microsoft Azure Databricks

Jenkins, Terraform, AWS IAM, Python, Sql, AWS, DevOps pipelines, codepipeline

S3, Metadata Management, Pyspark, Streaming, Python, AWS, Version Control, Testing, Scala, Sql, Gcp, Spark, Data Governance, Databricks, Azure, job scheduling workflows, storage formats, security access controls, data transformations, data compliance, large-scale data pipelines, ADLS, best practices, Delta Lake, distributed data processing, cloud-native data architecture

snowflake , Java, Apache Spark, Kafka, Json, Avro, Sql, Databricks, Sybase Iq, Kubernetes, Python, Parquet, Apache Iceberg, CI CD tooling, Hadoop ecosystem technologies