Cloudera, Data Engineer, Hadoop, Apache Spark, Apache Kafka, Big Data, Python, Java

Spark SQL, Pyspark, Jenkins, Databricks, Photon Engine, Python, Azure DevOps, Expectations, Spark Structured Streaming, Auto-Optimize, Dynamic Partition Overwrite, DLT, Z-Ordering, dbt on Databricks, CI CD, Auto Loader, Delta Live Tables, Unity Catalog, Git integration, Liquid Clustering, Delta Lake, Delta constraints, Databricks Workflows