Hadoop, Pyspark, Scala, Kafka, Data Modeling, HBase, ELT, Hive, Etl, Airflow, HDFS, Spark optimization

Hld, BigQuery, Unit Testing, Hadoop, Pyspark, Apache Spark, Google Cloud, User Acceptance Testing, Jenkins, Git, Hive, Tdd, System Testing, Shell scripting, Python Programming, Cloudera, AWS ecosystem, Hortonworks Data Platform, CDC operations, UNIX operating system concepts, Agile delivery model, AWS S3 Filesystem operations

Github, Data Modelling, Bitbucket, Pyspark, Spark, Data Warehousing, Databricks, Sql, Python, Aws S3, AI capabilities

Spark SQL, Pyspark, Banking Domain Knowledge, Sql, Performance Tuning, Logging and monitoring, Dataframes, ETL Estimation, Unix Scheduling Tool, Generic process development, Advanced Data transformations, Error handling, UDFS, Spark Functions, Teradata BTEQ

Spark SQL, Spark Core, Hive, Spark Streaming, Hadoop, Pyspark, Data Warehousing, Unix Shell Scripting, Etl, HDFS, Batch Processing