AWS Data Engineer

Skills:

• Expertise in Data warehousing and ETL Design and implementation
• Hands on experience with Programming language like Python
• Good understanding of Spark architecture along with internals
• Hand on experience using AWS services like Glue (Pyspark), Lambda, S3, Athena,
• Experience on Snowflake is good to have
• Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
• Experience in Parallel Loading and Dependencies orchestrations
• Awareness of scheduling and orchestration tools
• Experience on RDBMS systems and concepts
• Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
• Create test cases and perform unit testing of ETL Jobs