AWS Data Engineer

INNOVA SOLUTIONS

Hyderabad, Chennai, Noida

5-10 Years

Save

Posted 18 days ago
Over 100 applicants

Quick Apply

Job Description

Hands on experience in Dimensional, Data vault and relation modelling
Expertise in Data warehousing and ETL Design and implementation
Hands on experience with Programming language like Python/Scala
Good understanding of Spark architecture along with internals
Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation
Experience on Mulesoft is good to have
Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.
Experience in Parallel Loading and Dependencies orchestrations
Awareness of scheduling and orchestration tools
Awareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processing
Experience on RDBMS systems and concepts
Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
Create test cases and perform unit testing of ETL Jobs
Analytical mind with a problem-solving and debugging skills.
Excellent Communication Skills
Awareness of Replication, Synchronization and Disaster Management techniques
Hand on experience in Data Quality Management
Awareness of data governance concepts and implementation
Hand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation