Data Engineer - AWS
- Posted 2 months ago
- Be among the first 50 applicants
Job Description
Hey Jobseekers,
we are looking for AWS Data Engineer with glue & Pyspark experience
Experience : 4 to 10 Years
Location : Hyderabad / Chennai / Noida / Pune / Bangalore
kindly reply with below details [Confidential Information]
CTC :-
ECTC :-
Notice Period :-
Preferred Location :-
- Hands on experience in Dimensional, Data vault and relation modelling
- Expertise in Data warehousing and ETL Design and implementation
- Hands on experience with Programming language like Python/Scala
- Good understanding of Spark architecture along with internals
- Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation
- Experience on Mulesoft is good to have
- Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
- Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.
- Experience in Parallel Loading and Dependencies orchestrations
- Awareness of scheduling and orchestration tools
- Awareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processing
- Experience on RDBMS systems and concepts
- Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
- Create test cases and perform unit testing of ETL Jobs
- Analytical mind with a problem-solving and debugging skills.
- Excellent Communication Skills
- Awareness of Replication, Synchronization and Disaster Management techniques
- Hand on experience in Data Quality Management
- Awareness of data governance concepts and implementation
- Hand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation
Thanks
Nishikanth
More Info
Key Skills
Service Streams
RDBMS systems
Spark architecture
Parallel Loading
queues
Database components
ETL Design and implementation
Data Quality Management



