Search by job, company or skills

Data Engineer - AWS

Data Engineer - AWS

Innova Solutions
4-10 Years
Not Disclosed
Early Applicant
  • Posted 2 months ago
  • Be among the first 50 applicants

Job Description

Hey Jobseekers,

we are looking for AWS Data Engineer with glue & Pyspark experience

Experience : 4 to 10 Years

Location : Hyderabad / Chennai / Noida / Pune / Bangalore

kindly reply with below details [Confidential Information]

CTC :-

ECTC :-

Notice Period :-

Preferred Location :-

  • Hands on experience in Dimensional, Data vault and relation modelling
  • Expertise in Data warehousing and ETL Design and implementation
  • Hands on experience with Programming language like Python/Scala
  • Good understanding of Spark architecture along with internals
  • Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation
  • Experience on Mulesoft is good to have
  • Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
  • Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.
  • Experience in Parallel Loading and Dependencies orchestrations
  • Awareness of scheduling and orchestration tools
  • Awareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processing
  • Experience on RDBMS systems and concepts
  • Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
  • Create test cases and perform unit testing of ETL Jobs
  • Analytical mind with a problem-solving and debugging skills.
  • Excellent Communication Skills
  • Awareness of Replication, Synchronization and Disaster Management techniques
  • Hand on experience in Data Quality Management
  • Awareness of data governance concepts and implementation
  • Hand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation

Thanks

Nishikanth

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Service Streams

RDBMS systems

Spark architecture

Parallel Loading

queues

Database components

ETL Design and implementation

Data Quality Management

About Company

Similar Jobs

3-5 yrs
Hyderabad, India
Skills:
Python Programming, Big Data Technologies, Apache Airflow, Data Modeling ETL, AWS Cloud Services, Databases SQL
3-10 yrs
Hyderabad, India
Skills:
S3, Aws Services, Scala, Apache Spark, Emr, Redshift, Lambda, Kinesis, Cloudwatch, Iam, Glue, Athena
10-12 yrs
Hyderabad, India
Skills:
.NET, Bdd, Nodejs, Angular, Tensorflow, Nosql, React, Pytorch, Docker, Terraform, Selenium, Python, Java, Rust, Big Data, Sql, Gherkin, MLops, Databricks, Cucumber, Kubernetes, LangFuse, LangSmith, LangGraph, LangChain, Playwright, LLMOps
5-10 yrs
Hyderabad, India
Skills:
Pyspark, S3, Lambda, Hive, Emr, Redshift, Python, AWS, Glue, Athena
5-7 yrs
Hyderabad, India
Skills:
Sql, Aws Redshift, cloud computing concepts, data modeling and schema design, AWS ecosystem, data warehousing concepts and best practices, ETL ELT processes