Search by job, company or skills

Data Engineer - AWS

Early Applicant
  • Posted 2 months ago
  • Be among the first 50 applicants

Job Description

Hey Jobseekers,

we are looking for AWS Data Engineer with glue & Pyspark experience

Experience : 4 to 10 Years

Location : Hyderabad / Chennai / Noida / Pune / Bangalore

kindly reply with below details [Confidential Information]

CTC :-

ECTC :-

Notice Period :-

Preferred Location :-

  • Hands on experience in Dimensional, Data vault and relation modelling
  • Expertise in Data warehousing and ETL Design and implementation
  • Hands on experience with Programming language like Python/Scala
  • Good understanding of Spark architecture along with internals
  • Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation
  • Experience on Mulesoft is good to have
  • Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
  • Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.
  • Experience in Parallel Loading and Dependencies orchestrations
  • Awareness of scheduling and orchestration tools
  • Awareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processing
  • Experience on RDBMS systems and concepts
  • Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
  • Create test cases and perform unit testing of ETL Jobs
  • Analytical mind with a problem-solving and debugging skills.
  • Excellent Communication Skills
  • Awareness of Replication, Synchronization and Disaster Management techniques
  • Hand on experience in Data Quality Management
  • Awareness of data governance concepts and implementation
  • Hand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation

Thanks

Nishikanth

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 128714929

Similar Jobs

Hyderabad, India

Skills:

Python ProgrammingBig Data TechnologiesApache AirflowData Modeling ETLAWS Cloud ServicesDatabases SQL

Hyderabad

Skills:

PysparkRedshiftSqlData LakePythonAWS Glue

Hyderabad, India

Skills:

snowflake Aws LambdaAmazon RedshiftAmazon S3PysparkAWS GlueData WarehousingPythonELTEtlScalable Data Pipelines

Hyderabad, India

Skills:

DeduplicationSqlPythonTerraformPysparkSparkAWS data servicesSCD Type 2incremental processingLakehouse Medallion architecturecdchistorical processing

Hyderabad, India

Skills:

SparkData ModelingBig Data TechnologiesJavaAws S3PythonScalaHadoopdata warehousing solutionsETL processes

Beware of Scammers

We don’t charge money for job offers