Search by job, company or skills

Innova Solutions

Data Engineer - AWS

Save
  • Posted a month ago
  • Be among the first 40 applicants
Early Applicant

Job Description

Hey Jobseekers,

we are looking for AWS Data Engineer with glue & Pyspark experience

Experience : 4 to 10 Years

Location : Hyderabad / Chennai / Noida / Pune / Bangalore

kindly reply with below details [Confidential Information]

CTC :-

ECTC :-

Notice Period :-

Preferred Location :-

  • Hands on experience in Dimensional, Data vault and relation modelling
  • Expertise in Data warehousing and ETL Design and implementation
  • Hands on experience with Programming language like Python/Scala
  • Good understanding of Spark architecture along with internals
  • Hand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formation
  • Experience on Mulesoft is good to have
  • Hands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions,
  • Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.
  • Experience in Parallel Loading and Dependencies orchestrations
  • Awareness of scheduling and orchestration tools
  • Awareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processing
  • Experience on RDBMS systems and concepts
  • Expertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.
  • Create test cases and perform unit testing of ETL Jobs
  • Analytical mind with a problem-solving and debugging skills.
  • Excellent Communication Skills
  • Awareness of Replication, Synchronization and Disaster Management techniques
  • Hand on experience in Data Quality Management
  • Awareness of data governance concepts and implementation
  • Hand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation

Thanks

Nishikanth

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 128714929

Similar Jobs

Hyderabad, India

Skills:

LambdaAWS CloudwatchDynamo DbAws CloudRedshiftPythonSqlStep FunctionGlue

Hyderabad, India

Skills:

data preparation Data ModelingHadoopAmazon S3TableauSqlSap BwAzure Data FactorySap HanaAzure Synapse AnalyticsDatabricksQlikviewPredictive AnalyticsPythonEtlSap Business ObjectsColumnar NoSQL Database PlatformsRelational Database PlatformsAzure Blob StorageAzure Data Lake StorageRDataikuMap Reduce

Hyderabad, India

Skills:

snowflake GithubS3SqlJenkinsLambdaKmsEc2IamSnsPythonAWSGlue

Hyderabad, India

Skills:

snowflake LambdaSqlS3SQL ServerApache AirflowEmrJiraPostgresPysparkAWSCloudformationOraclePythonGitRedshiftSagemakerMWAAStep FunctionsGlueUnified StudioFargateAurora

Hyderabad, India

Skills:

Python ProgrammingBig Data TechnologiesApache AirflowData Modeling ETLAWS Cloud ServicesDatabases SQL