Data Engineer

Virtusa

Pune, India

6-10 Years

Save

Posted an hour ago
Be among the first 10 applicants

Early Applicant

Job Description

Experience 6-10 yrs

Experience in AWS services must like S3, Lambda , Pyspark, Airflow, Glue, Athena, Lake formation ,Step functions, Kinesis, Streaming Pipeline etc.
Experience in programming in Python, Functional Testing (FT) & Unit Testing (UT).
Experience in programming in CI/CD concepts - Jenkins, SQL DB Script.
Experience performing 2-3 data Migration projects (NOT DATA SCIENCE) on AWS platforms.

Nice to have

Experience in a Big Data technologies (Terradata, Snowflake, Spark, Redshift, Kafka, etc.)
Experience with data management process on AWS is a huge Plus
Experience in implementing complex ETL transformations on AWS using Glue.
Familiarity with relational database environment (Oracle, Teradata, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.

Experience in AWS services must like S3, Lambda , Pyspark, Airflow, Glue, Athena, Lake formation ,Step functions etc.

Experience in programming in AWS and Python.

Should have expertise in performing data analysis (NOT DATA SCIENCE) on AWS platforms

Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)

Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)