Search by job, company or skills

V

Data Engineer

6-10 Years
Save
  • Posted 22 days ago
  • Be among the first 40 applicants
Early Applicant

Job Description

Experience 6-10 yrs

  • Experience in AWS services must like S3, Lambda , Pyspark, Airflow, Glue, Athena, Lake formation ,Step functions, Kinesis, Streaming Pipeline etc.
  • Experience in programming in Python, Functional Testing (FT) & Unit Testing (UT).
  • Experience in programming in CI/CD concepts - Jenkins, SQL DB Script.
  • Experience performing 2-3 data Migration projects (NOT DATA SCIENCE) on AWS platforms.

Nice to have

  • Experience in a Big Data technologies (Terradata, Snowflake, Spark, Redshift, Kafka, etc.)
  • Experience with data management process on AWS is a huge Plus
  • Experience in implementing complex ETL transformations on AWS using Glue.
  • Familiarity with relational database environment (Oracle, Teradata, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.

Experience in AWS services must like S3, Lambda , Pyspark, Airflow, Glue, Athena, Lake formation ,Step functions etc.

Experience in programming in AWS and Python.

Should have expertise in performing data analysis (NOT DATA SCIENCE) on AWS platforms

Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)

Experience in Big Data technologies (Spark, Redshift, Kafka, etc.)

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 148321799

Similar Jobs

Pune, India

Skills:

CassandraPysparkPostgreSQLApache SparkSQL ServerAzure DatabricksELTDockerMongoDBKubernetesEtlInflux DB

Pune, India

Skills:

Apache AirflowTerraformPysparkAzure Data LakePythonSqldbtDelta LakeMicrosoft Fabric

Pune, India

Skills:

HadoopPysparkScalaAWS GlueDynamodbHBaseSqlDataBricksHiveAws RedshiftPythonAWS EMRAWS Cloud Data PlatformNoSQL databasesSpark Framework

Pune

Skills:

HiveHadoopPysparkShell ScriptingPythonAirflow

Pune, India

Skills:

Microsoft Sql ServerPython Programming LanguageGoogle BigQuery