Search by job, company or skills

INNOVA SOLUTIONS

AWS Data Engineer with AWS,SQL,Pyspark,Glue,SCD

Save
  • Posted 17 days ago
  • Over 100 applicants
Quick Apply

Job Description

  • 7-10 yrs exp with Python , Pyspark , SQL, AWS (S3,EMR,EC2,glue,redshift,lamba), Snowflake
  • S3 life cycle ,DPU in glue ,database connection from glue job, lambda , 100 files in Athena, Spark entry point ,Data Frame Dynamic Frame, Spark Join strategies ,Broadcast and Accumulator , DAG And Lineage, Start snowflake schema, SCD type 2 ,Orchestration ,Airflow
  • Airflow Operators, Semi Anti join ,Windows Functions ,Decorators, deep and shallow, Hashing Algo , Data skewness.

About Company

Job ID: 107708683

Similar Jobs

Hyderabad, India

Skills:

RDSPysparkAWS GlueDynamodbEmrSqlLambdaCloudwatchIamSqsSnsPythonAWSLake FormationCloudTrail

Chennai, India

Skills:

PysparkS3LambdaEtl ToolsEmrPythonSqlRedshiftAWSGlue

Pune, India

Skills:

snowflake JavaS3Amazon Web ServicesScalaKafkaEmrCelerySparkKubernetesPythonAirflowAWS Step FunctionsdbtGlueAthena

Pune, India

Skills:

TcpMS-SQLWindows ServerPl SqlSwitchesMicrosoft Sql ServerHTMLJavascriptshell scriptingMySQLRoutersOraclePythonUDPCSSPbxSqlIisUnix CommandsUDM developmentActimize AISRelational Databasestelephony backgroundnetwork principlesNICsRecording Telephony integrationsIP communicationnetwork testing and analysis toolsAWS cloud environmentsActive Directory security policiesRcmACD vendors

Pune, India

Skills:

snowflake PysparkOracle Sql ServerAdfTidalSSISAutosysSqlDatabricksAzurePythonAirflowControl-M