T
AWS Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Job Description
AWS Data Engineer
Key Requirements/ Past Experiences/ Knowledge
Proficiency in Scala/Java/Python
Oozie, Hive & Scala (hands on)
Experience with Apache Spark
Cloud expertise: primarily AWS
Hands-on experience in building on-premises data pipelines using big data platforms like Cloudera, including basic Hive and Oozie
Performance tuning techniques - for hive & scala
CI CD Pipelines (GIT/Jenkins)
Unit testing
Familiarity with GitLab for source control
Location
Hyderabad, Bangalore, Kolkata, Chennai,Pune
Job ID: 152330555
Skills:
S3, Lambda, Pyspark, Python, AWS, Glue
Skills:
Machine Learning, Apache Spark, Node.js, Natural Language Processing, Data mining, Python, AWS, Technical computing tools, Container orchestration, Managed cloud DB
Skills:
AWS Glue, Dynamodb, Apache Airflow, Kinesis, Spark, Aws Redshift, Python, Glue Catalog, AWS EMR, AWS DMS, Managed Streaming for Apache Kafka, Aurora, Spark Scala, dbt, AWS Kinesis
Skills:
Aws Lambda, AWS Glue, Data Warehousing, AWS Athena, Sql, ELT, Databricks, Etl, AWS EMR, Amazon QuickSight, AWS Step Functions, distributed processing, data lakes
Skills:
Python Programming, SQL proficiency, Data modeling and schema design, ETL/ELT processes, AWS data services
