
Search by job, company or skills
Job Description
AWS Data Engineer
Key Requirements/ Past Experiences/ Knowledge
Proficiency in Scala/Java/Python
Oozie, Hive & Scala (hands on)
Experience with Apache Spark
Cloud expertise: primarily AWS
Hands-on experience in building on-premises data pipelines using big data platforms like Cloudera, including basic Hive and Oozie
Performance tuning techniques - for hive & scala
CI CD Pipelines (GIT/Jenkins)
Unit testing
Familiarity with GitLab for source control
Location
Hyderabad, Bangalore, Kolkata, Chennai,Pune
Job ID: 153630513
Skills:
Machine Learning, Apache Spark, Node.js, Natural Language Processing, Data mining, Python, AWS, Technical computing tools, Container orchestration, Managed cloud DB
Skills:
S3, Lambda, Pyspark, Python, AWS, Glue
Skills:
Aws Lambda, AWS Glue, Data Warehousing, AWS Athena, Sql, ELT, Databricks, Etl, AWS EMR, Amazon QuickSight, AWS Step Functions, distributed processing, data lakes
Skills:
amazon emr , Pyspark, Amazon S3, AWS Glue, Sql, Amazon Redshift, Python, Apache Hadoop, Lambda, RDS, Kinesis, Ec2, Dynamodb, Spark, Amazon Aurora, Iceberg, Step Functions, Glue, Athena
Skills:
Python Programming, SQL proficiency, Data modeling and schema design, ETL/ELT processes, AWS data services