Search by job, company or skills

Data Engineer

Early Applicant
  • Posted 2 days ago
  • Be among the first 10 applicants

Job Description

  • 7+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework
  • Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices
  • Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
  • Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
  • Must have Linux experience (Shell scripting/Python)
  • Snowflake experience in creating automation pipelines for data ingestion and transformation using Spark.
  • Good to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
  • Good to have experience creating CI/CD pipelines – Maven, Gradle, Jenkins, Artifactory, AWSCodeCommit Cloudformation

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Job ID: 152056069

Similar Jobs

Hyderabad, India

Skills:

MavenPysparkApache SparkSqlApache AirflowJenkinsGitGcpAzurePythonAWSEtlSubversion

Hyderabad, India

Skills:

PysparkS3EmrRedshiftSqlApache AirflowNosqlLambdaDockerKubernetesPythonAWSGlue

Bengaluru, Hyderabad

Skills:

BigQuerySqlPythonData ModelingDimensional Modeling

Hyderabad, India

Skills:

snowflake Data ManagementHadoopPerformance TuningDimensional ModelingData ModelingRedshiftSqlData QualityHiveSparkData IntegrationPythonAirflowbig data systemsdata warehouse scalingETL pipelines

Hyderabad, India

Skills:

snowflake GcpSqlAWSPythonAzureData lake architecturesCI CD pipelines

Beware of Scammers

We don’t charge money for job offers