Search by job, company or skills

Data Engineer with Spark, Scala +Kafka

  • Posted 4 hours ago
  • Be among the first 10 applicants

Job Description

Data Engineer with Scala , Kafka, GCP

  • Should know how to develop, deploy , monitor and optimize Etl workflows for both Batch and Streaming with Scala, Spark, Airflow, BQ , Kafka , Dataproc and GCP environments
  • Experience in Medallion architecture with proper Data quality checks and summarization activities
  • Experience in performance optimizations, Observability and runbook creations for continuous optimizations.
  • Good knowledge of Airflow orchestrations including dependency handing, idempotent execution etc.
  • Exposure to data governance and information security would be a plus
  • Through knowledge of handing streaming data including back pressure handling etc.
  • Minimum Experience – 6+ years

Skills: gcp,scala,data quality,airflow,,bq,airflow,dataproc,kafka

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153795295

Similar Jobs

Bengaluru, India

Skills:

BigQueryGcpScalaApache SparkKafkaDataprocAirflow

Bengaluru, India

Skills:

AnsibleJavaDynamodbGrafanaMavenHadoopRustJ2EELinuxKafkaStashBig DataGitSplunkUnixGolangElastic SearchPrometheusKubernetesDockerJenkinsSparkFlinkRay StreamingEnterprise Redis DBHumio

Bengaluru, India

Skills:

Apache AirflowDockerScalaApache SparkApache KafkaAzureSqlKubernetesAWS

Bengaluru

Skills:

secure coding SqlSpring BatchData ModelingJavaPythonElasticsearchAirflowdbt

Bengaluru, India

Skills:

SparkSqlSpring BatchJavaPythonKubernetesElasticsearchKafkaAirflowdbt

Beware of Scammers

We don’t charge money for job offers