Search by job, company or skills

  • Posted 3 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

  • Core Frameworks: Apache Spark, PySpark, Airflow, NiFi, Kafka, Hive, Iceberg, Oozie
  • Programming Languages: Python, Scala, Java
  • Data Formats & Storage: Parquet, ORC, Avro, S3, HDFS
  • Orchestration & Workflow: Airflow, DBT
  • Performance Optimization: Spark tuning, partitioning strategies, caching, YARN/K8s resource tuning
  • Testing & Validation: Great Expectations, Deequ, SQL-based QA frameworks
  • Observability & Monitoring: Datadog, Grafana, Prometheus

More Info

Job Type:
Industry:
Employment Type:

Job ID: 145103791