Data Engineer -Data Engineer Data Platform
Data Engineer -Data Engineer Data Platform
Unison Group New Zealand- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
Experience: 4-6 years of experience in data engineering or software development.
Technical Expertise:
Technical Expertise:
- Strong hands-on experience with Apache Spark / PySpark
- Proficiency in Python programming (data manipulation, error handling, packaging)
- Solid understanding of distributed computing concepts (RDDs, DataFrames, partitions, shuffles)
- Proficient in SQL and data modeling for both structured and semi-structured data
- Understanding of version control (Git), CI/CD, and Agile methodologies
- Strong debugging, performance tuning, and analytical skills
More Info
Key Skills
About Company
Skills:
AWS Glue, Containers, Data Modeling, Grafana, Datadog, Nosql, Lambda, Typescript, Javascript, Terraform, Python, Java, Apache Flink, Cloudformation, Kotlin, Sql, Automated Testing, Cloudwatch, ECS, Spark, Kubernetes, Message queues, AWS CDK, Go, Streaming platforms, Infrastructure as code, OpenTelemetry, Serverless technologies, GraphQL APIs, Relational Databases, Event-driven architectures
Skills:
snowflake , Power Bi, Pyspark, Workato, Git, Terraform, Iam, Databricks, Azure, Python, AWS, Airflow, GitHub Actions, rbac, dbt, CI/CD, Secrets Management, Fivetran
Skills:
Java, Scala, Kafka, Sql, Git, Spark, Kubernetes, Python, Airflow, Nessie, Flink, Iceberg, Polaris
Skills:
Cloudformation, Pyspark, Apache Spark, Kafka, Redshift, Sql, Redis, Terraform, Presto, ECS, Python, Kubernetes, Apache Iceberg, Airflow, Pinot, Debezium, ClickHouse, StarRocks, Druid, Hudi, Delta Lake, Trino
Skills:
data modeling concepts, Databricks Unified Data Analytics Platform, data integration techniques, scripting and automation, cloud-based data processing and storage solutions