- Skills Data Engineering, Must have experience with Java & Scala based implementations for enterprise-wide platforms.
- Experience with Apache Beam, Google Dataflow, Apache Kafka for real-time steam processing technology stack.
- Complex state-full processing of events with partitioning for higher through puts.
Must Have - Either of the below combinations:
- Java + Apache Beam (Dataflow / Flink) & GCP
- 2. Python + Apache Beam (Dataflow / Flink) & GCP
- 3. Java + Apache Spark
- 4. Python + Apache Spark