Big Data Platform Engineer

Techwurkz India is looking for immediate joiners (15 days or less) for a US offshore client project supporting large-scale data platforms.

Role: Big Data Platform Engineer

Experience: 57 years

Location: Anywhere in India (100% Remote)

Shift: Rotational US shifts (includes 247 on-call support)

Experience Needed

5+ years of exp needed

Troubleshooting applications on an internal platform running Spark and Airflow.

Maintaining Spark jobs

Troubleshooting individual user's Spark issues

• Strong understanding of troubleshooting applications that are deployed on Kubernetes.
• Basic understanding of Python, for the occasional writing of scripts for automation.
• Apache Spark and Airflow will be good to have familiarity with, since it's a big part of the day-to-day troubleshooting requests.
• Networking, containerization, and Linux is crucial to know as well for managing the complex, distributed, and cloud-native infrastructure the platform is running on.

Bonus

• Java for some jobs that require some Java knowledge, which is handled most of the time by a cross-functional team.

Note This role is for a Big Data Platform Engineer. 60 to 70% is Data Engineer (development part) and 30% is operational part. Linux Admin exp is must. Kubernetes in pod exp is mandatory.