Pyspark Developer

Skill – Python Spark Developer

Primary Skills – Python, Spark,Pyspark, Airflow or Control M

Exp – 4 - 10 Yrs

Location – Tech M Office – Chennai – Sholinganallur / Bellandur - Bengaluru

Work Mode – Hybrid – 12 Days a month

Job Description

Through and hands on knowledge on Python and Spark Programming and writing efficient, reusable, and reliable Python code.

Well versed with:

· Very good proficiency in Python and Spark programming.

· Pandas: Experience with data manipulation and analysis using Pandas.

· Implementation experience of Spark Core, Spark SQL and Spark Streaming

· Working with Spark in combination Hadoop Ecosystem

· Design and implementation of low-latency, high-availability, and performance applications.

· Should lead and guide a team of junior Python developers.

· As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.

· Performance tuning, improvement, balancing, usability, and automation.

· Collaborate with other team members and stakeholders.

Educational Qualification—

• Proficiency in Python programming.
• Experience with Pandas for data manipulation and analysis.
• Knowledge of Polars for efficient data processing.
• Strong problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment