T
Pyspark Data Engineer
T
Pyspark Data Engineer
Tata Consultancy Services- Posted 2 hours ago
- Be among the first 10 applicants
Job Description
Greetings from TATA CONSULTANCY SERVICES!
TCS is hiring for Pyspark
Location: - Pune
Experience Range: - 5+ years
- 4 – 7 years of total experience with good knowledge of Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS, Python and AWS services
- Good python, Pyspark scripting skills
- Spark UI/Optimization/debugging techniques
- Intermediate SQL exposure – Subquery, Joins, CTE's
- Good understanding of Database technologies
- Excellent communication skills to liaise with Business & IT stakeholders.
- Expertise in planning execution of a project and efforts estimation.
- Understanding of Data Vault, data mesh and data fabric architecture patterns.
- Exposure to working in Agile ways of working.
More Info
Key Skills
AWS EMR
Debugging techniques
Data mesh
Subquery
Spark UI Optimization
CTE’s
Data fabric architecture patterns


