Search by job, company or skills

Pyspark Data Engineer

Pyspark Data Engineer

Tata Consultancy Services
5-7 Years
Not Disclosed
  • Posted 2 hours ago
  • Be among the first 10 applicants

Job Description

Greetings from TATA CONSULTANCY SERVICES!

TCS is hiring for Pyspark

Location: - Pune

Experience Range: - 5+ years

  • 4 – 7 years of total experience with good knowledge of Knowledge of Pyspark, Big Data experience, AWS EMR, S3, IAM, Lambda, SNS, SQS, Python and AWS services
  • Good python, Pyspark scripting skills
  • Spark UI/Optimization/debugging techniques
  • Intermediate SQL exposure – Subquery, Joins, CTE's
  • Good understanding of Database technologies
  • Excellent communication skills to liaise with Business & IT stakeholders.
  • Expertise in planning execution of a project and efforts estimation.
  • Understanding of Data Vault, data mesh and data fabric architecture patterns.
  • Exposure to working in Agile ways of working.

More Info

Job Type:
Industry:
Function:
Employment Type:

Key Skills

AWS EMR

Debugging techniques

Data mesh

Subquery

Spark UI Optimization

CTE’s

Data fabric architecture patterns

Similar Jobs

5-11 yrs
Pune, India
Skills:
Spark, Sql, Azure Databricks, Python, Git, Pyspark, Agile Methodologies, CI CD, DataFrames, Delta Lake
5-8 yrs
Pune, India
Skills:
Dax, Power Bi, Sql, Databricks, Python, Azure Synapse, Pyspark