T
PySpark Developer
T
PySpark Developer
Tata Consultancy Services- Posted 4 hours ago
- Be among the first 10 applicants
Job Description
Dear Professionals
Greetings from Tata consultancy Services,
Job Title : PySpark Developer
Experience : 5 to 10 Years
Location: Chennai, Bengaluru, Hyderabad, Pune, Kolkata.
Mode of Work : Work from Office
Mode of Interview: Virtual
Key Responsibilities
- PySpark and Spark SQL
- Working with Dataframes using different APIs
- Spark Functions
- Advanced Data transformations
- Good knowledge in SQL
- Applying UDFS
- Error handling, logging and monitoring
- Unix, Scheduling Tool
- Performance Tuning & Generic process development
ETL Technical Designing, Guiding Team for solving Technical Problems, Providing Technical Solution to Client
Understanding Business Requirement and converting to Technical specification, Execution Planning
Effort Estimation, Task assignment to the team and tracking of activities, Performance Tuning
Hands on development for complex modules, ensuring coding standards, quality of delivery
- Flexibility to work in Development/Maintenance Support type of work and work in shifts (if needed)
- Banking Domain Knowledge
More Info
Key Skills
Dataframes
Unix Scheduling Tool
Advanced Data transformations
Error handling
UDFs
Spark Functions
About Company
Skills:
Hadoop, Pyspark, Scala, Mapreduce, Unix Shell Scripting, Hive, Spark, Tensorflow, Python, Pytorch, scikit-learn, Machine Learning Techniques, SparkML
Skills:
Hive, Hadoop, Pyspark, Spark, Data Warehousing, Unix Shell Scripting, Sql, Etl, BigData technologies, HDFS
Skills:
Java, Performance Tuning, Pyspark, Kafka, Sql, ELT, Query Optimization, Apache Airflow, Data Quality, Git, Data Governance, Python, Etl, Apache Iceberg, DevOps practices, data modeling techniques, data transformation frameworks, large-scale structured and unstructured datasets, Spark-based data processing, data partitioning, metadata
Skills:
data wrangling , slicing , Numpy, Pandas, Concurrency, Git, Restful Services, Oop, Pyspark, data pipeline, Debugging, Apis, Core Python, Data Loading, Gen AI, dataframes, DB connectivity, application unit tests, Decorators, apply map functions, Vector operations, applymap, Lambda Functions, error handling, aggregations
Skills:
data wrangling , Oops, Data pipeline, Concurrency, Python, Pyspark, Exception Handling, Apis, Data Loading, Debugging, Numpy, Git, Pandas, Restful Services, Unit tests, Decorators, Dataframes, Apply map functions, Lambda Functions, Parallel Processing, Error handling, Applymap, DB connectivity, Gen Agentic AI, Vector operations