PySpark Data Engineer

zorba ai

Delhi, India

5-10 Years

Save

Posted 17 hours ago
Be among the first 10 applicants

Early Applicant

Job Description

Role: PySpark Data Engineer

Experience: 5–10 Years

Locations: Chennai, Bangalore, Hyderabad, Delhi, Pune

Open Positions: 10

Required Technical Skills

Strong experience in Python and PySpark
Hands-on experience with Big Data technologies
Expertise in Hadoop ecosystem components such as Hive and Impala
Strong SQL knowledge including Joins, Subqueries, and CTEs
Experience with Spark optimization, debugging, and Spark UI analysis
Good Python scripting and automation skills
Exposure to database technologies
Hands-on AWS cloud experience with:

EMR
S3
IAM
Lambda
SNS
SQS
Redshift

Key Responsibilities

Design, develop, and optimize scalable data pipelines using PySpark
Process and analyze large-scale structured and unstructured datasets
Develop ETL/ELT workflows on Big Data platforms
Work on Spark performance tuning and debugging
Integrate AWS cloud services within data engineering solutions
Collaborate with cross-functional teams for data integration and analytics initiatives
Ensure data quality, reliability, and performance across pipelines

Must-Have Skills

PySpark
Python
Big Data/Hadoop ecosystem
Hive / Impala
SQL
AWS EMR & S3

Good-to-Have Skills

Scala
Spark UI optimization techniques
AWS Lambda, SNS, SQS, IAM
Redshift
Strong debugging and scripting skills

Skills: aws,pyspark,big data

More Info

Job Type:

Industry:

Function:

Employment Type:

About Company

zorba aiJob Source: www.linkedin.com

Job ID: 147202773

Jobs by Skill - IT

Jobs by Skill - Non IT

International Jobs

Last Updated: 12-05-2026 02:01:40 PM

Homejobs in DelhiPySpark Data Engineer

Similar Jobs

Pyspark Data Engineer+5+yrs

zorba ai

5-7 yrs

Delhi, India

Skills:

Hadoop Ecosystem, Sql, Data Modeling, Data Governance, Apache Spark, Pyspark, Kafka, Airflow, ETL pipeline development

GCP Data Engineer | Java & PySpark

Synechron

6-8 yrs

Gurugram, Gurugram, India

Skills:

Java, BigQuery, Hadoop, Pyspark, Spring Boot, Sql, UNIX, Tensorflow, Restful Web Services, Cloud Storage, Git, Hive, Gcp, shell scripting, Linux, Perl, Spark, Dataproc, DataFlow, Python, Scikit-learn, Cloud Composer

Data Engineer - Python & Pyspark with AWS

Staffice Global Private Limited

5-7 yrs

Gurugram

Skills:

Python, Sql, Aws, Etl

Data Engineer - ( PySpark, SQL, Python, ETL & cloud )

getege edtech pvt. ltd.

5-7 yrs

Noida, India

Skills:

data engineering , Spark, Sql, Databricks, ELT, Cosmos DB, Data Modeling, Azure Data Factory, Data Lake, Hadoop, Numpy, Pandas, Etl, Python, Azure SQL Database, Synapse Analytics, Blob Storage