Search by job, company or skills

zorba ai

PySpark Data Engineer

zorba ai
Bengaluru, India
5-10 Years

This job is no longer accepting applications

  • Posted a month ago

Job Description

Role: PySpark Data Engineer

Experience: 5–10 Years

Locations: Chennai, Bangalore, Hyderabad, Delhi, Pune

Open Positions: 10

Required Technical Skills

  • Strong experience in Python and PySpark
  • Hands-on experience with Big Data technologies
  • Expertise in Hadoop ecosystem components such as Hive and Impala
  • Strong SQL knowledge including Joins, Subqueries, and CTEs
  • Experience with Spark optimization, debugging, and Spark UI analysis
  • Good Python scripting and automation skills
  • Exposure to database technologies
  • Hands-on AWS cloud experience with:
    • EMR
    • S3
    • IAM
    • Lambda
    • SNS
    • SQS
    • Redshift
Key Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark
  • Process and analyze large-scale structured and unstructured datasets
  • Develop ETL/ELT workflows on Big Data platforms
  • Work on Spark performance tuning and debugging
  • Integrate AWS cloud services within data engineering solutions
  • Collaborate with cross-functional teams for data integration and analytics initiatives
  • Ensure data quality, reliability, and performance across pipelines

Must-Have Skills

  • PySpark
  • Python
  • Big Data/Hadoop ecosystem
  • Hive / Impala
  • SQL
  • AWS EMR & S3

Good-to-Have Skills

  • Scala
  • Spark UI optimization techniques
  • AWS Lambda, SNS, SQS, IAM
  • Redshift
  • Strong debugging and scripting skills

Skills: aws,pyspark,big data

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Data Engineering
Employment Type:
Full time

About Company

zorba ai

Job ID: 147198925

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 24-05-2026 05:35:17 PM
Homejobs in Bengaluru / BangalorePySpark Data Engineer

Similar Jobs

PySpark Data Engineer | Big Data & Analytics

Synechron
S
Bengaluru, India

Skills:

Cassandra, Pyspark, Apache Airflow, Nosql, Numpy, Docker, Azure Data Lake, Python, AWS, Spark SQL, Pycharm, Hadoop, Sql, Jenkins, Hive, Pandas, Azure, Kubernetes, DataFrames, GitHub Actions, Spark MLlib, HDFS, Jupyter, VSCode

Data Engineer (AWS & PySpark)

Wissen Technology
Bengaluru, India

Skills:

data engineering , Pyspark, AWS Glue, Data Warehousing Concepts, Etl Development, Python, Sql, AWS EMR, Data Pipeline Design

Python, Pyspark, GCP Data Engineer

Zensar Technologies
Bengaluru, India

Skills:

Pyspark, Sql, Apache Spark, DataFlow, BigQuery, MySQL, Nosql, Python, Terraform, Docker, Git, PostgreSQL, Cloud DataProc, Cloud Functions

Data Engineer (PySpark)

Clover Infotech
Bengaluru

Skills:

Pyspark, Scripting, Big Data Technologies, Data Warehousing, Cloudera Data Platform

Data Engineer (PySpark) - Leading UAE Bank, Cloudera Data Platform Expert

global software solutions group
Bengaluru, India

Skills:

Pyspark, Big Data Technologies, Data Warehousing, Cloudera Data Platform, Scripting and Automation, Orchestration and Scheduling