Search Jobs

Search by job, company or skills

  • Posted 3 hours ago
  • Be among the first 10 applicants

Job Description

JD

Join us for our Walk-in Drive in Bangalore on 19th September 2026 (Saturday) and explore exciting career opportunities. If you are interested, please apply with your updated resume.

Role : Pyspark Data Engineer / Pyspark Developer

Experience : 4 to 10 years

Location : Bangalore

Mode : Work from Office

Responsibilities:

• Data Processing: Design, develop, and maintain data processing solutions using PySpark, Apache Spark, and Python.

• Data Pipeline Development: Develop and optimize data pipelines using PySpark, Apache Spark, and cloud-based data platforms.

• Data Integration: Integrate data from various sources, including relational databases, NoSQL databases, and cloud storage.

• Data Transformation: Develop and implement data transformation logic using PySpark, Apache Spark, and Python.

• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.

Required Skills: • PySpark: In-depth knowledge of PySpark, Apache Spark, and Python.

• Data Processing: Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage.

• Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.

• Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines

• Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark • Programming: Proficiency in programming languages, including Python, Java, or Scala.

• Communication: Excellent communication and collaboration skills.

More Info

Job Type:
Industry:
Employment Type:

Similar Jobs

8-15 yrs
Bengaluru, India
Skills:
snowflake GolangPostgreSQLAWS GlueKafkaPythonStep FunctionsClickHouse
8-12 yrs
Bengaluru, India
Skills:
DockerPysparkSQL ServerDatabricksRestful ApisKubernetesAzure DevOpsAzure Container RegistryAzure Key VaultAzure Blob StorageAzure Kubernetes Service
5-7 yrs
Bengaluru, India
Skills:
agent development Agentic DesignETL processesData pipeline architecturePython Programming LanguageData storage solutions
5-12 yrs
Bengaluru, India
Skills:
snowflake Performance TuningSqlData ModellingPythonEtldbt Data Build ToolauditingMonitoringCI CD environmentsBig Data frameworksSecurityAzure cloud infrastructureautomated deployments