Search by job, company or skills

5-13 Years
Not Disclosed
Early Applicant
Quick Apply
  • Posted 58 minutes ago
  • Be among the first 10 applicants

Job Description

Python / Databricks / PySpark Developer

Experience: 5 Years

Role: Data Engineer

Mandatory Skills: Python, PySpark, Databricks, SQL

Job Summary

We are looking for an experienced Data Engineer with strong hands-on expertise in Python, PySpark, and Databricks to develop and maintain scalable data processing solutions.

Key Responsibilities

  • Develop and maintain data pipelines using Python and PySpark.
  • Build and manage ETL/ELT workflows in Databricks.
  • Perform data extraction, transformation, and loading.
  • Work with large datasets using Apache Spark and SQL.
  • Optimize data processing jobs for performance and scalability.
  • Ensure data quality, reliability, and pipeline efficiency.

Required Skills

  • Strong programming experience in Python.
  • Hands-on experience with PySpark and Apache Spark.
  • Experience working with Databricks.
  • Good knowledge of SQL and data engineering concepts.
  • Experience developing and maintaining data pipelines.

Preferred Skills

  • Delta Lake and Spark optimization.
  • Azure or AWS cloud platforms.
  • Experience with production data pipelines and troubleshooting.

Ideal Candidate

A Data Engineer with approximately 5 years of experience and practical expertise in Python, PySpark, Databricks, and SQL.

More Info

Job Type:
Function:
Employment Type:

Key Skills

User Avatar

About Recruiter

Harika Gowrisetty

0 Active Jobs

Similar Jobs

6-8 yrs
Chennai, India
Skills:
S3, Github, Performance Tuning, Agile Development Methodologies, Pyspark, Emr, Redshift, Sql, ELT, Lambda, Git, Iam, Data Warehousing, Python, Etl, AWS Data Services, Glue, Optimization of Spark applications, Athena
7-10 yrs
Bengaluru, India
Skills:
snowflake , Java, Github, Scala, Pl Sql, Data Modeling, Informatica, Apache Nifi, Jenkins, Etl Tools, Data Warehousing, Solution Designing, Oracle, Python, AWS architecture, Relational Databases, CI CD tools
12-14 yrs
Bengaluru, India
Skills:
Java, BigQuery, Hadoop, C++, Scala, Kafka, Hive, Spark, Databricks, Python, Kubernetes, Airflow, Go, HDFS, Delta Lake, CI/CD
5-12 yrs
Hyderabad, India
Skills:
Relational Databases (RDBMS), Azure Data Factory, Azure Synapse Analytics, Pyspark, Azure Data Lake, Sql, Python
6-10 yrs
Bengaluru, India
Skills:
Git, Pyspark, Sql, Python, Azure DevOps, AI-Assisted Development, Claude Claude Code, Microsoft Fabric, CI CD, Azure Data Factory ADF