Search by job, company or skills

C

Databricks + Pyspark

new job description bg glownew job description bg glownew job description bg svg
  • Posted 13 days ago
  • Be among the first 20 applicants
Early Applicant

Job Description

Skills- Databricks+ Pyspark

Experience: 4 to 13 years

We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.

Key Responsibilities

  • Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.
  • Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models.
  • Performance & Cost Optimization: Fine-tune Spark configurations, optimize Databricks clusters, and reduce compute/storage costs.
  • Collaboration: Work closely with Data Scientists, Analysts, and DevOps teams to ensure data reliability.
  • ETL & Data Warehousing: Implement scalable ETL processes for structured & unstructured data.
  • Monitoring & Automation: Implement logging, monitoring, and alerting mechanisms for data pipeline health and fault tolerance.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 133088775