Databricks Developer

Description

We are seeking an experienced Databricks Developer to join our team in India. The ideal candidate will have a strong background in data engineering and a passion for building scalable data solutions using Databricks and Apache Spark.

Responsibilities

• Develop and maintain data pipelines in Databricks using Spark.
• Collaborate with data engineers and data scientists to design scalable data solutions.
• Optimize Spark jobs for performance and cost efficiency.
• Implement ETL processes to extract, transform, and load data from various sources.
• Work with cloud technologies such as Azure or AWS to deploy Databricks solutions.
• Troubleshoot and debug data processing issues in Databricks.
• Ensure data quality and consistency across data processing workflows.

Skills and Qualifications

• 8-18 years of experience in data engineering or related field.
• Strong proficiency in Apache Spark and Databricks.
• Experience with programming languages such as Scala, Python, or Java.
• Knowledge of SQL and data modeling concepts.
• Familiarity with cloud platforms like Azure or AWS.
• Understanding of data warehousing concepts and tools.
• Ability to work with large datasets and distributed computing.
• Excellent problem-solving skills and attention to detail.