Job Title: Data Engineer - Databricks
Experience: 5+ Years
Location: Coimbatore
Employment Type: Full-time - On-site
Job Summary:
We are looking for a highly skilled Data Engineer with strong expertise in Databricks, SQL, and modern data engineering practices. The ideal candidate should be Databricks certified and capable of building scalable, high-performance data pipelines to support analytics and business intelligence needs.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks.
- Build and optimize ETL/ELT workflows for large-scale data processing.
- Write complex and optimized SQL queries for data transformation and analysis.
- Work with big data technologies like Apache Spark (PySpark).
- Ensure high data quality, reliability, and performance.
- Collaborate with cross-functional teams including Data Science, Analytics, and Business teams.
- Implement data governance, security, and best practices.
- Troubleshoot and optimize data workflows for performance and cost efficiency.
Required Skills:
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks (Spark, Delta Lake).
- Advanced proficiency in SQL.
- Experience with Python / PySpark.
- Strong understanding of data modeling and ETL/ELT processes.
- Experience with cloud platforms such as AWS / Azure / GCP.
Certifications:
- Databricks Certified Data Engineer Associate or Professional (highly preferred)
Nice to Have:
- Experience with Airflow or other orchestration tools.
- Familiarity with Snowflake, BigQuery, or Redshift.
- Experience with real-time data processing (Kafka, streaming).
- Exposure to BI tools like Power BI or Tableau.
