Lead Data Engineer (Databricks)

Job Title: Data Engineer

Location: Hyderabad / Ahmedabad (Hybrid)

Experience: 7+ Years

Key Responsibilities:

Required Skills: Python, Pyspark, SQL, Databricks

Please apply if you can join in less than 30 days.

About the Role:

We are seeking a Data Engineer with 7+ years of experience to develop scalable and high-performance data solutions. The ideal candidate will have strong expertise in Python, PySpark, SQL, and Databricks, along with a deep understanding of big data processing and cloud technologies.

Key Responsibilities:

• Design, develop, and enhance ETL/ELT data pipelines using Python and PySpark.
• Build and maintain large-scale data processing frameworks with Databricks.
• Write and optimize SQL queries, stored procedures, and data models for efficient data management.
• Work with both structured and unstructured data to enable business intelligence and analytics.
• Ensure data pipeline efficiency, scalability, and reliability through continuous optimization.
• Implement data governance, security, and compliance best practices.
• Collaborate closely with data scientists, analysts, and business stakeholders to deliver data-driven insights.
• Identify and resolve data quality issues, performance bottlenecks, and system failures in production environments.

Must-Have Skills:

Python Proficient in writing clean, efficient, and scalable code for data processing.

PySpark Hands-on experience with distributed data processing and optimization.

SQL Strong ability to write complex queries and optimize database performance.

Databricks Practical experience in building and managing large-scale data solutions.