Data Engineer – Technical Lead (Databricks & AWS)
Location: Bangalore / Hyderabad (Hybrid, 2–3 days onsite
)Budget: Up to 40 LP
AExperience: 10+ Year
sJoiners: Immediate / within 15 day
s
About the Ro
leWe are seeking an experienced Data Engineer – Technical Lead to drive end-to-end architecture, solutioning, and client engagement for large-scale cloud data platforms. The ideal candidate will combine deep technical expertise with strong leadership and communication skills to deliver scalable, secure, and high-performance solution
s.
Key Responsibilit
- iesLead technical solution design, ensuring scalability, reliability, and performan
- ce.Establish coding standards, conduct code reviews, and mentor team membe
- rs.Develop optimized Spark jobs (PySpark/Scala) with performance tuni
- ng.Build ETL/ELT pipelines using Databricks notebooks, Workflows, and AWS Gl
- ue.Integrate data into ADLS/S3 with robust security and metadata manageme
- nt.Define IAM roles, ACLs, and storage permissions for secure operatio
- ns.Collaborate with stakeholders, architects, and DevOps teams for deployment readine
ss.
Must-Have Sk
- ills8+ years in Data Engineering / Big Data / Cloud Data Platfo
- rms.6+ years hands-on with Databricks (PySpark/Scala, Delta Lake, Lakehouse, RBAC/AC
- Ls).5+ years designing Spark-based ingestion & transformation pipeli
- nes.4+ years with AWS Glue (ETL jobs, Workflows, Crawlers, Glue Catal
- og).Strong expertise in Athena, Spark, Python script
ing.
Soft S
- killsExcellent communication (verbal, email, instant messag
- ing).Strong interpersonal skills for stakeholder and team collabora
- tion.Analytical mindset with proven problem-solving abi
- lity.Agile/Scrum experience with tools like Jira/Azure De
vOps.
