Technical Lead – Data Engineering (Databricks & Snowflake)
Location: Hyderabad
Yrs of exp- 14-16 Yrs
Job Summary
Key Responsibilities
- Lead the design and architecture of scalable, high-performance data solutions on Databricks and Snowflake
- Define and enforce best practices for data engineering, including coding standards, performance optimization, and cost management
- Oversee the development and maintenance of robust ETL/ELT pipelines ensuring data quality, reliability, and scalability
- Collaborate with data architects, product owners, and business stakeholders to translate requirements into technical solutions
- Implement and ensure adherence to data governance, security, and compliance standards
- Mentor and guide engineering teams through code reviews, design discussions, and technical problem-solving
- Monitor system performance, troubleshoot issues, and optimize workloads for efficiency and cost
- Drive release planning, deployment strategies, and continuous improvement across data platforms
- Identify and resolve technical blockers, ensuring smooth project delivery
Required Skills & Qualifications
- 7+ years of experience in data engineering or related roles
- Strong expertise in Databricks (Spark, Delta Lake) and Snowflake
- Proficiency in Python, SQL, and distributed data processing frameworks
- Experience designing and implementing ETL/ELT pipelines at scale
- Strong understanding of data modeling, data warehousing, and lakehouse architecture
- Experience with orchestration tools (Airflow, Azure Data Factory, etc.)
- Knowledge of cloud platforms (Azure, AWS, or GCP)
- Familiarity with data governance, security, and compliance practices
- Excellent problem-solving and leadership skills
Preferred Qualifications
- Experience with CI/CD pipelines and DevOps practices
- Exposure to real-time data processing and streaming frameworks
- Knowledge of cost optimization strategies in cloud data platforms
- Prior experience in leading teams or managing technical delivery
