Data Engineering Lead

About the Role

The Data Engineering Lead will be responsible for leading the design and development of scalable ETL/ELT pipelines and data workflows, ensuring data quality, governance, and performance optimization.

Responsibilities

• Lead the design and development of scalable ETL/ELT pipelines and data workflows
• Develop and optimize T-SQL queries, stored procedures, and database solutions
• Build and manage data solutions using Snowflake, MSSQL, and Databricks
• Develop data pipelines using Python and Spark (Databricks)
• Implement and manage CI/CD pipelines for data engineering deployments
• Ensure data quality, governance, and performance optimization
• Design and implement data models and data warehouse architectures
• Collaborate with business and technical teams to translate requirements into solutions
• Perform code reviews, troubleshooting, and production support
• Mentor and guide junior data engineers and drive best practices

Required Skills

• 8+ years of experience in data engineering
• Strong expertise in T-SQL and SSIS (SQL Server Integration Services)
• Basic DBA skills (indexing, backup/recovery, performance tuning)
• Hands-on experience in ETL/ELT implementation and data pipeline development
• Experience with Snowflake and Microsoft SQL Server (MSSQL)
• Strong working knowledge of Databricks and Python
• Solid understanding of data modeling and data warehousing concepts
• Experience with CI/CD tools and automated deployment pipelines
• Hands-on experience with cloud platforms (AWS or Azure)
• Strong knowledge of performance tuning and query optimization
• Knowledge of data governance, security, and compliance practices