Insight Direct India is seeking an experienced and ambitious Cloud Technical Lead - Data to join our team. In this role, you'll be responsible for building our Enterprise Data platform using Snowflake, setting up scalable and robust Databricks clusters, and developing pipelines to validate, ingest, normalize, enrich, and process business-specific data.
As a Cloud Technical Lead - Data, you will get to:
- Lead the building of an Enterprise Data platform using Snowflake.
- Set up scalable, robust, and resilient Databricks clusters.
- Build pipelines to validate, ingest, normalize/enrich, and perform business-specific data processing.
What We're Looking For
- Experience:
- 7-10 years of overall experience in data technologies.
- 5+ years of working experience in Data processing / ETL.
- 2+ years of working experience in Snowflake.
- A minimum of 2 years working experience in Databricks and Python.
- Education: BE, B.Tech in Information Technology, or a related field.
- Snowflake Expertise: Strong understanding of Snowflake architecture, roles, and user security. Proven experience in Snowflake with data modeling, data pipelines, data governance, and performance tuning. Understanding of Snowflake capabilities like Snowpipe, STREAMS, etc.
- Azure Data Services: Strong knowledge and skills in Azure. Experience with implementation of Azure data services solutions, including Azure Data Factory, SQL Database, Stream Analytics, Data Lake, Event Hubs.
- Data Fundamentals: Deep understanding of Data Warehousing concepts, reporting, and analytical concepts.
- Programming: Proficient in technologies such as Azure Data Factory, Azure Databricks, SQL, and Python.
- Data Pipelines: Experience building data pipelines and infrastructure.
- Leadership & Collaboration: Excellent communication, collaboration, and leadership skills.
- Work Ethic: Ability to work under pressure, prioritize, and multitask.
- Attention to Detail: Strong attention to detail, quality, and accuracy.
- Good to have: Experience with Machine Learning and Big Data tech stack.