Data Engineer

Job Overview:

We are seeking an experienced Snowflake Developer with a minimum of 5 years of hands-on experience in Snowflake development, integration, migration, and deployment. The ideal candidate will be responsible for designing, implementing, and optimizing Snowflake solutions, ensuring efficient data architecture, and supporting our data-driven decision-making processes.

Key Responsibilities:

Snowflake Development:

o Design, develop, and optimize complex data models, tables, views, and stored procedures within the Snowflake environment.

o Implement data ingestion, transformation, and loading processes using Snowflake features such as Snowpipe, streams, and tasks.

o Develop and maintain Snowflake scripts and SQL-based ETL/ELT processes.

Data Integration & Migration:

o Lead and execute data migration projects, including the transition from legacy databases or data warehouses to Snowflake.

o Integrate Snowflake with various data sources and third-party tools, ensuring seamless data flow and connectivity.

o Collaborate with cross-functional teams to ensure data consistency, quality, and accuracy across systems.

Performance Optimization:

o Monitor and optimize Snowflake performance, including query tuning, workload management, and resource optimization.

o Implement and manage data partitioning, clustering, and indexing strategies to improve performance and scalability.

o Regularly review and refine Snowflake security models, including access controls and encryption.

Deployment & Maintenance:

o Develop and manage CI/CD pipelines for Snowflake deployments, ensuring smooth and automated release processes.

o Perform regular maintenance, upgrades, and troubleshooting within the Snowflake environment. o Ensure data compliance with organizational policies and industry regulations, including GDPR, HIPAA, etc.

Collaboration & Documentation:

o Work closely with data architects, analysts, and other stakeholders to translate business requirements into technical solutions.

o Create and maintain detailed documentation of Snowflake environments, data flows, and ETL/ELT processes.

o Provide mentorship and guidance to junior developers and team members.

Required Skills & Qualifications:

Technical Expertise:

o Minimum of 5 years of hands-on experience with Snowflake development, including data modeling, ETL/ELT, and SQL scripting.

o Strong experience in data integration, migration, and deployment within the Snowflake environment. o Proficiency in SQL, Python, or other relevant programming languages.

o Experience with data warehousing concepts, including star schema, snowflake schema, and OLAP.

o Familiarity with Snowflake's features such as Snowpipe, Time Travel, Streams, and Tasks.

Tools & Technologies:

o Experience with cloud platforms such as AWS, Azure, or Google Cloud, and their integration with Snowflake.

o Proficiency in data integration tools like Matillion, Talend, Informatica, or similar.

o Familiarity with CI/CD tools such as Jenkins, GitLab, or Azure DevOps.

Preferred Qualifications:

Certifications: Snowflake Certification or equivalent certifications in cloud data warehousing.

Experience: Experience with additional data platforms like Redshift, BigQuery, or similar.

Knowledge: Understanding of data governance, data security, and compliance.