Senior Data Engineer

Looking for a Data Engineering professional to work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. You will be building, optimizing, and maintaining large data pipelines and warehouse infrastructure in this role.

Key Responsibilities

• Minumum 5 years of experince in Data Engineering.
• Design, develop, and maintain robust data pipelines in Hadoop and related ecosystems, ensuring data reliability, scalability, and performance.
• Implement data ETL processes for batch and streaming analytics requirements.
• Optimize and troubleshoot distributed systems for ingestion, storage, and processing.
• Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs.
• Ensure data security, integrity, and compliance throughout the infrastructure.
• Maintain documentation and contribute to architecture reviews.
• Participate in incident response and operational excellence initiatives for the data warehouse.
• Continuously learn mindset and apply new Hadoop ecosystem tools and data technologies.

Required Skills

• Snowflake Architecture, Snowpipe, Streams & Tasks, Virtual Warehouses.
• SQL, Python, PySpark.
• ETL/ELT Development and CDC.
• dbt.
• Medallion Architecture.
• Dimensional Modeling and SCD Type 1 & Type 2.
• SAP HANA to Snowflake migration experience.
• AWS/Azure/GCP knowledge.
• Git, Azure DevOps, Jira, Confluence.
• Strong analytical and stakeholder management skills.

Preferred Qualifications

• Bachelor's degree in Computer Science, IT, Engineering, or related field.
• Enterprise-scale Snowflake implementation experience.
• SnowPro Core Certification.
• Cloud certifications (AWS/Azure/GCP).
• Agile/Scrum experience.

Nice to Have

• Snowpark
• AI/ML Data Engineering
• LLMs, Prompt Engineering, RAG
• DataOps / CI-CD Pipelines
• Experience with globally distributed teams