Data Engineering and ETL Specialist

We are looking for a skilled Data Engineering and ETL Specialist with 3-4 years of hands-on experience building and managing robust data pipelines and transformation workflows. The ideal candidate will have strong proficiency in Snowflake, Matillion, SQL, and Python/PySpark, with a proven track record of delivering scalable, production-grade ETL solutions that drive business intelligence and analytics outcomes.

The Core Responsibilities For The Job Include The Following

ETL / ELT Pipeline Development:

• Design, develop, and maintain scalable ETL/ELT pipelines using Matillion and Snowflake.
• Build incremental and full-load data ingestion pipelines from diverse source systems (databases, APIs, flat files).
• Implement Slowly Changing Dimension (SCD) strategies and data merge patterns for accurate historical tracking.
• Optimize Matillion jobs for performance, reusability, and maintainability.
  
  

Snowflake Data Warehousing

• Develop and manage Snowflake objects: databases, schemas, tables, views, streams, tasks, and pipes.
• Tune query performance using clustering keys, materialized views, and warehouse sizing strategies.
• Implement Snowpipe for real-time or near-real-time data ingestion requirements.
• Manage Snowflake data sharing, role-based access controls, and governance policies.
  
  

Data Transformation And Modeling

• Write complex SQL transformations, stored procedures, and UDFs to support business logic.
• Develop data models following star/snowflake schema and dimensional modeling best practices.
• Build and maintain Python/PySpark scripts for large-scale data processing and automation.
• Collabrate with data analysts and BI teams to ensure data models meet reporting requirements.
  
  

Data Quality And Governance

• Implement data quality checks, validation frameworks, and automated reconciliation processes.
• Maintain data lineage documentation and pipeline metadata for governance and auditability.
• Proactively monitor pipelines, set up alerting, and resolve failures or data anomalies.
  
  

Collaboration And Delivery

• Work closely with data architects, analysts, and business stakeholders to understand data requirements.
• Write clean, modular, reusable, and well-documented code across SQL, Python, and Matillion.
• Participate in code reviews and contribute to team best practices and documentation.
• Provide regular updates on project status and proactively flag risks or blockers.
  
  

Requirements

• Education: Graduates only (please ignore pursuers/dropouts/12th or 10th pass).
• 3-4 years of experience in data engineering or ETL development roles.
• Demonstrated experience delivering production-grade data pipelines using Snowflake and Matillion.
• Strong communication skills, written and verbal; ability to translate technical concepts for business audiences.
• Meticulous attention to detail, especially around data accuracy and pipeline reliability.
• Ability to work independently and collaborate effectively with cross-functional teams.
  
  

Good To Have Skills

• Cloud platforms: Azure Data Factory, Azure Synapse Analytics, or AWS Glue; Apache Airflow or similar orchestration tools (Prefect, Dagster); dbt (Data Build Tool) for transformation layer management Delta Lake / Lakehouse architecture exposure Experience with BI tools: Power BI, Tableau, or
• Looker Version control: Git branching strategies and CI/CD for data pipelines Certifications: Snowflake SnowPro Core, Matillion Associate, or equivalent.
  
  

Technical Expertise Area Technologies / Skills

• Data Warehouse Snowflake warehousing, Snowpipe, clustering, data sharing, streams, and tasks ETL/ELT Tool Matillion pipeline design, orchestration, scheduling, and transformation components.
• Query and Transformation SQL, Advanced SQL, Stored Procedures, Window Functions, Query Optimization, Programming Python, PySpark data processing, automation, distributed transformation Data Modelling Star Schema, Snowflake Schema, Dimensional Modelling, SCD Handling.
• Good to Have: Azure Data Factory, AWS Glue, dbt, Apache Airflow, Delta Lake, Power BI Other.
  
  

Mandatory Skills

• Snowflake data warehousing, performance tuning, clustering, data sharing, and Snowpipe Matillion ETL/ELT pipeline design, orchestration, job scheduling, and transformation components SQL / Advanced SQL complex queries, stored procedures, window functions, query optimization, Python / PySpark data processing, automation scripts, and distributed data transformation (ETL/ELT).
• Design end-to-end pipeline architecture, incremental loads, SCD handling Data Modelling star/snowflake schema, dimensional modeling, and data vault concepts Pipeline Orchestration scheduling, dependency management, error handling, and alerting Data Quality implementing validation checks, reconciliation, and data lineage tracking).
  
  

This job was posted by Akshay Patil from Netscribes.