Job Description
Project Description:
We are seeking a highly experienced Senior Data Engineer to design, develop, and optimize enterprise-scale data platforms using modern cloud technologies. The role involves building robust ELT pipelines, scalable data models, and analytics-ready datasets leveraging Snowflake, Azure Data Factory (ADF), DBT, Python, and SQL. The ideal candidate will play a key role in enabling data-driven decision making by delivering high-quality, governed, and performant data solutions.
Responsibilities:
Key Responsibilities
• Design and develop scalable ELT pipelines using Snowflake, ADF, DBT, and Python.
• Build and maintain enterprise data models including 3NF, Star Schema, and Snowflake Schema.
• Optimize Snowflake performance through query tuning, clustering, micro-partitioning, and warehouse management.
• Develop reusable and modular data transformation frameworks using DBT (Jinja, Macros, Testing, Documentation).
• Automate data ingestion, transformation, and operational processes using Python, Pandas, and PySpark.
• Implement workflow orchestration using tools such as Apache Airflow, Prefect, or Dagster.
• Establish data quality, governance, monitoring, and CI/CD best practices.
• Collaborate with Data Analysts, Data Scientists, Product Owners, and Business Stakeholders to deliver trusted data products.
• Create and maintain technical documentation, deployment procedures, and operational runbooks.
Mandatory Skills Description:
Mandatory Skills
• Snowflake Data Warehouse
• Azure Data Factory (ADF)
• DBT
• Python
• Advanced SQL
• Data Modeling (3NF, Star Schema, Snowflake Schema)
• Apache Airflow / Prefect / Dagster
• Cloud Platforms (Azure preferred)
• Git and CI/CD
• Data Quality and Governance Frameworks
• Agile/Scrum Methodology
More Info
Key Skills
Data Quality and Governance Frameworks
CI CD
Prefect
Azure Data Factory ADF
Data Modeling 3NF Star Schema Snowflake Schema
Snowflake Data Warehouse
Dagster
Cloud Platforms Azure
