Job Description
Job Summary
We are seeking a skilled Data Engineer with 7-12 years of experience to design, build, and maintain robust data pipelines and analytics solutions. The ideal candidate will have hands-on expertise in Snowflake, DBT, SQL, and be well-versed in modern data engineering practices including GitHub, CI/CD, and Agile methodologies.
Key Responsibilities
· Develop and maintain scalable data pipelines using Snowflake and DBT.
· Design and implement ETL/ELT processes for structured and semi-structured data.
· Collaborate with data analysts, scientists, and business stakeholders to understand data needs.
· Ensure data quality, integrity, and security across all data assets.
· Participate in Agile ceremonies and contribute to sprint planning and retrospectives.
· Use GitHub for version control, code reviews, and CI/CD deployments.
· Document data workflows, architecture, and business logic clearly.
Must-Have Skills
Snowflake
· Develop and manage Snowflake objects: tables, views, functions, stored procedures, stages, and file formats.
· Implement advanced features: CDC, Streams, Snowpipe, Time Travel, and Cloning.
· Write dynamic SQL and utilize Python/JavaScript within Snowflake for data processing.
· Work with semi-structured data (JSON/XML), APIs, and tools like Postman for integration and validation.
· Build Dynamic Tables, Materialized Views, and Tasks for scalable workflows.
· Strong experience in performance tuning, access control, and data governance.
DBT (Data Build Tool)
· Build modular SQL models across staging, intermediate, and mart layers.
· Hands-on with incremental models, DBT tests, and Jinja templating/macros.
· Exposure to DBT documentation, lineage graphs, and environment configuration.
· Integrate DBT with GitHub and deploy via CI/CD pipelines.
Python
· Scripting for data transformation, automation, and API integrations.
· Familiarity with libraries like Pandas, NumPy, and SQLAlchemy.
Nice-to-Have Skills
· SnapLogic Experience in building and managing integrations using SnapLogic pipelines.
· Power BI Ability to create dashboards and visualizations for business insights.
