While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer - Snowflake
Experience Level: 4+ Years
Work location: Mumbai, Bangalore & Trivandrum
Notice Period: Looking for 0-15 days joiners
Role & Responsibilities
- Snowflake Development: Design, develop, and optimize data structures within Snowflake on Azure, utilizing Snowpipe, Snowpark, Stored Procedures, UDFs, and Streams & Tasks.
- Pipeline Orchestration: Build and manage complex ETL/ELT data pipelines using Azure Data Factory (ADF), incorporating robust error handling, alerting, and CDC methods.
- Data Platform Management: Work proficiently within the Azure data ecosystem, utilizing Azure Data Lake Storage (ADLS) and integrating Azure Key Vault for secure credential management.
- Advanced Querying: Develop complex SQL logic and perform query optimization and data manipulation across data warehouse and staging environments.
- Data Security & Governance: Implement Snowflake security configurations, including Role-Based Access Control (RBAC) and Data-Masking features.
- DevOps & Integration: Manage CI/CD pipelines using Azure DevOps (Git and branching strategies) and integrate data streams via SFTP and REST APIs.
- Quality Assurance: Assist in developing automated testing frameworks for data pipeline validation and data quality monitoring.
- Data Modeling: Apply dimensional modeling concepts (Star and Snowflake schemas) to build efficient data structures for financial reporting.
- Financial Alignment & Collaboration: Support the integration of financial data from platforms like Sage Intacct GL, SkyGen, and ClearWater; collaborate with stakeholders to gather technical requirements.
- Team Mentorship: Lead, mentor, and conduct code reviews for Junior Data Engineers to ensure alignment with engineering standards.
Skills Expectation
- Snowflake Expertise (Advanced): Strong hands-on experience with Snowflake on Azure, including performance tuning, virtual warehouses, data loading, RBAC, Data-Masking, and Snowpark.
- Azure Data Services: Extensive experience with Azure Data Factory (ADF) for complex pipeline orchestration, alongside proficiency in ADLS and Azure Key Vault.
- SQL & Programming: Expert-level SQL skills for data manipulation and query optimization, combined with intermediate Python skills for scripting and data processing.
- Data Warehousing & Modeling: Solid understanding of core data warehousing concepts, ETL/ELT patterns, and dimensional modeling.
- DevOps & Testing: Experience implementing CI/CD pipelines using Azure DevOps, version control (Git), and automated pipeline testing.
- Domain Awareness: Good to have knowledge of financial processes and familiarity with data structures from Sage Intacct GL, SkyGen, or ClearWater.
- Collaborative Execution: Strong problem-solving skills with the ability to translate business needs into technical pipelines and guide junior team members.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
