Senior Data Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role: Senior Data Engineer - Snowflake

Experience Level: 4+ Years

Work location: Mumbai, Bangalore & Trivandrum

Notice Period: 0- 15 days

Role & Responsibilities:

• Design, develop, and optimize data loading techniques, virtual warehouses, and performance tuning within Snowflake.

• Build complex SQL logics, stored procedures, and User-Defined Functions (UDFs) in Snowflake.

• Implement and manage Snowflake data sharing and security features.

• Design, develop, and orchestrate complex data pipelines using Azure Data Factory (ADF).

• Work proficiently with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database.

• Integrate Azure Key Vaults for secure credential management within data solutions.

• Perform advanced SQL querying, optimization, and data manipulation across various relational database systems.

• Implement and manage CI/CD pipelines for data solutions, preferably using Azure DevOps, including version control (Git) and branching strategies.

• Develop automated testing for data pipelines and data quality.

• Apply solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.

• Utilize strong programming skills in Python , Pyspark for data processing, scripting, and automation.

• Solve complex analytical and data-related problems with meticulous attention to detail.

• Lead the development of data pipelines and orchestration using Azure Data Factory (ADF) for data ingestion, cleansing, and transformation.

• Lead, mentor, and conduct code reviews for Junior Data Engineers. Assist in development and developing automated testing for data pipelines and data quality.

• Knowledge on financial processes such as budgeting, forecasting, financial reporting, accounts payable/receivable, sage intact general ledger, and treasury operations, and relevant financial regulations.

Skills expectation:

• Snowflake Expertise: Deep expertise in Snowflake, data loading techniques, virtual warehouses, and performance tuning. Strong experience with Snowflake SQL / building complex logics, stored procedures, and UDFs. Experience with Snowflake data sharing and security features.

• Azure Data Services (Expert): Azure Data Factory (ADF)- Extensive experience designing, developing, and orchestrating complex data pipelines. Azure Data Storage- Proficient with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database. Azure Key Vaults- Hands-on experience integrating Key Vaults for secure credential management.

• SQL (Expert): Advanced SQL querying, optimization, and data manipulation skills. Experience with various relational database systems.

• CI/CD (Advanced): Proven experience implementing and managing CI/CD pipelines for data solutions, preferably using Azure DevOps. Understanding of version control (Git) and branching strategies. Experience with automated testing for data pipelines and data quality.

• Data Modeling: Solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.

• Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail.

• Python: Strong programming skills in Python for data processing, scripting, and automation. Experience with relevant libraries.

• Domain Knowledge: Finance / Good to have Sage Intact GL knowledge.