Lead Data Integration Engineer (SQL, Snowflake, Python)

Thedevelopment family is responsible for creating, designing, deploying, and supporting applications, programs, and software solutions. May include research, new development, prototyping, modification, reuse, re-engineering, maintenance, or any other activities related to software products used internally or externally on product platforms supported by the firm. The software development process requires in-depth subject matter expertise in existing and emerging development methodologies, tools, and programming languages. Software Developers work closely with business partners and / or external clients in defining requirements and implementing solutions.

Lead data integrationengineer role specializes in planning, detailing technical requirements, designing, developing, and testing all software systems and applications for the firm. Works closely with architects, product managers, project management, and end-users in the development and improvement of existing software systems and applications, proposing and recommending solutions that tackle complex business problems.

Qualifications:

Looking for a strong Database developer with hands-on experience in developing large scale Data engineering pipelines for financial services and preferably for risk management.

Minimum 6 years of Hands-on experience in writing, tuning, and managing complex SQL, creating stored procedures and database objects for a large-scale data warehouse systems in Snowflake

Minimum 6 years of related experience in building and maintaining large scale Data warehouse applications in cloud.

Minimum 3 years of experience in python as a developer, developing complex data pipelines loading data into Snowflake Database.

Must have knowledge in Dimensional modelling techniques like Star schema, type 2 slowly changing dimension and various type of fact tables.

Hands on experience in shell scripts for handling script-based ELT pipelines using Python or Snowpark.

Hands on experience in creating and managing Autosys JILs for orchestration or Airflow.

Knowledge in ETL tools like Talend or similar tools and create heterogenous pipelines.

Strong hands-on experience code versioning in bitbucket, GIT, Liquibase and managing multiple versions of release and CICD pipelines.

Good understanding of Enterprise Data integration concepts, Data warehouse modelling and Data architecture patterns.

Worked on Agile projects and knowledge of Jira for tracking and updating project tasks.

The IT SIFMU Delivery Department supports core Clearing and Settlement application delivery for DTC, NSCC and FICC. The department also develops and supports Asset Services, Wealth Management & Insurance Services and Master Reference Data applications.