Project Description:
- Our Client is a leading global financial markets infrastructure and data provider. Their purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.
Team is responsible for managing a secure, scalable, and highly available cloud platform built on AWS, Azure, and Snowflake. Our mission is to deliver a strategic Common Data and Reporting solution for clients, members, and regulators by consolidating multiple data sources into a centralized reporting data store
- .
This role offers the opportunity to work on cutting-edge cloud technologies and contribute to building a platform that transforms how data is leveraged across the busines
s.
Responsibiliti
- es:•Design, build, and optimize scalable data pipelines using Python, SQL, DBT, and Apache Airf
- lowDevelop and manage DBT models and ensure reliable workflow orchestration in Airf
- lowMonitor and maintain Snowflake platform performance, availability, and cost efficie
- ncyTroubleshoot and resolve issues across data ingestion, transformation, and pipeli
- nesImplement and maintain end-to-end data quality testing and validation framewo
- rksAutomate deployments and workflows using GitLab CI/CD and support release proces
- sesProvide support to users and collaborate with teams on Snowflake, Airflow, and data soluti
- onsDocument architecture and best practices while contributing to technical design, mentoring, and continuous improvem
ent
Mandatory Skills Descript
- ion:7+ years of proven experience as a Senior Data Engi
- neerHands-on experience with Snowflake (preferred) or Databricks/Or
- acleSolid experience with DBT (data modeling and transformat
- ion)Experience with cloud platforms – AWS (preferred) or A
- zureStrong SQL - advanced query writing and optimization sk
- illsStrong Python - experience in data processing and automa
- tionBasic CI/CD knowledge (GitLab or similar) - understanding of deployment pipel
- inesApache Airflow - workflow orchestra
- tionData Build Tool - data transformation and mode
ling
Nice-to-Have Skills Descrip
- tion:Terraform - infrastructure as
- codeKafka - event streaming and mess
aging
