Project Description:
Our client is an EU subsidiary of a Global Financial Bank working in multiple markets and asset classes.
DWH / ETL developer will work closely with the Development Lead to design, build interfaces and integrate data from a variety from internal and external data sources into the new Enterprise Data Warehouse environment. The ETL Developer will be responsible for developing ETL primarily utilizing Microsoft & Azure technologies within industry recognized ETL standards, architecture, and best practices.
Responsibilities:
- Act as a technical expert in the designing, coding, unit testing, supporting, and debugging of data warehouse software components in all aspects of SDLC
- Apply cloud and ETL engineering skills to solve problems and design approaches
- Troubleshoot and debug ETL pipelines and creating unit tests for ETL pipelines.
- Assess query performance and actively contribute to optimizing the code
- Write technical documentation and specifications
- Support internal audit by submitting required evidence
- Create reports and dashboards in the BI portal
- Work with Development Lead, DWH Architect and QA Engineers to plan, implement and deliver best ETL strategies
- Work with business analysts to understand requirements to create technical design specifications, gaining a sound understanding of business processes for related applications so that integration processes fulfill the end-user requirements
- Communicate effectively in a collaborative, complex and high performing team environment as per Agile principles
Mandatory Skills Description:
- Proven work experience as an ETL Developer
- SQL Server , SSIS and SSMS
- Advanced knowledge of relational databases and dimensional Data Warehouse modelling concepts
- Good understanding of physical and logical data modeling
- Very good understanding of modern SaaS / PaaS data solutions in a cost conscious approach
- Expert level of knowledge of Microsoft Data stack
- Experience in developing and deploying data oriented solutions in Cloud (Azure / Synapse Analytics / Fabric)
- Experience in designing and implementing data transformation and ETL layers using Data Factory, Notebooks
- Experience with PowerBI for report & dashboard creation. PowerQuery and/or DAX is an advantage.
- Experience in / understanding of Azure Data Lake Storage
- Knowledge / use of CI/CD tools and principles, preferably Azure DevOps or Bamboo
- Strong SQL knowledge, able to create complex SQL queries and good understanding of stored procedures, views, indexes, functions, etc.
- Good working knowledge of at least one scripting language. Python is an advantage.
- Experience with GIT repositories and working with branches. GitHub, Azure DevOps or Bitbucket experience are preferable.
- Ability to troubleshoot and solve complex technical problems
- Good understanding of software development best practices
- Working experience in Agile projects; preferably using JIRA
- Experience in working in high priority projects preferably greenfield project experience
- Able to communicate complex information clearly and concisely.
- Able to work independently and also to collaborate across the organization
- Highly developed problem-solving skills with minimal supervision
- Understanding of data governance and enterprise concepts preferably in banking environment
Nice-to-Have Skills Description:
- Microsoft Fabric
- Snowflake
- Azure DevTest Labs, ARM templates
- Azure PurView
- Banking / finance experience