Participates in
ETL Design of new or changing spark sql and pyspark code, data bricks & python with the team and prepares technical specifications.
- Designs and builds integrations supporting FCRM ETL application.
- Performs source system analysis as required.
- Implements best practices and tunes Azure SQL code for optimization.
- Develop and maintain complex ETL jobs and frameworks using the Bank's standard tools
- Provide support to the development and testing teams to resolve data issues, including escalation support on complex issues
- ADF orchestration
- Production support experienced is plus .
- Strong programming skills in Python and SQL Hands-on experience with: Azure Databricks (Unity Catalog preferred)Apache Spark / PySpark Azure Data
- Orchestrate workflows using Azure Databricks Jobs / Azure Data Factory
- Work with structured and semi-structured data formats such as JSON, CSV, Parquet, Delta tables Skills: sql,etl,python,spark,azure
