Staff Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Staff Data Engineer

Location: Bangalore-Manyata Tech Park

Business & Team: Technology Delivery

Impact &contribution: Here, you'll thrive. You'll be supported when faced with challenges and empowered to tackle new opportunities. We're hiring engineers from across India and have opened technology hubs in Bangalore. We really love working here, and we think you will too.

Roles & responsibilities:

• Defines technical strategy for key business areas, contributing to roadmaps.
• Identifies disruptive technologies and drives adoption where beneficial.
• Works on solutions and shapes the technical direction of a crew or several teams in their BU.
• Leads implementation of complex initiatives with impact across several teams.
• Designs and shares resilient solutions with high fault tolerance and graceful degradation.
• Identify and drive differentiating outcomes around toil reduction, efficiency and new capability.
• Influences crew leadership on technical matters.
• Drives cross-functional technical alignment across multiple business units.
• Builds a culture of trust where team members feel confident to share their ideas and concerns.

Essential Skills:

• 10-15 years of experience as a Data Engineering professional in a data-intensive environment.
• Expertise in Spark framework.
• Expertise in Apache Airflow.
• The individual should have strong analytical and reasoning skills in the relevant area.
• Proficiency in AWS cloud services, specifically EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DMS, Event Bridge, DynamoDB, IAM, Secret Manager, KMS, Step functions, SQS, SNS,
• Experience in Cloud Foundation (CFN), Cloud Development Kit (CDK) and Software Development Kit (SDK).Exposure to MSK, Flink, Iceberg [good to have]
• Cloud Watcher, User Notification, Appflow, Fargate, ECS, EKS, Airflow, Boto3, RDS, Sagemaker, IAM, , Cookie Cutter.
• Excellent skills in Python-based framework development are mandatory.
• Proficiency in SQL for efficient querying, managing databases, handling complex queries, and optimizing query performance.

Education Qualification:

• Bachelor's degree or master's degree in engineering in Computer Science/Information Technology