Big Data Administrator

Who we are

Crédit Agricole Corporate and Investment Banking (Crédit Agricole CIB) is the corporate and investment banking arm of Crédit Agricole Group, world's 10th largest bank by total assets.

Our Singapore center is the 2nd largest IT setup (after Paris Head Office) for Crédit Agricole CIB's worldwide business. We work daily with international branches located in 30 markets by:

• Envisioning and preparing the Bank's futures information systems
• Partnering and supporting core banking flagships and transverse areas in their large scale development projects
• Providing premium In-house Banking applications

This unique positioning empowers us to bring our core banking business a sustainable competitive advantage on the market.

We seek innovative and agile people sharing our mindset to support ambitious and forthcoming technological challenges.

Summary of Position

You will be a technical L2 resource for all Big Data services in CA-CIB. As such, you will provide support for all production support activities within the Big Data team in Singapore. You are accountable for the overall health and stability of the technical solutions within his scope. You have to effectively work with technical peers such as architects, peer experts and project teams on technology road maps and projects. You will work with L3/Service Manager to gain control over the scope of technical activities, develop best practices and gain knowledge over all aspects of support.

The Big Data team operates the RUN activities and delivers projects for its infrastructure scope covering all Big Data associated technologies.

Key Responsibilities

• Administer and maintain core Big Data platforms — including Hadoop (HDP/HDFS/YARN), Apache Kafka, Redis, MongoDB, and OpenSearch/Elasticsearch — ensuring high availability, performance, and fault tolerance

• Perform cluster lifecycle management: provisioning, scaling, patching, decommissioning, and capacity planning aligned with transaction growth and peak volumes

• Monitor, troubleshoot, and resolve complex or high-severity incidents across Big Data services; drive root cause analysis and implement preventive measures

• Manage data security and access governance: implement Kerberos authentication, user provisioning (Linux + Hadoop stack), and least-privilege access controls in compliance with banking regulations

• Support and optimize streaming and ingestion pipelines via Apache Kafka, Apache NiFi, and AWS EMR for real-time and batch payment processing workloads

• Develop and maintain runbooks, SOPs, and technical documentation; define and enforce best practices for cluster operations and data pipelines

• Engage with architects, development teams, and project managers on technology roadmaps; assess new technologies for operational adoption and risk

• Coach and develop partner resources; contribute to knowledge sharing and continuous improvement initiatives across the team

Requirements

Must-Have:

• Degree in Computer Science, Information Technology, or a related field

• 6–8 years of experience in Big Data or Data Platform Engineering in enterprise environments

• Hands-on administration experience with Hadoop ecosystem (HDFS, YARN, MapReduce, HDP), Apache Kafka, Redis clusters, and MongoDB clusters

• Proficiency in administering OpenSearch/Elasticsearch clusters, including indexing optimization and query performance tuning

• Strong Linux system administration skills and scripting proficiency (Shell and/or Python)

• Experience with data security frameworks including Kerberos authentication and access governance

• Proven experience supporting high-volume, low-latency production systems, preferably in payments or financial services

Good-to-Have:

• AWS cloud certification

• Knowledge of access control mechanisms such as PAM, and familiarity with JVM tuning

• Proficiency in Python, Java, or Scala; experience with SQL-on-Hadoop tools (e.g., Hive) or ETL processes