JD for CIS Team Azure Data Engineer. (GG10)
Data Engineer
Role Overview
This role involves designing, developing, and maintaining cloud-native data solutions while working in an Agile environment.
Key Responsibilities
- Modern Data Platform Development:
- Build data lake components on cloud-based platforms.
- Design and develop data marts for business analysts and data scientists.
- Data Engineering & Pipelines:
- Design data pipelines to integrate structured, semi-structured, and unstructured data from multiple sources.
- Implement ETL/ELT processes to transform and cleanse data.
- Ensure data quality and transformation rules align with enterprise standards.
- Work with Medallion architecture and implement best practices for data modeling.
- Agile & DevOps Practices:
- Deliver solutions using Agile methodologies in a CI/CD-driven environment.
- Work on containerized solutions (Azure Kubernetes) and scheduling tools like Azure Scheduler.
- Follow secure coding practices and authentication/authorization protocols.
Candidate Qualifications
- Education: Bachelor's degree in Computer Science or equivalent.
- Experience:
- 4 - 8 years of experience in data engineering or data application development (ETL/ELT/BI).
- 2+ years of experience in cloud-based data platform development.
- Expertise in building Azure-based data pipelines, including:
- Azure Data Factory / Synapse
- DataBricks / Synapse Spark Pool
- Cosmos DB
- Azure Data Lake Storage (ADLS)
- Dedicated SQL Pool / Azure SQL
- Azure Logic Apps
- Hands-on experience with data transformation & cleansing using Spark, Python, R, SQL.
- Strong understanding of CI/CD, test-driven development, and domain-driven design.
Skills & Competencies
- Technical Expertise:
- Proficiency in Python, SQL, Spark, Azure Data Factory, and ETL processes.
- Experience in secure coding, authentication, and monitoring tools like Veracode, MS Entra, PingOne.
- Working knowledge of Azure Kubernetes, Azure DevOps, SonarQube, and Azure AppInsights.
- Soft Skills:
- Strong communication and collaboration in global, multi-cultural environments (Japanese experience is a plus).
- Able to work in a high-paced, diverse environment with a can-do attitude.
- Language:
- Business proficiency in English; Japanese language is a plus.
This is a great opportunity to be part of MetLife's technology transformation journey.
