Responsibilities
About the Opportunity
This is an outstanding opportunity to be at the forefront of technological innovation with Principal. As a Lead Data Engineer, you will Build end-to-end cloud-native data architectures using services such as AWS and Azure for analytics, BI, and advanced data workloads. You will mentor and lead engineering teams, ensuring detailed execution of projects and encouraging a culture of excellence.
What You'll Do
- Build, develop, and handle scalable, reliable data pipelines using modern orchestration tools.
- Implement and handle cloud data lakes, lakehouses, and warehouses (e.g., Delta Lake, Snowflake, Synapse).
- Build end-to-end cloud-native data solutions using services such as AWS and Azure for analytics, BI, and advanced data workloads.
- Define data engineering standards, patterns, and guidelines aligned with enterprise information and cloud computing strategy.
- Establish data validation, monitoring, observability, and SLAs to ensure accuracy, completeness, and availability of data.
- Provide technical guidance, code reviews, and mentoring to data engineers, encouraging a collaborative and inclusive environment.
- Make sure data security, encryption, access controls, PII protection, and compliance with regulatory standards.
- Work closely with data scientists, analysts, platform teams, and business collaborators to deliver magnificent solutions.
- Develop CI/CD pipelines, infrastructure as code (IaC), automated testing, and deployment for data and cloud platforms.
- Enable data discoverability and traceability through metadata management, lineage tracking, and data catalogs.
- Assess emerging cloud and data technologies, recommending tools that improve scalability, reliability, or efficiency.
- Lead identifying and fixing root causes, along with resolution of data pipeline or platform incidents.
- Chip in to long-term data platform roadmaps and provide technical feedback for business and architectural decisions.
Qualifications
Who You Are
- Proven 7+ years experience in learning and adapting to multiple data-related cloud services, programming languages, development & consumption tools, and architecture frameworks.
- Proficiency in cloud environments including AWS and Microsoft Azure.
- Strong experience building solutions using AWS services like DMS, Step Functions, Lambda, Glue, DynamoDB, and RDS on complex systems.
- Skilled in data visualization platforms such as Microsoft PowerBI.
- Strong expertise in writing queries and stored routines, especially within Microsoft SQL Server environments.
- Solid understanding of data warehousing and data mesh concepts.
- Hands-on experience in Snowflake.
- Proficiency in Python and PySpark programming.
- Preferably, knowledge in the asset management or pension domain.
Must have
- Experienced in building data visual representations using Microsoft PowerBI.
- In-depth knowledge of SQL and stored procedures, particularly with SQL Server databases.
- A bachelor's degree or equivalent experience in any stream.
- Strong problem-solving and analytical abilities.
- Strong documentation skills.
- Strong communication and interpersonal skills.
- Good time management skills.
- Positive attitude and interest in learning.
- An excellent teammate approach.
- Ability to quickly grasp new concepts and a stretch approach.
- Familiarity with MS Office, JIRA, and SharePoint.
- High competence with excellent problem-solving and analytical skills.
Additional Information
Why Choose Principal
At Principal, we believe in nurturing talent and providing a collaborative environment where you can thrive. We offer:
- Opportunities to work on brand new technologies and innovative projects.
- An encouraging and inclusive culture that values diversity.
- Continuous learning and development programs to help you achieve your career goals.
- Competitive compensation and benefits.
Join us and be part of a team that pursues outstanding quality and aims to provide world-class solutions. Your contributions will directly influence our success and help us remain leaders in the financial services industry. We are excited to see the outstanding work you will achieve with us!
