Data Engineer

Key Responsibilities

• Design and implement scalable data lake solutions for handling customer and market data
• Build, improve, and optimize pipelines for ingesting and enriching financial data
• Analyze and map source data fields to enhance platform functionality
• Gather and document system enhancement requirements with business and core systems teams
• Troubleshoot and resolve data pipeline issues in collaboration with the production team
• Ensure data accuracy, scalability, and throughput of high-volume financial data processes
• Work with RDBMS systems and leverage AWS services for data storage, processing, and computation
• Optionally use data virtualization tools like Dremio and Starburst to support analytics
• Utilize project management and CI/CD tools such as JIRA and Jenkins