'Job Description Python Developer Data engineer is expected to work in investment banking / fund management domain with excellent coding and debugging skills in python, deep understanding of algorithms in data ingestion, transformation and storage mechanism
Years of experience: 7+ years (Senior)
Responsibilities: o Real-time data streaming and data analysis o Build data-driven models. Create bespoke data models and algorithms. Work on relational and non-relational data storages o Design, develop, test, and document the data collection framework o Implementing data pipeline infrastructure for data ingestion. Transform and aggregate data, automated jobs and maintain them o Identify data integrity issues while implementing and maintaining database structures o Identify and leverage 3rd party off the shelf tools and libraries. Developing python based tools & utilities in-house to improve efficiency o Work in collaboration with IT engineering and business teams
Qualifications: o Bachelor's degree in Computer Science or Engineering o 3+ years of experience in data engineering using python, experienced in performing ETL and/or data pipeline implementations o Expertise in data Lake technologies, data storage formats and query engines o Exceptional in Pandas, NumPy and dataframes, and work experience in Spark, AWS Glue, AWS Redshift is a definite plus o Experienced in financial domain. BFSI domain / investment banking knowledge is a definite plus o Experienced In AWS CDK or CloudFormation
Bachelor Of Computer Application (B.C.A), Bachelor of Commerce (B.Com), Bachelor Of Technology (B.Tech/B.E), Bachelor of Science (B.Sc), Master OF Business Administration (M.B.A), Master in Computer Application (M.C.A), Master of Commerce (M.Com), Masters in Technology (M.Tech/M.E)
