Data Engineer

The Edge Partnership

Porur, Chennai

8-10 Years

Save

Posted 4 hours ago
Be among the first 10 applicants

Early Applicant

Job Description

Our client is a leading global financial services firm providing a wide range of investment banking, securities, investment management and wealth management services. The Data Engineer is a role focusing on responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, machine learning, and business intelligence initiatives. This role is ideal for someone who thrives in a fast-paced environment and is passionate about transforming raw data into actionable insights.

Please contact Radhika or email your cv directly in word format with job reference number: JOB 15960 to

Please note that due to the high number of applications only shortlisted candidates will be contacted. If you do not hear from us in the next 5 business days, we regret to inform you that your application for this position was unsuccessful.

[Confidential Information]

Key responsibilities

Work on Azure data platform to deliver scalable data solutions.
Design, develop, and maintain robust data pipelines using modern data engineering tools and frameworks.
Collaborate with the team to develop scalable frameworks that streamline data loading processes and support business operations.
Collaborate with business stakeholders to build and optimize data architecture (e.g. data marts, data lakes, data warehouses).
Support the ingestion and preparation of diverse data types - structured and unstructured, batch and real-time - into the Azure Data Lake, ensuring they are cleaned and aggregated to meet business requirements.
Collaborate with data scientists, analysts, and software engineers to deliver high-quality data solutions.
Ensure data quality, integrity, and security across all data platforms.
Ensure reliable and timely data delivery by orchestrating scheduled workflows.
Monitor and troubleshoot data workflows and infrastructure performance.
Implement best practices for data governance, versioning, and documentation.
Ensure visibility and traceability of enterprise data assets by managing data catalogues and lineage through Microsoft Purview / Collibra.

Role requirements

Bachelor's or master's degree in computer science, Engineering, or a related field.
8+ years of experience in data engineering or a similar role.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration abilities.
Experience with Azure data platforms (e.g., Databricks, Azure Synapse).
Familiarity with data modelling, warehousing concepts, and distributed systems.
Experience with real-time data processing (e.g. Azure Event Hub, Kafka).
Knowledge of data management tools (e.g. MS Purview, Collibra).
Proficiency in Python, SQL, and data pipeline frameworks.