Senior Data Engineer

Virtusa

Chennai

8-15 Years

Save

Posted 3 days ago
Be among the first 50 applicants

Early Applicant

Quick Apply

Job Description

Job Title: Senior Data Engineer

Experience Level

8+ years overall IT experience (minimum 5 years in specified tech skills)

Position Summary

The Senior Data Engineer will lead complex data engineering projects, focusing on designing robust data architectures, optimizing data workflows, managing data pipelines, and ensuring the seamless operation of data systems that align with business requirements. This role provides technical leadership for data solutions, particularly within healthcare data systems.

Key Responsibilities

As a Senior Data Engineer, you will:

Data Architecture & Pipeline Leadership: Lead the design, construction, and testing of data architectures and the development of data pipelines capable of handling large-scale datasets, ensuring alignment with business requirements.
Data Transformation: Work with DBT (Data Build Tool) for transforming raw data into actionable insights.
Technical Leadership: Provide technical leadership for data projects, ensuring best practices and high-quality data solutions.
Data Quality & Optimization: Ensure data quality and optimize data lakes in Iceberg format, with a strong understanding of their architecture.
Collaboration: Collaborate with product, finance, and other business units to ensure data pipelines meet their requirements.
Advanced Analytics Enablement: Oversee the development of data solutions that enable predictive and prescriptive analytics.
Technical Quality Assurance: Ensure the technical quality of solutions by managing data as it moves across environments.
Architecture Alignment: Align data architecture to Healthfirst solution architecture.
Incident Management & Reliability: Work with automation teams to design, code, test, and deliver software to automate repetitive and manual operational work. Troubleshoot priority incidents and engage in postmortems to ensure permanent closure.

Mandatory Skills & Experience

Technical Proficiency:

Python & PySpark: Strong experience in Python Scripting and PySpark for data processing.
SQL & ETL: Proficiency in SQL dealing with big data, including experience with Informatica ETL.
Data Lake & Optimization: Proven experience in Data Quality and data optimization of data lakes in Iceberg format, with a strong understanding of architecture.
AWS Cloud: Expertise in AWS cloud platform and its data services: S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, EventBridge.
AWS Glue: Experience in AWS Glue jobs.
Shell Scripting: Expertise in BASH Shell scripting.
Data Tools: Experience with DBT (Data Build Tool).

Experience & Qualifications:

8+ years of overall IT experience, with a minimum of 5 years of work experience in the specified technical skills.
Strong understanding of healthcare data systems.
Experience leading data engineering teams.
Experience in Agile environments.

Essential Professional Skills

Excellent problem-solving skills and attention to detail.
Effective communication and collaboration skills.

More Info

Job Type:

Permanent Job

Industry:

Information Technology

Role:

Software Engineer /Programmer

Function:

Employment Type:

Full time

Open to candidates from:

Indian

About Company

Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa is an Equal Opportunity Employer. All applicants will receive fair and impartial treatment without regard to race, color, religion, sex, national origin, ancestry, age, legally protected physical or mental disability, protected veteran status, status in the U.S. uniformed services, sexual orientation, gender identity or expression, marital status, genetic information or on any other basis which is protected under applicable federal, state or local law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government-issued ID during each interview. All candidates must be authorized to work in the USA.

Job ID: 118072795

Jobs by Skill - IT