We are looking for a Senior Data Engineer to design, build, and maintain data pipelines across our health plan technology platform, spanning AWS-native data services and existing SQL Server/SSIS ETL processes. This role sits alongside the other engineering teams in this application landscape (software engineering, Data/BI & Integration, DevOps, and Edifecs EDI), and carries dual responsibility: keeping current SQL Server/SSIS workloads reliable, and helping migrate and modernize them onto AWS-native pipelines.
Key Responsibilities
- Design, build, and maintain ETL/ELT pipelines using AWSGlue, Lambda, and Step Functions to ingest, transform, and load data acrossAWS-based data platforms (S3, Redshift, Athena)
- Maintain, enhance, and troubleshoot existing SQLServer-based ETL processes built in SSIS, including packages, control flows,data flows, and error handling
- Write and optimize complex T-SQL queries, storedprocedures, and views supporting reporting and downstream applications
- Support ongoing migration and modernization of legacySQL Server/SSIS ETL workloads to AWS-native data pipelines
- Design and maintain data models (dimensional/starschema) supporting analytics and reporting use cases
- Use AWS Database Migration Service (DMS) and relatedtools to support data migration from on-premises SQL Server to AWS
- Implement data quality checks, validation, andmonitoring across ETL pipelines
- Optimize pipeline performance, reliability, and costacross both AWS-native and SQL Server/SSIS workloads
- Partner with BI, integration, and application teams(including the Power BI and Edifecs/EDI teams within this applicationlandscape) to ensure data availability and consistency across systems
- Document data flows, pipeline architecture, and datamodels to support internal knowledge sharing
- Troubleshoot and resolve production data pipelineissues, including root-cause analysis
- Mentor junior engineers on data engineering and ETL/ELTbest practices
Required Qualifications
- Bachelor's degree in Computer Science, Engineering,Information Systems, or a related field
- 8–12 years of experience in data engineering or ETLdevelopment
- Strong, hands-on experience with AWS data services: S3,Redshift, Glue, Athena, Lambda, and Step Functions
- Strong, hands-on experience with SQL Server, includingT-SQL development, query optimization, and performance tuning
- Strong, hands-on experience building and maintainingETL packages in SSIS (control flow, data flow, error handling, and deployment)
- Working proficiency in Python for scripting,automation, and Glue/PySpark-based ETL development
- Solid understanding of dimensional data modeling (starschema) for analytics and reporting use cases
- Experience with data migration tools and approaches(e.g., AWS DMS) for moving workloads from on-premises SQL Server to AWS
- Strong understanding of data quality, governance, andlineage practices
- Strong debugging, performance-tuning, andproduction-support skills across ETL pipelines
- Excellent written and verbal communication skills forcross-functional collaboration
AI Knowledge & AI-Assisted Development (Required)
- Daily, practical use of AI coding/assistant tools(e.g., Claude Code, GitHub Copilot, Cursor, or similar) to acceleratedevelopment of Glue/PySpark scripts, SSIS package logic, and T-SQL queries
- Able to critically review and validate AI-generatedcode, queries, and transformations for correctness, performance, and dataintegrity before deployment
- Practical use of AI tools to assist with dataprofiling, anomaly detection, and technical documentation
- Understanding of secure and compliant AI tool usage,including never entering PHI, member data, or other sensitive information intoprompts or external AI tools
- Able to identify where AI-driven automation can improvepipeline development, testing, or migration efficiency, and champion adoptionwithin the team
Preferred Qualifications
- Experience in the US health insurance or payer domain:claims, eligibility, enrollment, provider, or member data, with HIPAA-awaredata handling practices
- Exposure to healthcare data standards (X12 EDI, HL7,FHIR)
- Experience with Power BI or other BI/reporting toolsconsuming the data pipelines you build
- Experience with additional AWS data services: EMR,Kinesis, or Redshift Spectrum
- Experience with modern orchestration tools (e.g.,Apache Airflow) as an alternative or complement to SSIS
- Relevant certifications: AWS Certified DataEngineer/Analytics Specialty, Microsoft SQL Server certifications
