Senior Data Engineer

Summary:

The role will serve the Data Strategy and Operations function within Company, establishing new data integration patterns into Data 360 from third-party vendors and managing ingestion from existing sources. The individual will own pipeline monitoring, KPI tracking, and egress management to multiple downstream destinations.

Responsibilities:

• Manage all new data ingestions for operational needs.
• Build new data integrations for all new data sources and providers, including third-party data providers.
• Manage new data egress patterns to send/share data outputs from Data 360 to multiple destinations.
• Ingest new data via existing ingestion pipelines.
• Monitor, maintain, and troubleshoot data pipelines.
• Track and report statistics including data volume, number of data streams, and other ingestion KPIs.

Requirements:

• Strong experience in data engineering, ETL, and data architecture.
• Experience working withdata models.
• Hands-on experience with Airflow and MuleSoft.
• Strong SQL skills with Snowflake and other relational databases.
• Experience writing complex Python modules for custom ETL workflows.
• Expertise in building batch and real-time data pipelines.
• Experience with dbt for data transformation and modeling.
• Familiarity with AWS/GCP and distributed/event-driven architectures.
• Strong understanding of data modeling, data warehousing, and big data processing.
• Experience with data quality, monitoring, and pipeline orchestration frameworks.
• Ability to work closely with Product, Data Science, and Analytics teams.

Required Skills:

• Ownership
• Clear Communication
• Sense of Urgency
• Proficiency in learning

#AditiConsulting
# 26-03263