Search by job, company or skills

Hub Group

Data Engineer

Save
  • Posted 9 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Summary

We are seeking a motivated Staff Data Engineer to join our data engineering team. This role focuses on the development and maintenance of ETL/ELT data pipelines that support enterprise reporting and analytics.

The primary responsibility is to build, enhance, and maintain data integration processes while ensuring reliable data delivery. This is a hands-on development role with some exposure to production support, offering an opportunity to grow technical skills in a fast-paced data environment.

Key Responsibilities

Data Pipeline Development (Primary Focus)

  • Develop, test, and maintain ETL/ELT pipelines for batch data processing.
  • Build and enhance data integration workflows using existing ETL tools and frameworks.
  • Work with structured and semi-structured data sources (e.g., SQL Server, Oracle, MongoDB).
  • Write and optimize SQL queries to support data transformation and validation.
  • Perform unit testing and support QA validation for data pipelines.
  • Implement enhancements to improve performance, reliability, and maintainability of existing jobs.

Production Support & Operations

  • Monitor ETL jobs and assist in resolving basic production issues such as job failures and data discrepancies.
  • Support troubleshooting efforts and escalate complex issues to senior team members.
  • Assist with job scheduling updates and configuration changes as needed.
  • Participate in on-call or off-hours support rotation (as required)

Collaboration & Continuous Learning

  • Work closely with senior engineers and analysts to understand data requirements.
  • Follow established standards and best practices for development and deployment.
  • Document code changes, processes, and troubleshooting steps.
  • Continuously learn new tools, technologies, and data engineering practices.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • 2+ years of experience in ETL development, data engineering, or a similar role.
  • Experience with ETL tools such as Informatica, Talend, or SSIS.
  • Strong SQL skills working with relational databases (Oracle, SQL Server, MySQL).
  • Basic experience working with semi-structured data (e.g., MongoDB, JSON).
  • Familiarity with scripting languages (Python or Shell scripting).
  • Strong problem-solving and analytical skills.
  • Good communication skills and ability to work in a team environment.

Preferred Qualifications

  • Exposure to cloud data platforms (e.g., Snowflake).
  • Understanding of data warehousing concepts (foundational level).
  • Experience with job scheduling or monitoring tools.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151078457

Similar Jobs

Hyderabad, India

Skills:

snowflake PysparkApache SparkInformaticaSqlAzure SynapseAzure Data FactoryGcpDatabricksAzureTalendAWSBig QueryMLlibEvent HubCI CD pipelines

Hyderabad, India

Skills:

S3PysparkPostgreSQLDeduplicationLambdaTerraformPythonAWSScalaDynamodbEmrSparkAdvanced SqlMedallion ArchitectureIncremental historical processingIdempotencyAuroraAWS data servicesAWS SagemakerStep Functionslate-arriving data handlingCDC Merge processingLakehouseGlueresilient pipeline patternsType 2 Dimensions

Hyderabad, India

Skills:

PysparkDatabricksData ModelingGitlabPythonSqlAirflowReltio MDM platformMatch Merge and survivorship rulesCrosswalks reference data

Hyderabad, India

Skills:

amazon emr Aws LambdaAmazon RedshiftAmazon S3Amazon KinesisAWS GlueAWS AthenaJsonSqlRedshift Spectrum

Hyderabad, India

Skills:

T-sqlPower BiPostgreSQLSQL ServerMySQLDaxAWSFabric PipelinescdcAWS DMSDebeziumReal-Time IntelligenceDataflows Gen2XMLA endpoint toolingTabular EditorDimensional modellingDelta LakeMicrosoft FabricALM ToolkitMedallion architecture