Data Engineer, ZTD R&D

POSITION RESPONSIBILITIES

Business Analysis

• Autonomously perform Business Analysis as needed for data-based use cases, including open interaction with SMEs to answer questions and seek feedback, early analysis investigation spikes to analyze preliminary datasets, and phase-based design planning for implementation.

• Creates accurate entity mappings for data integrations and transformations, including business rules

• Creates entity relationship diagrams to document a variety of data development cases, including process flow, entity source to target, and database diagrams

• Define scope, approach, next steps, and direction with regard to assigned project objectives, and consult with technical lead for internal and business objective alignment

• Determine appropriate frequency and mode of needed data staging, from near-real-time streaming to daily wipe-reload

• Determine appropriate means of provisioning data, from direct file or analysis table consumption to visualization 15%

Data Analysis

• Analyze incoming data (from raw sets, database tables, APIs, and other sources) rapidly to understand its potential, needed manipulations, and issues.

• Perform data cleanup activities without direction

• Profile datasets, detecting anomalies, needed alignments, and patterns

• Proactively determine probable rules, and confirm unknown concepts with domain technical owner

• Understands AI tools and technologies; able to leverage pre-trained models for daily tasks.

• Provide L3/L4 support for production data issues including advanced query capabilities and ETL pattern knowledge/familiarity to troubleshoot datasets and ETLs, and direct contracted resources as needed to remediate issues. 25%

Data Development

• Design and develop data solutions from prototype to production, largely self-driven, with a particular focus on rapid ETL development, including integrations, data processing, and analyses, as well as limited data apps and visualizations

• Automate pipelines using scripting and ETL tools

• Manage and monitors pipeline execution

• Design and implement error handling capabilities

• Setup simple orchestration jobs

• Perform data migration analysis tasks, such as evaluation of current sets, mapping, and process flow diagramming

• Own and oversee as needed execution of data migration tasks as part of system deployment

• Diagnose, handle, and manage data migration issues

• Understands ACID principles for databases

• Understands and applies different approaches for data loading based on the scenario, such as wipe/reload, upsert, and CDC

• Recognizes and can approach varying latencies of data loading, from batch to near-realtime

• Oversee and work with contract resources to fulfill design and execution for data products.

• Assume responsibility for the overall quality of delivered products.

• Understand and apply key Agile concepts like failing fast and minimum viable product.

• Participate in project management activities like daily stand-up meetings, sprint reviews, etc.

• Assume responsibility for own assigned tasks and reaching out for clarity,

• Create tasks as needed and delegate where appropriate

• Document technical design specifications

• Interpret and diagnose existing legacy or inherited code for problems and proposed remediation

• Unit test workflows extensively to minimize rework

• Peer review with others to receive and provide advice and insight

• Regression test developed items to verify continuous coverage of existing functionality

• Design, execute, and oversee test script execution and automation

• Define deployment/installation documentation

• Execute or oversee deployment, including installation, installation verification, and hypercare

• Document products consistently 50%

Data Architecture

• Recognize key VMRD data entities and understand how they relate to others, to extend the value and linkability of data across use cases.

• Know and apply approaches and sources to acquire additional metadata for key VMRD entities

• Understands basic Master Data Management principles

• Assure adherence to basic data security approaches, including app, visualization, database, and file security

• Understand and apply role-based security approaches and inheritance

• Recognize and safely handle sensitive data such as Personal Information and Intellectual Property

• Good understanding of the technical impacts of GxP-related systems and processes

• Build and continually enhance knowledge of both the technical and business functional landscape for VMRD

• Actively interface with Systems Engineers on app-related projects

• Collaborate with colleagues to continually enhance process and knowledge 10%

ORGANIZATIONAL RELATIONSHIPS

• ZTD R&D Solution Partners

• ZTD R&D Systems Engineers

• ZTD Centers Of Excellence

• VMRD business SMEs from multiple product lines and departments

Supervision

0-4 contingent workers technical direction

EDUCATION AND EXPERIENCE

• Undergraduate degree related to information technology and/or computer science or equivalent education and work experience required.

• 5-8+ years experience with the design, building, and supporting of rapid data development (3-6+ with Master's degree)

• Experience with utilizing multiple vendors and/or departments for service and support activities.

• Excellent interpersonal and communication skills with the ability to build relationships.

• Experience in coordinating activities with multidisciplinary teams distributed in many physical locations with different time zones.

• Ability to prioritize issues and drive progress in ambiguous situations.

TECHNICAL SKILLS REQUIREMENTS

• Familiarity with structured and unstructured data approaches

• Familiarity with structuring data to serve analytic needs, both for visualizations and data science use cases

• Expert experience with rapid ETL tools, including Alteryx/KNIME and Python/R

• Strong experience deploying rapid ETLs from PoC to production

• Experience with scripted languages such as Powershell, Python, and R in an automation environment

• General experience with SQL Server and/or Oracle databases

• Strong experience with SQL query writing

• Working knowledge of T-SQL and/or PL/SQL

• Expert experience with data analysis and troubleshooting

• Basic statistics knowledge

• Some experience with Power BI and/or Tableau

• Strong experience with Microsoft Excel for basic ad hoc data purposes as well as as a data source

• Some experience using pretrained GenAI tools for code acceleration

• Experience with software testing including unit, integration, and regression testing

• Experience with technical writing for SDLC documentation

Project Management

• Experience working within a Solution Delivery Lifecycle Management framework

• Experience with Agile and familiarity with Waterfall development methodologies

• Ability to self-manage targeted projects, and create and delegate tasks