Job Summary

We are seeking a Senior Data Engineer with extensive hands-on expertise in the Ab Initio product suite. In this role, you will be responsible for designing, developing, and optimizing high-volume data integration solutions. You will lead the creation of complex ETL/ELT patterns, ensuring that data pipelines are scalable, resilient, and aligned with enterprise data warehousing standards. The ideal candidate is a technical expert who can navigate the complexities of the Co>Operating System and provide architectural guidance for end-to-end data processing workflows.

Key Responsibilities: ETL Design & Development: Lead the design and implementation of sophisticated Ab Initio graphs and plans using the Graphical Development Environment (GDE). Orchestration: Develop and manage automated workflows and job dependencies using Conduct>It and Continuous Flows for both batch and real-time processing. Metadata Management: Oversee version control, object promotion, and metadata lineage within the Enterprise Meta-Environment (EME). Performance Tuning: Perform deep-dive analysis of Ab Initio applications to optimize component usage, multifilesystem (MFS) performance, and parallel processing techniques. Data Warehousing: Collaborate on the design of logical and physical data models for relational databases (e.g., Oracle, Snowflake, SQL Server) to ensure seamless data integration. Scripting & Automation: Develop robust Unix/Linux shell scripts for wrapper utilities, automation, and system-level troubleshooting. Technical Leadership: Conduct code reviews, establish development standards, and mentor junior engineers on Ab Initio best practices. Collaboration: Partner with Data Architects and Business Analysts to translate complex requirements into technical designs and functional specifications.

Ab Initio Core: Expert-level knowledge of the Co>Operating System, GDE, and the creation of custom components. Component Library: Proficiency with a wide range of components (Partition, Departition, Transform, Database, and Validation). Metadata & Ops: Hands-on experience with EME (air commands) and Conduct>It (Plan/Task development). Environment: Strong command of Unix/Linux internals and shell scripting (KSH, BASH). Databases: Expert SQL skills and experience with large-scale relational database systems. Methodology: Proven experience working in Agile/Scrum delivery environments.

Lead Software Engineer