Key Responsibilities:
ETL Development & Optimization
- Design and develop ETL pipelines using Ab Initio GDE, creating efficient graphs and plans for data extraction, transformation, and loading
- Optimize Ab Initio processes with MFS (Multi-File System) for improved performance and reduced batch run times
- Utilize Ab Initio Co>Operating System and EME (Enterprise Meta Environment) for metadata management, version control, and deployment
Data Quality & Validation
- Implement data profiling, cleansing, validation, and error-handling techniques
- Ensure high data integrity and quality throughout ETL processes
Database & Scripting
- Apply strong SQL skills for data extraction, transformation, and reconciliation
- Use UNIX/Linux shell scripting to support data processing, debugging, and automation
- Work with relational databases like Oracle and SQL Server
Collaboration & Support
- Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical solutions
- Debug and resolve complex production issues related to ETL jobs, data mismatches, and performance bottlenecks
- Support data warehousing and data modeling initiatives for scalable structures
Documentation & Best Practices
- Create and maintain technical design documents, ETL specifications, and operational documentation
- Participate in code reviews and ensure adherence to Ab Initio and ETL best practices
