Experience & Qualification:
- 6+ years overall IT experience
- 3+ years hands-on experience with Apache NiFi in enterprise projects
Key Responsibilities:
- Design, develop, and maintain Apache NiFi data flows for ingesting high‑volume payment and account data into systems
- Develop and manage NiFi processors, process groups, connections, back‑pressure, and error handling mechanisms
- Implement real-time and batch data processing pipelines for payment events, acknowledgements, alerts, and notifications
- Integrate NiFi with RDBMS (Oracle / PostgreSQL) and messaging systems for persistent storage and downstream consumption
- Support data reconciliation between source systems, and external interfaces (e.g., bank APIs, reporting systems)
- Ensure data quality, lineage, auditability, and recoverability in line with banking and regulatory requirements
- Work closely with Backend API engineers, System Analysts, and DevOps teams to ensure end‑to‑end data flow alignment
Mandatory Technical Skills:
- Apache NiFi
- Flow design, processors, controller services
- Back pressure, prioritizers, funnels, provenance
- Error routing and retry strategies
- Data Engineering
- Data ingestion and transformation (JSON, XML, CSV)
- Batch and streaming data flows
- Databases
- SQL (Oracle / PostgreSQL preferred)
- Data modelling and optimization for large datasets
- Integration
- REST APIs
- File-based integrations (SFTP, SMTP, batch files)
Good-to-Have / Preferred Skills: