Job Description
Job Description
We are seeking a highly skilled senior Apache NiFi developer. This role focuses on designing and building scalable, resilient data pipelines that power trade processing, regulatory reporting, and downstream analytics. You will work on high-throughput, low-latency data flows, ensuring seamless integration across complex financial systems while maintaining strict data integrity, security, and compliance standards. Responsibilities: - Design, develop, and maintain scalable data flows using Apache NiFi to support post-trade processing and data distribution. - Build robust ingestion, transformation, and routing pipelines for structured and unstructured financial data. - Integrate NiFi with internal and external systems, including APIs, messaging platforms, and databases. - Optimise NiFi performance (throughput, latency, back-pressure, clustering) for high-volume trading environments. - Implement monitoring, alerting, and troubleshooting for production data pipelines to ensure reliability and uptime. - Ensure data quality, lineage, governance, and compliance with financial regulations. - Develop reusable processors, templates, and frameworks to standardise data integration patterns. - Collaborate with data architects, platform engineers, and business stakeholders to translate requirements into technical solutions. - Lead code reviews, enforce engineering best practices, and mentor junior developers. - Support deployment, release management, and production issue resolution. Requirements: - 5+ years of experience in data engineering or integration roles. - Strong hands-on expertise with Apache NiFi (processors, controllers, flow design, clustering, security). - Deep understanding of ETL/ELT and real-time data streaming architectures. - Experience in Java processors and integrations. - Experience with messaging systems (Kafka) and RESTful APIs. - Solid experience with SQL and relational/non-relational databases. - Familiarity with Linux/Unix environments and scripting. - Experience with cloud platforms (AWS) and containerisation (Docker/Kubernetes). - Strong understanding of data formats (JSON, XML, Avro, CSV) and data transformation techniques. Preferred Experience: - Experience in capital markets, trading platforms, or post-trade processing systems. - Knowledge of trade lifecycle, settlement, and regulatory reporting workflows. - Familiarity with data governance, lineage, and audit requirements in financial systems. - Exposure to big data ecosystems (Hadoop and Spark). - Experience with CI/CD pipelines and version control for NiFi flows. Company Summary Ennovision is an IT Services company backed by result-oriented professionals that helps enterprises reimagine and realign their businesses to stay ahead in this digital age. As a global software development and IT consulting company, we understand our customers business aspirations and deliver value through custom software solutions and services. Our delivery models are flexible and tailor-made to accommodate our clients organizational, business, and commercial needs. The DNA of the company is constant innovation with a relentless focus on customer success. Measured in terms of the quality of deliverables, time to market, return on investment, and cost optimization.
Required Skills
[AWS CloudFormation, Docker, Hibernate, Java, Kafka, Kubernetes, Spring Boot, AWS, Big Data, CI / CD, Cloud Computing, Containers, Linux, Monitoring]
Additional Information
NA
