Apache NiFi

Apache NiFi is an easy to use, powerful and reliable system to process and distribute data. It automates data pipelines and distribution for use cases such as cybersecurity, observability, event streams and generative AI, and is used by thousands of companies across industries. Flows are built and monitored in a browser-based interface that combines design, control, feedback and monitoring in one place.

NiFi tracks complete data provenance, giving lineage of information from beginning to end. Its configuration options include loss-tolerant or guaranteed delivery, low latency or high throughput, dynamic prioritization, back pressure control and runtime modification of flows. Security covers HTTPS with configurable authentication strategies, multi-tenant authorization and policy management, and encrypted communication over TLS and SSH. It is released under the Apache License.