Reporting and Data Pipeline

Overview

The N-Squared OCS can be integrated with a system-agnostic data pipeline and dashboard solution built on Apache Nifi, PostgreSQL and Apache Superset. With this pipeline, the OCS real-time database and OCS EDRs are processed by Apache Nifi’s data processing engine into a PostgreSQL database, and this database may the be used for reporting, business analysis and dashboard creation (such as with Superset).

To install this reporting solution for the OCS, see the Red Hat 8 installation guide.

Apache Nifi

Using Apache Nifi, the OCS reporting solution processes the OCS real-time database and OCS EDRs into the OCS reporting database stored in a PostgreSQL. Nifi configuration instructions are described in the data pipeline page.

Reporting Database

The reporting database is the target for all Apache Nifi data processing output. The published data model of this reporting database is documented here.

Apache Superset

Using Apache Superset, information stored in the N-Squared OCS reporting database can be aggregated and reporting on using a richly functional web dashboard solution suitable for business and operations staff. Superset configuration instructions are located on the dashboard page.