Schema Monitoring

Overview

Upriver automatically monitors and tracks the schema of each data source. A schema is considered to have been changed when either a field/column has been added/removed or if the type of a field has changed.

The current schema for each data source can be seen in the Data Sources field's page (see Data Source Fields).

Once any change to the schema has been detected, Upriver ensures users are promptly alerted to alterations in their data schema.

Schema incident

When Upriver detects a schema incident, it creates an entry in the incidents list for easy tracking. The incident details display both the expected and actual schema of the data source, helping users identify any structural differences. Additionally, users can choose to focus specifically on these changes by enabling the “Only show changes” toggle above the schema view, simplifying the review process by highlighting only what has been altered.

A schema incident detected by Upriver. In this example you can see that three fields were removed from the schema.

In addition, to help understand the incident, users can hover over the type badge and see examples for the the specific field. These incidents are also grouped according to the semantic format in order to help the users make sense of the data without needing to query it.

Examples displayed when hovering over the type icon