BigQuery
Integration GCP BigQuery with Upriver
Google BigQuery is a powerful, fully managed data warehouse solution offered by Google Cloud, designed to handle large-scale data analytics. By integrating BigQuery with Upriver, you can seamlessly automate data observability for all your datasets and tables to ensure high data quality directly.
Prerequisites
To monitor Google BigQuery with Upriver, you will need the following:
Provision GCP for Upriver operation.
Configure a BigQuery integration in Upriver.
Step 1: Provision GCP
Before connecting a BigQuery table to Upriver, ensure that your Google Cloud Platform (GCP) account is properly configured. Follow the guidelines provided in this page to ensure correct setup.
Step 2: Configure BigQuery integration in Upriver's Platform
Once your GCP account is set up, its time to configure a BigQuery integration in the Upriver platform by providing the following the next steps:
Configure a new Data Integration - Navigate to
Settings->Data Integrations, click "+ Add" in the top-right corner.Fill in basic settings:
Name - A user defined name.
Type - Type of integration. BigQuery should be chosen.
[Optional] Provision GCP: Repeat Step 1 only if your BigQuery project is not covered by original GCP provisioning process.
Fill in the connection details:
Project ID: GCP project ID where the BigQuery instance resides.
Step 3: Configure the Data Source in Upriver platform
Now that your BigQuery integration is set up, you can configure Data Sources to be monitored.
To do this:
Follow the instructions provided in Data Source Configuration section of the documentation.
When configuring a BigQuery Data Source, choose the correct integration in the Connection step. The integration chosen should point to the GCP project that holds the relevant BigQuery with the table you wish to monitor.
Provide the required Database and Table.
Continue with the rest of the configuration as needed.
Monitor and Manage Your Data
After configuring a Redshift datasource, Upriver will automatically monitor it for you. You can track data issues and enforce governance policies, ensuring your data is consistently accurate and trustworthy throughout the pipeline.
Last updated