Configure BigQuery in Application Design Center

BigQuery is a fully managed, petabyte-scale, and cost-effective analytics data warehouse that lets you run analytics over vast amounts of data in near real time. For more information, see BigQuery introduction .

This document describes the components and parameters you can configure when using App Design Center to create a BigQuery dataset. The configuration parameters are based on the terraform-google-bigquery Terraform module.

Component connections

The following table includes the components that you can connect to a BigQuery dataset, and the resulting updates to your application and its generated Terraform code.

Connected component

Application updates

Background information

  • The Compute Engine instances can read and write data to the BigQuery dataset.
  • The BigQuery resource metadata is added to the Compute Engine instance template.
  • The roles/bigquery.dataEditor role is added to Compute Engine instance template service account.
  • The service account can be used by services, such as Cloud Run, to read and modify data in the BigQuery dataset.
  • The BigQuery roles/bigquery.dataEditor role is added to the service account.
  • The Cloud Run service can interact with the BigQuery dataset.
  • The BigQuery resource metadata is added to the Cloud Run environment variables.
  • The BigQuery roles/bigquery.dataEditor role is added to the Cloud Run service account.
  • The Pub/Sub subscription can write messages to the BigQuery dataset.
  • The BigQuery dataset information is added to the BigQuery subscription fields.

Required configuration parameters

If your template includes a BigQuery component, you must configure the following parameters before you deploy.

Parameter name

Description and constraints

Background information

Dataset ID

id Introduction to datasets

Project ID

The project where you want to deploy the BigQuery dataset and table.

Configure components

Optional configuration parameters

The following parameters are optional. To display advanced parameters, in the Configurationarea, select Show advanced fields.

Feature

Subfeature

Parameter name

Description and constraint information

Background information

Tables

Table ID

id
Time Partitioning

Expiration MS

Range Partitioning

Field

Deletion Protection

Select the checkbox to prevent this table from being deleted by Terraform. If not selected, the component-level Deletion Protection setting is used.

Delete Contents on Destroy

Select to delete all tables in the dataset when destroying the resource. If not selected, destroying the resource fails if tables are present.

Deletion Protection

When selected, a terraform apply or terraform destroy that would delete tables will fail. When not selected, tables can be deleted. You can override this setting using the deletion protection setting for each table.

Dataset Labels

Key

Views

View ID

id
Materialized Views

View ID

id
Time Partitioning

Expiration MS

Range Partitioning

Field

External Tables

Table ID

id

Description

A description of the external table.

Encoding

Skip Leading Rows

Google Sheets Options

Range

Hive Partitioning Options

Mode

Deletion Protection

Select the checkbox to prevent this table from being deleted by Terraform. If not selected, the component-level Deletion Protection setting is used.

Routines

Routine ID

Routine Type

Language

Description

A description of the routine.
Arguments

Name

The name of the argument.

Argument Kind

Mode

Create a Mobile Website
View Site in Mobile | Classic
Share by: