Schedule production executions

Create a Dataform repository

1. In the Google Cloud console, go to the Dataformpage.

   Go to Dataform

2. Click add Create repository.

3. On the Create repositorypage, do the following:

   1. In the Repository IDfield, enter quickstart-production .

   2. In the Regionlist, select europe-west4 .

   3. Click Create.

4. Click Done.

Grant Dataform access to BigQuery

To run workflows in BigQuery, the Dataform service account must have the following required roles:

• BigQuery Data Editor on projects to which Dataform needs both read and write access. They usually include the project hosting your Dataform repository.
• BigQuery Data Viewer on projects to which Dataform needs read-only access.
• BigQuery Job User on the project hosting your Dataform repository.

To grant these roles, follow these steps:

1. In the Google Cloud console, go to the IAMpage.

   Go to the IAM page

2. Click Add.

3. In the New principalsfield, enter your Dataform service account ID.

4. In the Select a rolelist, select the BigQuery Job Userrole.

5. Click Add another role, and then in the Select a rolelist, select the BigQuery Data Editorrole.

6. Click Add another role, and then in the Select a rolelist, select the BigQuery Data Viewerrole.

7. Click Save.

Create a release configuration

To create production compilation results of the quickstart-production repository, follow these steps:

1. In the Google Cloud console, go to the Dataformpage.

   Go to Dataform

2. Click quickstart-production .

3. Click Release configurations, and then click New release configuration.

4. In the Create release configurationpane, configure the following settings:

   1. In the Release IDfield, enter production .

   2. In the Git commitishfield, leave the default value main .

   3. In the Frequencymenu, select Custom.

   4. In the Custom schedulefield, enter 0 16 * * * .

   5. In the Timezonemenu, select a UTC+1 timezone, for example, Greenwich Mean Time (GMT).

   Every day at 4 PM UTC+1, Dataform will compile the quickstart-production repository and apply compilation settings configured in this release configuration to create production compilation results.

5. Click Create.

The production release configuration creates a compilation result of the entire quickstart-production repository every day at 4PM UTC+1.

Create a workflow configuration

To schedule execution of production tables, follow these steps:

1. In the Google Cloud console, go to the Dataformpage.

   Go to Dataform

2. Click quickstart-production .

3. Click Workflow configurations, and then click New workflow configuration.

4. In the Create workflow configurationpane, in the Configuration IDfield, enter production .

5. In the Release configurationmenu, select production .

6. In the Frequencyfield, enter 0 17 * * * .

7. In the Timezonemenu, select a UTC+1 timezone, for example, Greenwich Mean Time (GMT).

   Every day at 5PM UTC+1, Dataform runs the latest production compilation result of the quickstart-production repository.

   To ensure that Dataform runs the latest compilation result in the corresponding release configuration, keep a minimum 1 hour break between the time of compilation result creation and the time of scheduled execution.

8. Click All actions.

   Dataform run all the workflow actions in the production compilation result.

9. Click Create.

The production workflow configuration runs the entire latest compilation result created by the production release configuration every day at 4PM UTC+1.

View past production compilation results

To view past scheduled production compilation results, follow these steps:

1. In the Google Cloud console, go to the Dataformpage.

   Go to Dataform

2. Click quickstart-production .

3. Click Release configurations.

4. Click production .

View past production workflow executions

To view past production workflow executions, follow these steps:

1. In the Google Cloud console, go to the Dataformpage.

   Go to Dataform

2. Click quickstart-production .

3. Click Workflow configurations.