Create an AlloyDB stream using the automated flow

Console

1. Go to your source AlloyDB for PostgreSQL clusters overview page.

   Go to AlloyDB for PostgreSQL

2. Click the primary cluster from which you want to stream data.

3. Create and start your stream automatically, in one of the following ways:

   1. In the Cluster detailspage, under Data replication, click Start stream.
   2. In the Integrationssection, click Start streamunder Replicate data to BigQuery.
   3. On the Launchpadtab, under Seamlessly integrate with other Google Cloud products, click Replicate data to BigQuery.

4. The Start stream to replicate datapane opens.

5. Under Stream settings, review the default settings for the stream that you create.

6. You can change the source database by expanding the corresponding drop-down and selecting a different value.

7. If you're ready to create and start your stream, click Start stream.

If you need to change the stream settings, click Customize.

Customize stream settings

When you click Customize, the Customize stream settingspage appears. Make sure that you have the required permissions to customize the stream settings.

Get started

1. On the Get startedpage, provide the name for your stream in the Stream namefield. The Stream IDfield gets populated automatically.

2. In the Provide the instance user account detailssection, select the authentication method:

   • IAM database authentication: this option is available if your user has the Identity and Access Management (IAM) principal identity assigned. For more information, see IAM principals . If you select this option, you must manually grant the alloydbsuperuser role and the CREATEROLE permission to your user:

     1. In Google Cloud console, go to the AlloyDB for PostgreSQL Clusters page.

     Go to AlloyDB for PostgreSQL

     1. Select your AlloyDB for PostgreSQL cluster.
     2. In the navigation menu, click AlloyDB for PostgreSQL Studioand sign in.
     3. In the Explorerpane, run the following query for your user:

    GRANT 
     
    alloydbsuperuser 
     
    TO 
     
    " USER_NAME 
   " 
    ; 
    ALTER 
     
    ROLE 
     
    " USER_NAME 
   " 
     
    CREATEROLE 
    ; 
   

   • Built-in database authentication: provide the username and the password of a user with the alloydbsuperuser role. If your user doesn't have the alloydbsuperuser role, follow the steps described in the IAM database authentication section to grant it manually. If you select built-in database authentication, also make sure that the user has GRANT permissions on the tables that they want to replicate.

3. Review additional stream details, such as region, encryption and labels. Expand the Additional stream detailssection to apply changes, if required.

4. Click Continue.

Configure source

1. On the Configure sourcepage, select the database from which you want to replicate data.

2. The Selected objectslist selects all available objects by default. The objects on the list are the objects for which you have the necessary permissions to stream. To change the selected objects, modify the selections in the list.

3. Review advanced stream configurations, such as backfill mode and the maximum number of concurrent backfill connections. Expand the Advanced stream configurationssection to apply changes, if required.

4. Click Continue.

Configure destination

1. On the Configure destinationpage, adjust the BigQuery destination settings, if required. For more information, see Configure information about the destination for the stream .

Create and start the stream

1. Click Create and startto create and start your stream, or Create without startingto create your stream and start it later in Datastream.

2. You're notified about the tasks that are automatically performed for you:

   • Datastream creates the required Virtual Private Cloud resources, such as an internal IP address range, subnetwork and network attachment.
   • Datastream configures tables for CDC, sets up replication slots, sets up a publication for all tables in the database, and creates a dedicated Datastream user.
   • Datastream creates a private connectivity configuration and source and destination connection profiles.

3. Confirm that you want to create and start your stream.