Modify a stream

You can modify the following information about a stream:

  • High-level information, such as the display name and labels for the stream.
  • Configuration information for the source database and the destination, such as the tables and schemas in the source database that Datastream will either transfer to the destination or will be restricted from transferring into the destination. Datastream uses this configuration information to transfer the correct data from the source database to the destination.

Modify high-level information

  1. Go to the Streamspage in the Google Cloud Console.

    Go to the Streams page

  2. Click the stream that you want to modify.

  3. On the Stream detailspage, click EDIT.

  4. Select Edit stream settingsfrom the menu that appears.

  5. Modify the display name or labels for the stream.

  6. After making your changes, click SAVE.

Modify configuration information about the source database

  1. Go to the Streamspage in the Google Cloud Console.

    Go to the Streams page

  2. Click the stream that you want to modify.

  3. On the Stream detailspage, click EDIT.

  4. Select Edit source configurationfrom the menu that appears.

  5. In the Select objects to includesection, use the Objects to includedrop-down menu to change the tables and schemas in the source database that Datastream will transfer to the destination.

  6. Optionally, expand the Select objects to excludenode. In the Objects to excludefield, modify the tables and schemas in the source database that you want to restrict Datastream from transferring into the destination. If tables are added to this list, then they're no longer pulled into the destination. However, they're not removed from the destination.

  7. Note that for Oracle sources, you can't modify the CDC method. However, you can change the database directories details, if you selected this log file access type.

  8. Optionally, expand the Choose backfill mode for historical datanode to modify whether Datastream backfills the destination with current and future data from the source, or streams only changes to this data.

    • Select the Automaticoption to stream all existing data, in addition to changes to the data, from the source into the destination.

      If you select this option, then in the Objects excluded from automatic backfillfield, you can modify the tables and schemas in the source database that you want to restrict Datastream from backfilling into the destination.

    • Select the Manualoption to stream only changes to the data.

  9. After making your changes, click SAVE.

Modify configuration information about the destination

  1. Go to the Streamspage in the Google Cloud Console.

    Go to the Streams page

  2. Click the stream that you want to modify.

  3. On the Stream detailspage, click EDIT.

  4. Select Edit destination configurationfrom the menu that appears.

  5. Depending on the destination that you selected, adjust the following settings as required:

    BigQuerydestinations:

    • Under Encryption, change the type of encryption that you want to use: Google-managed encryption key or Cloud Key Management Service key.
    • Under Balance data staleness and BigQuery costs, change the Staleness limitoption.

    BigLake Iceberg tablesdestinations:

    • Under Encryption, change the type of encryption that you want to use: Google-managed encryption key or Cloud Key Management Service key.

    Cloud Storagedestinations:

    • In the Stream path prefixfield, modify the folder of the destination into which Datastream will transfer schemas, tables, and data from the source database.
    • From the Output formatmenu:
      • Choose the format of files written to Cloud Storage. Datastream supports two output formats: Avro and JSON.
      • If you select the JSON format, then select or clear the Include a Unified Types schema file in the file pathand Enable gzip compressioncheck boxes.
  6. Click SAVEto apply your changes and start your stream . Any modifications that you make to streams that are running are updated by Datastream automatically.

What's next

Create a Mobile Website
View Site in Mobile | Classic
Share by: