Google Cloud Dataflow V1beta3 Client - Class StreamingMode (0.8.1)

Reference documentation and code samples for the Google Cloud Dataflow V1beta3 Client class StreamingMode.

Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages written to storage.

Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see Set the pipeline streaming mode .

Protobuf type google.dataflow.v1beta3.StreamingMode

  Value: 0 
 

Run in the default mode.

Generated from protobuf enum STREAMING_MODE_UNSPECIFIED = 0;

  Value: 1 
 

In this mode, message deduplication is performed against persistent state to make sure each message is processed and committed to storage exactly once.

Generated from protobuf enum STREAMING_MODE_EXACTLY_ONCE = 1;

  Value: 2 
 

Message deduplication is not performed. Messages might be processed multiple times, and the results are applied multiple times.

Note: Setting this value also enables Streaming Engine and Streaming Engine resource-based billing.

Generated from protobuf enum STREAMING_MODE_AT_LEAST_ONCE = 2;