- Resource: Subscription
- PushConfig
- OidcToken
- PubsubWrapper
- NoWrapper
- BigQueryConfig
- State
- CloudStorageConfig
- TextConfig
- AvroConfig
- State
- ExpirationPolicy
- DeadLetterPolicy
- RetryPolicy
- State
- AnalyticsHubSubscriptionInfo
- Methods
Resource: Subscription
A subscription resource. If none of pushConfig
, bigqueryConfig
, or cloudStorageConfig
is set, then the subscriber will pull and ack messages using API methods. At most one of these fields may be set.
JSON representation |
---|
{ "name" : string , "topic" : string , "pushConfig" : { object ( |
name
string
Required. Name of the subscription. Format is projects/{project}/subscriptions/{sub}
.
topic
string
Required. The name of the topic from which this subscription is receiving messages. Format is projects/{project}/topics/{topic}
. The value of this field will be _deleted-topic_
if the topic has been deleted.
pushConfig
object (
PushConfig
)
Optional. If push delivery is used with this subscription, this field is used to configure it.
bigqueryConfig
object (
BigQueryConfig
)
Optional. If delivery to BigQuery is used with this subscription, this field is used to configure it.
cloudStorageConfig
object (
CloudStorageConfig
)
Optional. If delivery to Google Cloud Storage is used with this subscription, this field is used to configure it.
ackDeadlineSeconds
integer
Optional. The approximate amount of time (on a best-effort basis) Pub/Sub waits for the subscriber to acknowledge receipt before resending the message. In the interval after the message is delivered and before it is acknowledged, it is considered to be outstanding . During that time period, the message will not be redelivered (on a best-effort basis).
For pull subscriptions, this value is used as the initial value for the ack deadline. To override this value for a given message, call subscriptions.modifyAckDeadline
with the corresponding ackId
if using non-streaming pull or send the ackId
in a StreamingModifyAckDeadlineRequest
if using streaming pull. The minimum custom deadline you can specify is 10 seconds. The maximum custom deadline you can specify is 600 seconds (10 minutes). If this parameter is 0, a default value of 10 seconds is used.
For push delivery, this value is also used to set the request timeout for the call to the push endpoint.
If the subscriber never acknowledges the message, the Pub/Sub system will eventually redeliver the message.
labels
map (key: string, value: string)
Optional. See Creating and managing labels .
An object containing a list of "key": value
pairs. Example: { "name": "wrench", "mass": "1.3kg", "count": "3" }
.
expirationPolicy
object (
ExpirationPolicy
)
Optional. A policy that specifies the conditions for this subscription's expiration. A subscription is considered active as long as any connected subscriber is successfully consuming messages from the subscription or is issuing operations on the subscription. If expirationPolicy
is not set, a default policy
with ttl
of 31 days will be used. The minimum allowed value for expirationPolicy.ttl
is 1 day. If expirationPolicy
is set, but expirationPolicy.ttl
is not set, the subscription never expires.
filter
string
Optional. An expression written in the Pub/Sub filter language
. If non-empty, then only PubsubMessage
s whose attributes
field matches the filter are delivered on this subscription. If empty, then no messages are filtered out.
deadLetterPolicy
object (
DeadLetterPolicy
)
Optional. A policy that specifies the conditions for dead lettering messages in this subscription. If deadLetterPolicy is not set, dead lettering is disabled.
The Pub/Sub service account associated with this subscriptions's parent project (i.e., service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com) must have permission to subscriptions.acknowledge() messages on this subscription.
retryPolicy
object (
RetryPolicy
)
Optional. A policy that specifies how Pub/Sub retries message delivery for this subscription.
If not set, the default retry policy is applied. This generally implies that messages will be retried as soon as possible for healthy subscribers. RetryPolicy will be triggered on NACKs or acknowledgment deadline exceeded events for a given message.
detached
boolean
Optional. Indicates whether the subscription is detached from its topic. Detached subscriptions don't receive messages from their topic and don't retain any backlog. subscriptions.pull
and StreamingPull
requests will return FAILED_PRECONDITION. If the subscription is a push subscription, pushes to the endpoint will not be made.
enableExactlyOnceDelivery
boolean
Optional. If true, Pub/Sub provides the following guarantees for the delivery of a message with a given value of messageId
on this subscription:
- The message sent to a subscriber is guaranteed not to be resent before the message's acknowledgment deadline expires.
- An acknowledged message will not be resent to a subscriber.
Note that subscribers may still receive multiple copies of a message when enableExactlyOnceDelivery
is true if the message was published multiple times by a publisher client. These copies are considered distinct by Pub/Sub and have distinct messageId
values.
state
enum (
State
)
Output only. An output-only field indicating whether or not the subscription can receive messages.
analyticsHubSubscriptionInfo
object (
AnalyticsHubSubscriptionInfo
)
Output only. Information about the associated Analytics Hub subscription. Only set if the subscritpion is created by Analytics Hub.
PushConfig
Configuration for a push delivery endpoint.
JSON representation |
---|
{ "pushEndpoint" : string , "attributes" : { string : string , ... } , // Union field |
pushEndpoint
string
Optional. A URL locating the endpoint to which messages should be pushed. For example, a Webhook endpoint might use https://example.com/push
.
attributes
map (key: string, value: string)
Optional. Endpoint configuration attributes that can be used to control different aspects of the message delivery.
The only currently supported attribute is x-goog-version
, which you can use to change the format of the pushed message. This attribute indicates the version of the data expected by the endpoint. This controls the shape of the pushed message (i.e., its fields and metadata).
If not present during the subscriptions.create
call, it will default to the version of the Pub/Sub API used to make such call. If not present in a subscriptions.modifyPushConfig
call, its value will not be changed. subscriptions.get
calls will always return a valid version, even if the subscription was created without this attribute.
The only supported values for the x-goog-version
attribute are:
-
v1beta1
: uses the push format defined in the v1beta1 Pub/Sub API. -
v1
orv1beta2
: uses the push format defined in the v1 Pub/Sub API.
For example: attributes { "x-goog-version": "v1" }
An object containing a list of "key": value
pairs. Example: { "name": "wrench", "mass": "1.3kg", "count": "3" }
.
authentication_method
. An authentication method used by push endpoints to verify the source of push requests. This can be used with push endpoints that are private by default to allow requests only from the Pub/Sub system, for example. This field is optional and should be set only by users interested in authenticated push. authentication_method
can be only one of the following:oidcToken
object (
OidcToken
)
Optional. If specified, Pub/Sub will generate and attach an OIDC JWT token as an Authorization
header in the HTTP request for every pushed message.
wrapper
. The format of the delivered message to the push endpoint is defined by the chosen wrapper. When unset, PubsubWrapper
is used. wrapper
can be only one of the following:pubsubWrapper
object (
PubsubWrapper
)
Optional. When set, the payload to the push endpoint is in the form of the JSON representation of a PubsubMessage ( https://cloud.google.com/pubsub/docs/reference/rpc/google.pubsub.v1#pubsubmessage) .
noWrapper
object (
NoWrapper
)
Optional. When set, the payload to the push endpoint is not wrapped.
OidcToken
Contains information needed for generating an OpenID Connect token .
JSON representation |
---|
{ "serviceAccountEmail" : string , "audience" : string } |
Fields | |
---|---|
serviceAccountEmail
|
Optional. Service account email used for generating the OIDC token. For more information on setting up authentication, see Push subscriptions . |
audience
|
Optional. Audience to be used when generating OIDC token. The audience claim identifies the recipients that the JWT is intended for. The audience value is a single case-sensitive string. Having multiple values (array) for the audience field is not supported. More info about the OIDC JWT token audience here: https://tools.ietf.org/html/rfc7519#section-4.1.3 Note: if not specified, the Push endpoint URL will be used. |
PubsubWrapper
This type has no fields.
The payload to the push endpoint is in the form of the JSON representation of a PubsubMessage ( https://cloud.google.com/pubsub/docs/reference/rpc/google.pubsub.v1#pubsubmessage) .
NoWrapper
Sets the data
field as the HTTP body for delivery.
JSON representation |
---|
{ "writeMetadata" : boolean } |
Fields | |
---|---|
writeMetadata
|
Optional. When true, writes the Pub/Sub message metadata to |
BigQueryConfig
Configuration for a BigQuery subscription.
JSON representation |
---|
{
"table"
:
string
,
"useTopicSchema"
:
boolean
,
"writeMetadata"
:
boolean
,
"dropUnknownFields"
:
boolean
,
"state"
:
enum (
|
Fields | |
---|---|
table
|
Optional. The name of the table to which to write data, of the form {projectId}.{datasetId}.{tableId} |
useTopicSchema
|
Optional. When true, use the topic's schema as the columns to write to in BigQuery, if it exists. |
writeMetadata
|
Optional. When true, write the subscription name, messageId, publishTime, attributes, and orderingKey to additional columns in the table. The subscription name, messageId, and publishTime fields are put in their own columns while all other message properties (other than data) are written to a JSON object in the attributes column. |
dropUnknownFields
|
Optional. When true and useTopicSchema is true, any fields that are a part of the topic schema that are not part of the BigQuery table schema are dropped when writing to BigQuery. Otherwise, the schemas must be kept in sync and any messages with extra fields are not written and remain in the subscription's backlog. |
state
|
Output only. An output-only field that indicates whether or not the subscription can receive messages. |
useTableSchema
|
Optional. When true, use the BigQuery table's schema as the columns to write to in BigQuery. |
serviceAccountEmail
|
Optional. The service account to use to write to BigQuery. The subscription creator or updater that specifies this field must have |
State
Possible states for a BigQuery subscription.
Enums | |
---|---|
STATE_UNSPECIFIED
|
Default value. This value is unused. |
ACTIVE
|
The subscription can actively send messages to BigQuery |
PERMISSION_DENIED
|
Cannot write to the BigQuery table because of permission denied errors. This can happen if - Pub/Sub SA has not been granted the appropriate BigQuery IAM permissions - bigquery.googleapis.com API is not enabled for the project ( instructions ) |
NOT_FOUND
|
Cannot write to the BigQuery table because it does not exist. |
SCHEMA_MISMATCH
|
Cannot write to the BigQuery table due to a schema mismatch. |
IN_TRANSIT_LOCATION_RESTRICTION
|
Cannot write to the destination because enforceInTransit is set to true and the destination locations are not in the allowed regions. |
CloudStorageConfig
Configuration for a Cloud Storage subscription.
JSON representation |
---|
{ "bucket" : string , "filenamePrefix" : string , "filenameSuffix" : string , "filenameDatetimeFormat" : string , "maxDuration" : string , "maxBytes" : string , "maxMessages" : string , "state" : enum ( |
bucket
string
Required. User-provided name for the Cloud Storage bucket. The bucket must be created by the user. The bucket name must be without any prefix like "gs://". See the bucket naming requirements .
filenamePrefix
string
Optional. User-provided prefix for Cloud Storage filename. See the object naming requirements .
filenameSuffix
string
Optional. User-provided suffix for Cloud Storage filename. See the object naming requirements . Must not end in "/".
filenameDatetimeFormat
string
Optional. User-provided format string specifying how to represent datetimes in Cloud Storage filenames. See the datetime format guidance .
maxDuration
string (
Duration
format)
Optional. The maximum duration that can elapse before a new Cloud Storage file is created. Min 1 minute, max 10 minutes, default 5 minutes. May not exceed the subscription's acknowledgment deadline.
A duration in seconds with up to nine fractional digits, ending with ' s
'. Example: "3.5s"
.
maxBytes
string ( int64
format)
Optional. The maximum bytes that can be written to a Cloud Storage file before a new file is created. Min 1 KB, max 10 GiB. The maxBytes limit may be exceeded in cases where messages are larger than the limit.
state
enum (
State
)
Output only. An output-only field that indicates whether or not the subscription can receive messages.
serviceAccountEmail
string
Optional. The service account to use to write to Cloud Storage. The subscription creator or updater that specifies this field must have iam.serviceAccounts.actAs
permission on the service account. If not specified, the Pub/Sub service agent
, service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com, is used.
output_format
. Defaults to text format. output_format
can be only one of the following:textConfig
object (
TextConfig
)
Optional. If set, message data will be written to Cloud Storage in text format.
avroConfig
object (
AvroConfig
)
Optional. If set, message data will be written to Cloud Storage in Avro format.
TextConfig
This type has no fields.
Configuration for writing message data in text format. Message payloads will be written to files as raw text, separated by a newline.
AvroConfig
Configuration for writing message data in Avro format. Message payloads and metadata will be written to files as an Avro binary.
JSON representation |
---|
{ "writeMetadata" : boolean , "useTopicSchema" : boolean } |
Fields | |
---|---|
writeMetadata
|
Optional. When true, write the subscription name, messageId, publishTime, attributes, and orderingKey as additional fields in the output. The subscription name, messageId, and publishTime fields are put in their own fields while all other message properties other than data (for example, an orderingKey, if present) are added as entries in the attributes map. |
useTopicSchema
|
Optional. When true, the output Cloud Storage file will be serialized using the topic schema, if it exists. |
State
Possible states for a Cloud Storage subscription.
Enums | |
---|---|
STATE_UNSPECIFIED
|
Default value. This value is unused. |
ACTIVE
|
The subscription can actively send messages to Cloud Storage. |
PERMISSION_DENIED
|
Cannot write to the Cloud Storage bucket because of permission denied errors. |
NOT_FOUND
|
Cannot write to the Cloud Storage bucket because it does not exist. |
IN_TRANSIT_LOCATION_RESTRICTION
|
Cannot write to the destination because enforceInTransit is set to true and the destination locations are not in the allowed regions. |
SCHEMA_MISMATCH
|
Cannot write to the Cloud Storage bucket due to an incompatibility between the topic schema and subscription settings. |
ExpirationPolicy
A policy that specifies the conditions for resource expiration (i.e., automatic resource deletion).
JSON representation |
---|
{ "ttl" : string } |
Fields | |
---|---|
ttl
|
Optional. Specifies the "time-to-live" duration for an associated resource. The resource expires if it is not active for a period of A duration in seconds with up to nine fractional digits, ending with ' |
DeadLetterPolicy
Dead lettering is done on a best effort basis. The same message might be dead lettered multiple times.
If validation on any of the fields fails at subscription creation/updation, the create/update subscription request will fail.
JSON representation |
---|
{ "deadLetterTopic" : string , "maxDeliveryAttempts" : integer } |
Fields | |
---|---|
deadLetterTopic
|
Optional. The name of the topic to which dead letter messages should be published. Format is The operation will fail if the topic does not exist. Users should ensure that there is a subscription attached to this topic since messages published to a topic with no subscriptions are lost. |
maxDeliveryAttempts
|
Optional. The maximum number of delivery attempts for any message. The value must be between 5 and 100. The number of delivery attempts is defined as 1 + (the sum of number of NACKs and number of times the acknowledgment deadline has been exceeded for the message). A NACK is any call to subscriptions.modifyAckDeadline with a 0 deadline. Note that client libraries may automatically extend ack_deadlines. This field will be honored on a best effort basis. If this parameter is 0, a default value of 5 is used. |
RetryPolicy
A policy that specifies how Pub/Sub retries message delivery.
Retry delay will be exponential based on provided minimum and maximum backoffs. https://en.wikipedia.org/wiki/Exponential_backoff .
RetryPolicy will be triggered on NACKs or acknowledgment deadline exceeded events for a given message.
Retry Policy is implemented on a best effort basis. At times, the delay between consecutive deliveries may not match the configuration. That is, delay can be more or less than configured backoff.
JSON representation |
---|
{ "minimumBackoff" : string , "maximumBackoff" : string } |
Fields | |
---|---|
minimumBackoff
|
Optional. The minimum delay between consecutive deliveries of a given message. Value should be between 0 and 600 seconds. Defaults to 10 seconds. A duration in seconds with up to nine fractional digits, ending with ' |
maximumBackoff
|
Optional. The maximum delay between consecutive deliveries of a given message. Value should be between 0 and 600 seconds. Defaults to 600 seconds. A duration in seconds with up to nine fractional digits, ending with ' |
State
Possible states for a subscription.
Enums | |
---|---|
STATE_UNSPECIFIED
|
Default value. This value is unused. |
ACTIVE
|
The subscription can actively receive messages |
RESOURCE_ERROR
|
The subscription cannot receive messages because of an error with the resource to which it pushes messages. See the more detailed error state in the corresponding configuration. |
AnalyticsHubSubscriptionInfo
Information about an associated Analytics Hub subscription .
JSON representation |
---|
{ "listing" : string , "subscription" : string } |
Fields | |
---|---|
listing
|
Optional. The name of the associated Analytics Hub listing resource. Pattern: "projects/{project}/locations/{location}/dataExchanges/{data_exchange}/listings/{listing}" |
subscription
|
Optional. The name of the associated Analytics Hub subscription resource. Pattern: "projects/{project}/locations/{location}/subscriptions/{subscription}" |
Methods |
|
---|---|
|
Acknowledges the messages associated with the ack_ids
in the AcknowledgeRequest
. |
|
Creates a subscription to a given topic. |
|
Deletes an existing subscription. |
|
Detaches a subscription from this topic. |
|
Gets the configuration details of a subscription. |
|
Gets the access control policy for a resource. |
|
Lists matching subscriptions. |
|
Modifies the ack deadline for a specific message. |
|
Modifies the PushConfig
for a specified subscription. |
|
Updates an existing subscription by updating the fields specified in the update mask. |
|
Pulls messages from the server. |
|
Seeks an existing subscription to a point in time or to a given snapshot, whichever is provided in the request. |
|
Sets the access control policy on the specified resource. |
|
Returns permissions that a caller has on the specified resource. |