Method: endpoints.countTokens

Full name: projects.locations.endpoints.countTokens

Perform a token counting.

Endpoint

post https: / /{service-endpoint} /v1 /{endpoint}:countTokens

Where {service-endpoint} is one of the supported service endpoints .

Path parameters

endpoint string

Required. The name of the Endpoint requested to perform token counting. Format: projects/{project}/locations/{location}/endpoints/{endpoint}

Request body

The request body contains data with the following structure:

Fields
model string

Optional. The name of the publisher model requested to serve the prediction. Format: projects/{project}/locations/{location}/publishers/*/models/*

instances[] value ( Value format)

Optional. The instances that are the input to token counting call. Schema is identical to the prediction schema of the underlying model.

contents[] object ( Content )

Optional. Input content.

tools[] object ( Tool )

Optional. A list of Tools the model may use to generate the next response.

A Tool is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.

systemInstruction object ( Content )

Optional. The user provided system instructions for the model. Note: only text should be used in parts and content in each part will be in a separate paragraph.

generationConfig object ( GenerationConfig )

Optional. Generation config that the model will use to generate the response.

Response body

If successful, the response body contains an instance of CountTokensResponse .

Design a Mobile Site
View Site in Mobile | Classic
Share by: