Perform a token counting.
Endpoint
posthttps://{service-endpoint}/v1/{endpoint}:countTokens
Where {service-endpoint}
is one of the supported service endpoints
.
Path parameters
endpoint
string
Required. The name of the Endpoint requested to perform token counting. Format: projects/{project}/locations/{location}/endpoints/{endpoint}
Request body
The request body contains data with the following structure:
model
string
Optional. The name of the publisher model requested to serve the prediction. Format: projects/{project}/locations/{location}/publishers/*/models/*
instances[]
value ( Value
format)
Optional. The instances that are the input to token counting call. Schema is identical to the prediction schema of the underlying model.
contents[]
object ( Content
)
Optional. Input content.
tools[]
object ( Tool
)
Optional. A list of Tools
the model may use to generate the next response.
A Tool
is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.
systemInstruction
object ( Content
)
Optional. The user provided system instructions for the model. Note: only text should be used in parts and content in each part will be in a separate paragraph.
Example request
Text
C#
Go
Java
Node.js
Python
Multi-modal
Go
Python
Response body
If successful, the response body contains an instance of CountTokensResponse
.