- 1.35.0 (latest)
- 1.34.0
- 1.33.0
- 1.32.1
- 1.31.0
- 1.30.0
- 1.26.0
- 1.23.0
- 1.22.0
- 1.21.0
- 1.20.0
- 1.19.0
- 1.18.0
- 1.17.0
- 1.16.0
- 1.15.0
- 1.14.0
- 1.13.1
- 1.12.0
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.0
- 1.7.0
- 1.6.0
- 1.5.0
- 1.4.0
- 1.3.0
- 1.2.0
- 1.1.0
- 1.0.0
- 0.39.0
- 0.38.0
- 0.37.1
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.2
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.13.0
- 0.12.0
- 0.11.1
- 0.10.0
Reference documentation and code samples for the Google Cloud Ai Platform V1 Client class SpeculativeDecodingSpec.
Configuration for Speculative Decoding.
Generated from protobuf message google.cloud.aiplatform.v1.SpeculativeDecodingSpec
Namespace
Google \ Cloud \ AIPlatform \ V1Methods
__construct
Constructor.
Parameters
Name
Description
data
array
Optional. Data for populating the Message object.
↳ draft_model_speculation
↳ ngram_speculation
↳ speculative_token_count
int
The number of speculative tokens to generate at each step.
getDraftModelSpeculation
draft model speculation.
hasDraftModelSpeculation
setDraftModelSpeculation
draft model speculation.
Returns
Type
Description
$this
getNgramSpeculation
N-Gram speculation.
hasNgramSpeculation
setNgramSpeculation
N-Gram speculation.
Returns
Type
Description
$this
getSpeculativeTokenCount
The number of speculative tokens to generate at each step.
Returns
Type
Description
int
setSpeculativeTokenCount
The number of speculative tokens to generate at each step.
Parameter
Name
Description
var
int
Returns
Type
Description
$this
getSpeculation
Returns
Type
Description
string
