- 1.35.0 (latest)
- 1.34.0
- 1.33.0
- 1.32.1
- 1.31.0
- 1.30.0
- 1.26.0
- 1.23.0
- 1.22.0
- 1.21.0
- 1.20.0
- 1.19.0
- 1.18.0
- 1.17.0
- 1.16.0
- 1.15.0
- 1.14.0
- 1.13.1
- 1.12.0
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.0
- 1.7.0
- 1.6.0
- 1.5.0
- 1.4.0
- 1.3.0
- 1.2.0
- 1.1.0
- 1.0.0
- 0.39.0
- 0.38.0
- 0.37.1
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.2
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.13.0
- 0.12.0
- 0.11.1
- 0.10.0
Reference documentation and code samples for the Google Cloud Ai Platform V1 Client class EvaluateInstancesRequest.
Request message for EvaluationService.EvaluateInstances.
Generated from protobuf message google.cloud.aiplatform.v1.EvaluateInstancesRequest
Namespace
Google \ Cloud \ AIPlatform \ V1Methods
__construct
Constructor.
data
array
Optional. Data for populating the Message object.
↳ exact_match_input
↳ bleu_input
↳ rouge_input
↳ fluency_input
FluencyInput
LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
↳ coherence_input
↳ safety_input
↳ groundedness_input
↳ fulfillment_input
↳ summarization_quality_input
↳ pairwise_summarization_quality_input
↳ summarization_helpfulness_input
↳ summarization_verbosity_input
↳ question_answering_quality_input
↳ pairwise_question_answering_quality_input
↳ question_answering_relevance_input
↳ question_answering_helpfulness_input
↳ question_answering_correctness_input
↳ pointwise_metric_input
↳ pairwise_metric_input
↳ tool_call_valid_input
↳ tool_name_match_input
↳ tool_parameter_key_match_input
↳ tool_parameter_kv_match_input
↳ comet_input
↳ metricx_input
↳ location
string
Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}
getExactMatchInput
Auto metric instances.
Instances and metric spec for exact match metric.
hasExactMatchInput
setExactMatchInput
Auto metric instances.
Instances and metric spec for exact match metric.
$this
getBleuInput
Instances and metric spec for bleu metric.
hasBleuInput
setBleuInput
Instances and metric spec for bleu metric.
$this
getRougeInput
Instances and metric spec for rouge metric.
hasRougeInput
setRougeInput
Instances and metric spec for rouge metric.
$this
getFluencyInput
LLM-based metric instance.
General text generation metrics, applicable to other categories. Input for fluency metric.
hasFluencyInput
setFluencyInput
LLM-based metric instance.
General text generation metrics, applicable to other categories. Input for fluency metric.
$this
getCoherenceInput
Input for coherence metric.
hasCoherenceInput
setCoherenceInput
Input for coherence metric.
$this
getSafetyInput
Input for safety metric.
hasSafetyInput
setSafetyInput
Input for safety metric.
$this
getGroundednessInput
Input for groundedness metric.
hasGroundednessInput
setGroundednessInput
Input for groundedness metric.
$this
getFulfillmentInput
Input for fulfillment metric.
hasFulfillmentInput
setFulfillmentInput
Input for fulfillment metric.
$this
getSummarizationQualityInput
Input for summarization quality metric.
hasSummarizationQualityInput
setSummarizationQualityInput
Input for summarization quality metric.
$this
getPairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
hasPairwiseSummarizationQualityInput
setPairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
$this
getSummarizationHelpfulnessInput
Input for summarization helpfulness metric.
hasSummarizationHelpfulnessInput
setSummarizationHelpfulnessInput
Input for summarization helpfulness metric.
$this
getSummarizationVerbosityInput
Input for summarization verbosity metric.
hasSummarizationVerbosityInput
setSummarizationVerbosityInput
Input for summarization verbosity metric.
$this
getQuestionAnsweringQualityInput
Input for question answering quality metric.
hasQuestionAnsweringQualityInput
setQuestionAnsweringQualityInput
Input for question answering quality metric.
$this
getPairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
hasPairwiseQuestionAnsweringQualityInput
setPairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
$this
getQuestionAnsweringRelevanceInput
Input for question answering relevance metric.
hasQuestionAnsweringRelevanceInput
setQuestionAnsweringRelevanceInput
Input for question answering relevance metric.
$this
getQuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
hasQuestionAnsweringHelpfulnessInput
setQuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
$this
getQuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
hasQuestionAnsweringCorrectnessInput
setQuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
$this
getPointwiseMetricInput
Input for pointwise metric.
hasPointwiseMetricInput
setPointwiseMetricInput
Input for pointwise metric.
$this
getPairwiseMetricInput
Input for pairwise metric.
hasPairwiseMetricInput
setPairwiseMetricInput
Input for pairwise metric.
$this
getToolCallValidInput
Tool call metric instances.
Input for tool call valid metric.
hasToolCallValidInput
setToolCallValidInput
Tool call metric instances.
Input for tool call valid metric.
$this
getToolNameMatchInput
Input for tool name match metric.
hasToolNameMatchInput
setToolNameMatchInput
Input for tool name match metric.
$this
getToolParameterKeyMatchInput
Input for tool parameter key match metric.
hasToolParameterKeyMatchInput
setToolParameterKeyMatchInput
Input for tool parameter key match metric.
$this
getToolParameterKvMatchInput
Input for tool parameter key value match metric.
hasToolParameterKvMatchInput
setToolParameterKvMatchInput
Input for tool parameter key value match metric.
$this
getCometInput
Translation metrics.
Input for Comet metric.
hasCometInput
setCometInput
Translation metrics.
Input for Comet metric.
$this
getMetricxInput
Input for Metricx metric.
hasMetricxInput
setMetricxInput
Input for Metricx metric.
$this
getLocation
Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
string
setLocation
Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
var
string
$this
getMetricInputs
string
