Reference documentation and code samples for the Google Cloud Ai Platform V1 Client class EvaluateInstancesRequest.
Request message for EvaluationService.EvaluateInstances.
Generated from protobuf message google.cloud.aiplatform.v1.EvaluateInstancesRequest
Namespace
Google \ Cloud \ AIPlatform \ V1Methods
__construct
Constructor.
data
array
Optional. Data for populating the Message object.
↳ exact_match_input
↳ bleu_input
↳ rouge_input
↳ fluency_input
FluencyInput
LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.
↳ coherence_input
↳ safety_input
↳ groundedness_input
↳ fulfillment_input
↳ summarization_quality_input
↳ pairwise_summarization_quality_input
↳ summarization_helpfulness_input
↳ summarization_verbosity_input
↳ question_answering_quality_input
↳ pairwise_question_answering_quality_input
↳ question_answering_relevance_input
↳ question_answering_helpfulness_input
↳ question_answering_correctness_input
↳ pointwise_metric_input
↳ pairwise_metric_input
↳ tool_call_valid_input
↳ tool_name_match_input
↳ tool_parameter_key_match_input
↳ tool_parameter_kv_match_input
↳ comet_input
↳ metricx_input
↳ location
string
Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}
getExactMatchInput
Auto metric instances.
Instances and metric spec for exact match metric.
hasExactMatchInput
setExactMatchInput
Auto metric instances.
Instances and metric spec for exact match metric.
$this
getBleuInput
Instances and metric spec for bleu metric.
hasBleuInput
setBleuInput
Instances and metric spec for bleu metric.
$this
getRougeInput
Instances and metric spec for rouge metric.
hasRougeInput
setRougeInput
Instances and metric spec for rouge metric.
$this
getFluencyInput
LLM-based metric instance.
General text generation metrics, applicable to other categories. Input for fluency metric.
hasFluencyInput
setFluencyInput
LLM-based metric instance.
General text generation metrics, applicable to other categories. Input for fluency metric.
$this
getCoherenceInput
Input for coherence metric.
hasCoherenceInput
setCoherenceInput
Input for coherence metric.
$this
getSafetyInput
Input for safety metric.
hasSafetyInput
setSafetyInput
Input for safety metric.
$this
getGroundednessInput
Input for groundedness metric.
hasGroundednessInput
setGroundednessInput
Input for groundedness metric.
$this
getFulfillmentInput
Input for fulfillment metric.
hasFulfillmentInput
setFulfillmentInput
Input for fulfillment metric.
$this
getSummarizationQualityInput
Input for summarization quality metric.
hasSummarizationQualityInput
setSummarizationQualityInput
Input for summarization quality metric.
$this
getPairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
hasPairwiseSummarizationQualityInput
setPairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
$this
getSummarizationHelpfulnessInput
Input for summarization helpfulness metric.
hasSummarizationHelpfulnessInput
setSummarizationHelpfulnessInput
Input for summarization helpfulness metric.
$this
getSummarizationVerbosityInput
Input for summarization verbosity metric.
hasSummarizationVerbosityInput
setSummarizationVerbosityInput
Input for summarization verbosity metric.
$this
getQuestionAnsweringQualityInput
Input for question answering quality metric.
hasQuestionAnsweringQualityInput
setQuestionAnsweringQualityInput
Input for question answering quality metric.
$this
getPairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
hasPairwiseQuestionAnsweringQualityInput
setPairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
$this
getQuestionAnsweringRelevanceInput
Input for question answering relevance metric.
hasQuestionAnsweringRelevanceInput
setQuestionAnsweringRelevanceInput
Input for question answering relevance metric.
$this
getQuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
hasQuestionAnsweringHelpfulnessInput
setQuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
$this
getQuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
hasQuestionAnsweringCorrectnessInput
setQuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
$this
getPointwiseMetricInput
Input for pointwise metric.
hasPointwiseMetricInput
setPointwiseMetricInput
Input for pointwise metric.
$this
getPairwiseMetricInput
Input for pairwise metric.
hasPairwiseMetricInput
setPairwiseMetricInput
Input for pairwise metric.
$this
getToolCallValidInput
Tool call metric instances.
Input for tool call valid metric.
hasToolCallValidInput
setToolCallValidInput
Tool call metric instances.
Input for tool call valid metric.
$this
getToolNameMatchInput
Input for tool name match metric.
hasToolNameMatchInput
setToolNameMatchInput
Input for tool name match metric.
$this
getToolParameterKeyMatchInput
Input for tool parameter key match metric.
hasToolParameterKeyMatchInput
setToolParameterKeyMatchInput
Input for tool parameter key match metric.
$this
getToolParameterKvMatchInput
Input for tool parameter key value match metric.
hasToolParameterKvMatchInput
setToolParameterKvMatchInput
Input for tool parameter key value match metric.
$this
getCometInput
Translation metrics.
Input for Comet metric.
hasCometInput
setCometInput
Translation metrics.
Input for Comet metric.
$this
getMetricxInput
Input for Metricx metric.
hasMetricxInput
setMetricxInput
Input for Metricx metric.
$this
getLocation
Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
string
setLocation
Required. The resource name of the Location to evaluate the instances.
Format: projects/{project}/locations/{location}
var
string
$this
getMetricInputs
string
