Full name: projects.locations.evaluateDataset
Evaluates a dataset based on a set of given metrics.
Endpoint
posthttps:
Where {service-endpoint}
is one of the supported service endpoints
.
Path parameters
location
string
Required. The resource name of the Location to evaluate the dataset. Format: projects/{project}/locations/{location}
Request body
The request body contains data with the following structure:
dataset
object ( EvaluationDataset
)
Required. The dataset used for evaluation.
metrics[]
object ( Metric
)
Required. The metrics used for evaluation.
outputConfig
object ( OutputConfig
)
Required. Config for evaluation output.
autoraterConfig
object ( AutoraterConfig
)
Optional. Autorater config used for evaluation. Currently only publisher Gemini models are supported. Format: projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}.
Response body
If successful, the response body contains an instance of Operation
.
