- 1.73.0 (latest)
- 1.72.0
- 1.71.1
- 1.70.0
- 1.69.0
- 1.68.0
- 1.67.1
- 1.66.0
- 1.65.0
- 1.63.0
- 1.62.0
- 1.60.0
- 1.59.0
- 1.58.0
- 1.57.0
- 1.56.0
- 1.55.0
- 1.54.1
- 1.53.0
- 1.52.0
- 1.51.0
- 1.50.0
- 1.49.0
- 1.48.0
- 1.47.0
- 1.46.0
- 1.45.0
- 1.44.0
- 1.43.0
- 1.39.0
- 1.38.1
- 1.37.0
- 1.36.4
- 1.35.0
- 1.34.0
- 1.33.1
- 1.32.0
- 1.31.1
- 1.30.1
- 1.29.0
- 1.28.1
- 1.27.1
- 1.26.1
- 1.25.0
- 1.24.1
- 1.23.0
- 1.22.1
- 1.21.0
- 1.20.0
- 1.19.1
- 1.18.3
- 1.17.1
- 1.16.1
- 1.15.1
- 1.14.0
- 1.13.1
- 1.12.1
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.1
- 1.7.1
- 1.6.2
- 1.5.0
- 1.4.3
- 1.3.0
- 1.2.0
- 1.1.1
- 1.0.1
- 0.9.0
- 0.8.0
- 0.7.1
- 0.6.0
- 0.5.1
- 0.4.0
- 0.3.1
EvaluatedAnnotation
(
mapping
=
None
,
*
,
ignore_unknown_fields
=
False
,
**
kwargs
)
True positive, false positive, or false negative.
EvaluatedAnnotation is only available under ModelEvaluationSlice
with slice of annotationSpec
dimension.
Attributes
type_
google.cloud.aiplatform_v1.types.EvaluatedAnnotation.EvaluatedAnnotationType
Output only. Type of the EvaluatedAnnotation.
predictions
MutableSequence[google.protobuf.struct_pb2.Value]
Output only. The model predicted annotations. For true positive, there is one and only one prediction, which matches the only one ground truth annotation in ground_truths . For false positive, there is one and only one prediction, which doesn't match any ground truth annotation of the corresponding
data_item_view_id][EvaluatedAnnotation.data_item_view_id]
.
For false negative, there are zero or more predictions which
are similar to the only ground truth annotation in ground_truths
but not enough for a match.
The schema of the prediction is stored in ModelEvaluation.annotation_schema_uri
ground_truths
MutableSequence[google.protobuf.struct_pb2.Value]
Output only. The ground truth Annotations, i.e. the Annotations that exist in the test data the Model is evaluated on. For true positive, there is one and only one ground truth annotation, which matches the only prediction in predictions . For false positive, there are zero or more ground truth annotations that are similar to the only prediction in predictions , but not enough for a match. For false negative, there is one and only one ground truth annotation, which doesn't match any predictions created by the model. The schema of the ground truth is stored in ModelEvaluation.annotation_schema_uri
data_item_payload
google.protobuf.struct_pb2.Value
Output only. The data item payload that the Model predicted this EvaluatedAnnotation on.
evaluated_data_item_view_id
str
Output only. ID of the EvaluatedDataItemView under the same ancestor ModelEvaluation. The EvaluatedDataItemView consists of all ground truths and predictions on data_item_payload .
explanations
MutableSequence[ google.cloud.aiplatform_v1.types.EvaluatedAnnotationExplanation
]
Explanations of predictions . Each element of the explanations indicates the explanation for one explanation Method. The attributions list in the EvaluatedAnnotationExplanation.explanation object corresponds to the predictions list. For example, the second element in the attributions list explains the second element in the predictions list.
error_analysis_annotations
MutableSequence[ google.cloud.aiplatform_v1.types.ErrorAnalysisAnnotation
]
Annotations of model error analysis results.
Classes
EvaluatedAnnotationType
EvaluatedAnnotationType
(
value
)
Describes the type of the EvaluatedAnnotation. The type is determined
Values: EVALUATED_ANNOTATION_TYPE_UNSPECIFIED (0): Invalid value. TRUE_POSITIVE (1): The EvaluatedAnnotation is a true positive. It has a prediction created by the Model and a ground truth Annotation which the prediction matches. FALSE_POSITIVE (2): The EvaluatedAnnotation is false positive. It has a prediction created by the Model which does not match any ground truth annotation. FALSE_NEGATIVE (3): The EvaluatedAnnotation is false negative. It has a ground truth annotation which is not matched by any of the model created predictions.
