Console
    Contact Us Start free

    REST Resource: projects.locations.modelMonitors

    Resource: ModelMonitor

    Vertex AI Model Monitoring service serves as a central hub for the analysis and visualization of data quality and performance related to models. ModelMonitor stands as a top level resource for overseeing your model monitoring tasks.

    Fields
    name string

    Immutable. Resource name of the ModelMonitor. Format: projects/{project}/locations/{location}/modelMonitors/{modelMonitor} .

    displayName string

    The display name of the ModelMonitor. The name can be up to 128 characters long and can consist of any UTF-8.

    modelMonitoringTarget object ( ModelMonitoringTarget )

    The entity that is subject to analysis. Currently only models in Vertex AI Model Registry are supported. If you want to analyze the model which is outside the Vertex AI, you could register a model in Vertex AI Model Registry using just a display name.

    trainingDataset object ( ModelMonitoringInput )

    Optional training dataset used to train the model. It can serve as a reference dataset to identify changes in production.

    notificationSpec object ( ModelMonitoringNotificationSpec )

    Optional default notification spec, it can be overridden in the ModelMonitoringJob notification spec.

    outputSpec object ( ModelMonitoringOutputSpec )

    Optional default monitoring metrics/logs export spec, it can be overridden in the ModelMonitoringJob output spec. If not specified, a default Google Cloud Storage bucket will be created under your project.

    explanationSpec object ( ExplanationSpec )

    Optional model explanation spec. It is used for feature attribution monitoring.

    modelMonitoringSchema object ( ModelMonitoringSchema )

    Monitoring Schema is to specify the model's features, prediction outputs and ground truth properties. It is used to extract pertinent data from the dataset and to process features based on their properties. Make sure that the schema aligns with your dataset, if it does not, we will be unable to extract data from the dataset. It is required for most models, but optional for Vertex AI AutoML Tables unless the schem information is not available.

    encryptionSpec object ( EncryptionSpec )

    Customer-managed encryption key spec for a ModelMonitor. If set, this ModelMonitor and all sub-resources of this ModelMonitor will be secured by this key.

    createTime string ( Timestamp format)

    Output only. timestamp when this ModelMonitor was created.

    Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z" , "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30" .

    updateTime string ( Timestamp format)

    Output only. timestamp when this ModelMonitor was updated most recently.

    Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: "2014-10-02T15:01:23Z" , "2014-10-02T15:01:23.045123456Z" or "2014-10-02T15:01:23+05:30" .

    satisfiesPzs boolean

    Output only. reserved for future use.

    satisfiesPzi boolean

    Output only. reserved for future use.

    default_objective Union type
    Optional default monitoring objective, it can be overridden in the ModelMonitoringJob objective spec. default_objective can be only one of the following:
    tabularObjective object ( TabularObjective )

    Optional default tabular model monitoring objective.

    JSON representation 
     { 
 "name" 
 : 
 string 
 , 
 "displayName" 
 : 
 string 
 , 
 "modelMonitoringTarget" 
 : 
 { 
 object (  ModelMonitoringTarget 
 
) 
 } 
 , 
 "trainingDataset" 
 : 
 { 
 object (  ModelMonitoringInput 
 
) 
 } 
 , 
 "notificationSpec" 
 : 
 { 
 object (  ModelMonitoringNotificationSpec 
 
) 
 } 
 , 
 "outputSpec" 
 : 
 { 
 object (  ModelMonitoringOutputSpec 
 
) 
 } 
 , 
 "explanationSpec" 
 : 
 { 
 object (  ExplanationSpec 
 
) 
 } 
 , 
 "modelMonitoringSchema" 
 : 
 { 
 object (  ModelMonitoringSchema 
 
) 
 } 
 , 
 "encryptionSpec" 
 : 
 { 
 object (  EncryptionSpec 
 
) 
 } 
 , 
 "createTime" 
 : 
 string 
 , 
 "updateTime" 
 : 
 string 
 , 
 "satisfiesPzs" 
 : 
 boolean 
 , 
 "satisfiesPzi" 
 : 
 boolean 
 , 
 // default_objective 
 "tabularObjective" 
 : 
 { 
 object (  TabularObjective 
 
) 
 } 
 // Union type 
 }

    ModelMonitoringTarget

    The monitoring target refers to the entity that is subject to analysis. e.g. Vertex AI Model version.

    Fields
    source Union type
    source can be only one of the following:
    vertexModel object ( VertexModelSource )

    Model in Vertex AI Model Registry.

    JSON representation 
     { 
 // source 
 "vertexModel" 
 : 
 { 
 object (  VertexModelSource 
 
) 
 } 
 // Union type 
 }

    VertexModelSource

    Model in Vertex AI Model Registry.

    Fields
    model string

    Model resource name. Format: projects/{project}/locations/{location}/models/{model}.

    modelVersionId string

    Model version id.

    JSON representation 
     { 
 "model" 
 : 
 string 
 , 
 "modelVersionId" 
 : 
 string 
 }

    ModelMonitoringSchema

    The Model Monitoring Schema definition.

    Fields
    featureFields[] object ( FieldSchema )

    feature names of the model. Vertex AI will try to match the features from your dataset as follows: * For 'csv' files, the header names are required, and we will extract the corresponding feature values when the header names align with the feature names. * For 'jsonl' files, we will extract the corresponding feature values if the key names match the feature names. Note: Nested features are not supported, so please ensure your features are flattened. Ensure the feature values are scalar or an array of scalars. * For 'bigquery' dataset, we will extract the corresponding feature values if the column names match the feature names. Note: The column type can be a scalar or an array of scalars. STRUCT or JSON types are not supported. You may use SQL queries to select or aggregate the relevant features from your original table. However, ensure that the 'schema' of the query results meets our requirements. * For the Vertex AI Endpoint Request Response Logging table or Vertex AI Batch Prediction Job results. If the instanceType is an array, ensure that the sequence in featureFields matches the order of features in the prediction instance. We will match the feature with the array in the order specified in [featureFields].

    predictionFields[] object ( FieldSchema )

    Prediction output names of the model. The requirements are the same as the featureFields . For AutoML Tables, the prediction output name presented in schema will be: predicted_{targetColumn} , the targetColumn is the one you specified when you train the model. For Prediction output drift analysis: * AutoML Classification, the distribution of the argmax label will be analyzed. * AutoML Regression, the distribution of the value will be analyzed.

    groundTruthFields[] object ( FieldSchema )

    Target /ground truth names of the model.

    JSON representation 
     { 
 "featureFields" 
 : 
 [ 
 { 
 object (  FieldSchema 
 
) 
 } 
 ] 
 , 
 "predictionFields" 
 : 
 [ 
 { 
 object (  FieldSchema 
 
) 
 } 
 ] 
 , 
 "groundTruthFields" 
 : 
 [ 
 { 
 object (  FieldSchema 
 
) 
 } 
 ] 
 }

    FieldSchema

    Schema field definition.

    Fields
    name string

    Field name.

    dataType string

    Supported data types are: float integer boolean string categorical

    repeated boolean

    Describes if the schema field is an array of given data type.

    JSON representation 
     { 
 "name" 
 : 
 string 
 , 
 "dataType" 
 : 
 string 
 , 
 "repeated" 
 : 
 boolean 
 }

    Methods

    create

    		Creates a ModelMonitor.

    delete

    		Deletes a ModelMonitor.

    get

    		Gets a ModelMonitor.

    list

    		Lists ModelMonitors in a Location.

    patch

    		Updates a ModelMonitor.

    searchModelMonitoringAlerts

    		Returns the Model Monitoring alerts.

    searchModelMonitoringStats

    		Searches Model Monitoring Stats generated within a given time window.
    Design a Mobile Site
    View Site in Mobile | Classic
    Share by: