As outlined in Section 4.3 "Generative AI Safety and Abuse" of Google Cloud Platform Terms of Service , Google uses the following process to detect potential abuse and violations of its Acceptable Use Policy and Prohibited Use Policy as part of providing Generative AI Services to customers.
-
Automated detection: Google uses automated safety classifiers to detect potential abuse and violations. For technical details on how safety classifiers work, see Configure safety filters .
-
Prompt logging: If automated safety classifiers detect suspicious activity that requires further investigation into whether a customer has violated our policies, then Google may log customer prompts solely for the purpose of examining whether a violation of the AUP or Prohibited Use Policy has occurred. This data won't be used to train or fine-tune any AI/ML models. This data is stored securely for up to 90 days in the same region or multi-region selected by the customer for their project and adheres to Google Cloud assurances, such as Data Residency, Access Transparency and VPC Service Controls. Prompt logs for the purposes of abuse monitoring are not encrypted by Customer-managed encryption keys (CMEK). Customers also have the option to request an opt-out from abuse logging (see below).
-
Action: Authorized Google employees may assess the flagged prompts and may reach out to the customer for clarification. Failure to address the behavior—or recurring or severe abuse—may result in suspension or termination of the customer's access to Gemini Enterprise Agent Platform or Google Cloud services.
-
Services in scope: Google's Generative AI Services.
-
Customers in scope: Only customers whose use of Google Cloud is governed by the Google Cloud Platform Terms of Service . This means that customers with a Google Cloud Master Agreement are exempt from prompt logging for this abuse monitoring by default.
-
Customer opt-out: Customers may request for an exception by filling out this form . If approved, Google won't store any prompts associated with the approved Google Cloud account.
Advanced AI safety
As outlined in the Advanced AI Safety Addendum , Google Cloud has implemented a more rigorous abuse monitoring system for models designated as "Advanced AI".
-
Prompt and response logging: All prompts and responses will be logged and securely stored for up to 30 days for the sole purpose of monitoring for abuse. This data won't be used to train or fine-tune any AI/ML models. This data is stored in the same region or multi-region selected by the customer for their project and adheres to Google Cloud assurances, such as Data Residency, Access Transparency and VPC Service Controls. Prompt and response logs for the purposes of abuse monitoring are not encrypted by Customer-managed encryption keys (CMEK). It may not be possible to opt-out of prompt-response logging when using some Advanced AI features. Please contact your account team for clarification.
-
Automated investigation: Google deploys automated investigative tools, including safety classifiers, to analyze logged data and detect potential abuse and violations.
-
Action: Authorized Google employees may assess the flagged prompts and may reach out to the customer for clarification. Failure to address the behavior—or recurring or severe abuse—may result in suspension or termination of the customer's access to Gemini Enterprise Agent Platform or Google Cloud services.
-
Services in scope: Models and features designated as "Advanced AI", including:
- Claude Mythos (all versions)
- Claude Fable (all versions)
- Claude Opus >=4.7 when used for high risk dual use or prohibited use cases covered under Anthropic's Cyber Verification Program
-
Customer opt-out: Zero data retention may not be possible when using some Advanced AI features. Please contact your account team for clarification. See the following section on how to govern acceptance of the addendum.
Consent to the Advanced AI Safety Addendum
Consent to the Advanced AI Safety Addendum is required once per project before Advanced AI models can be enabled in that project. Consent is performed in Model Garden through the Google Cloud console before enabling any Advanced AI model.
Consenting users must acknowledge that they are acting on behalf of their
organization and possess the requisite authority to bind the customer to the
obligations of the addendum. In order to consent, a user must have the aiplatform.consents.update
permission which is included in the aiplatform.admin
role.
Govern the Advanced AI Safety Addendum
To prevent your users from consenting to this addendum admins can:
- Enforce least privileges in IAM
for the
aiplatform.consents.updatepermission. - Disable access to Model Garden models included in the Advanced AI Safety Addendum scope.
Partner-specific terms
Use of partner models on Gemini Enterprise Agent Platform is subject to partner-specific terms.
Anthropic
Use of Anthropic models on Gemini Enterprise Agent Platform is governed by Anthropic's Commercial Terms of Service or other applicable agreement with Anthropic, with use of Anthropic Advanced AI governed by Section F of Anthropic's Service Specific Terms . The abuse monitoring systems described on this page are used to ensure adherence to these terms.
Data retention
For Anthropic Claude Fable 5 and Mythos 5, prompts and responses are retained for up to 30 days. To use Claude Fable 5 and Mythos 5, as required by Anthropic, you must enable sharing this data with Anthropic for abuse monitoring.
What's next
- Learn about Responsible AI .
