Analyze your AI spend with the AI Cost Summary Agent

Use Gemini to analyze your AI costs and gain critical insights into your AI-related spend. The AI Cost Summary Agentanalyzes spending related to Gemini usage, including Gemini API and Vertex AI.

This agent proactively scans your entire AI footprint (pulling data from the relevant sources) to pinpoint the exact drivers of costs and cost changes, and provides useful next steps. This helps reduce the work necessary to understand cost trends and what changes drove your spend.

Permissions required to use the AI Cost Summary Agent

To use the AI Cost Summary widget, you need a role that includes the following permissions on the Cloud Billing account:

• billing.anomalies.list
• billing.billingAccountPrices.list
• billing.billingAccountServices.list
• billing.billingAccountSkus.list

To gain these permissions using a predefined role, ask your administrator to grant you one of the following Cloud Billing IAM role on your Cloud Billing account:

• Billing Account Viewer
• Billing Account Administrator

Analyze your AI spend

The AI Cost Summary Agent is presented as a widget on the Billing Overviewpage for your Cloud Billing account. To use the AI Cost Summary Agent, complete the following steps:

1. In the Google Cloud console, go to the Billing Overviewpage for your Cloud Billing account.

   Go to your Cloud Billing account

2. At the prompt, choose the Cloud Billing account for which you'd like to analyze your AI spend. The Billing Overviewpage opens for the selected billing account.

3. Locate the Your AI Spendwidget.

4. Type your question about your costs into the input field. For examples, see Example questions .

5. The widget begins analyzing your AI-related costs and presents you with a summary of the results. This analysis can take approximately 45 seconds.

6. You can either review the results of that analysis or ask the agent a specific follow-up questions about your AI-related spend (for example, how to reduce costs, or to investigate cost drivers).

Example questions

You can ask the agent questions such as:

• "Tell me about my AI costs for the past 30 days."
• "I see a Vertex AI cost spike on Feb 3, what caused this?"
• "What are my top 3 cost drivers right now across all my AI projects?"
• "Did I have any anomalies in my spend over the past month? What caused it?"
• "Break down my total spend by API Key so I can see which integration is expensive."

Limitations

• Scope:You can't ask the LLM about costs unrelated to AI services.
• Accuracy:Gemini can make mistakes. Always double-check responses and verify the insights and recommendations before making significant financial or architectural changes.