When you open the Gemini mobile app over some apps, videos, or files, screen actions appear. These are shortcuts to start conversations and tasks using content, including screenshots, PDFs, and URLs from your screen.
Get started
To get started, use gestures or say “Hey Google” to open Gemini over a webpage or app, like YouTube. Suggestion chips will appear above the Gemini chat box when they’re available. When you tap on a suggestion chip, Gemini may ask for more info before sending your chat.
When you tap on a suggestion, Gemini will upload the info on your screen or in the file for context. These suggestions include things like:
- Ask about… helps you ask about the screen, file, or a webpage you’re looking at.
Turn auto-submit on or off
All screen actions except “Ask about…” will automatically submit the content on your screen to Gemini when you tap them.
To turn off auto-submit, you can press and hold on a suggestion chip then tap Turn off auto-submit. To enable auto-submit, you can press and hold on the “Ask about…” chip then tap Turn on auto-submit.
Let Gemini infer when to use your screen context
Important:This feature is only available when you use Gemini in Arabic, Chinese, English, French, German, Hindi, Italian, Japanese, Korean, Portuguese (Brazil), and Spanish.
When Intelligent Screen Context is on, Gemini can infer when it should use what's currently visible on your screen as context for a chat conversation. For example, if you say or type “what’s the image on my screen?” with Intelligent Screen Context on, Gemini automatically checks your screen to give you relevant answers.
To turn Intelligent Screen Context on or off:
- On your Android phone or tablet, open the Gemini mobile app
.
- Tap your Profile pictureor Initial
Settings
- Turn Use text from screenand Use screenshoton
or off
.
