Copilot Vision Lets AI See Your Windows 11 Screen and Guide You in Real Time

Microsoft has released Copilot Vision on Windows , a new AI tool that lets you share what's visible on your screen with the AI and talk to it simultaneously. Copilot can analyze what you see on your screen, answer your questions, and guide you as you work with different apps and tasks.

The system lets you share up to two apps or windows at a time, so Copilot can gain context from multiple sources and help you connect information across different platforms.

With the new Highlights feature, you can ask Copilot to help you with tasks by saying, "Show me how." Copilot will then indicate where to click and what steps to follow in an app. This makes it easier to learn new software or finish tasks you're not familiar with. Imagine being a first-time Photoshop user or using some complex video-editing tool with this superpower.

Activating Copilot Vision is fully optional. The company said you're in control of which windows to share and can stop at any time.

Copilot Vision on Windows is currently available for US-based users. The company expects to soon bring it to quite a few non-European countries.