Today, Microsoft is launching Copilot Vision for Windows, an extension of its artificial intelligence assistant that lets you share your screen or apps so Copilot can do things like teach you how to use Adobe Photoshop features or analyze the photos and web pages you’re viewing.
“When you turn on this feature, Copilot Vision can see what you see and talk to you about it in real time,” says the Copilot team. “It acts as your second pair of eyes, able to analyze content, help you when you’re lost, provide ideas, and answer your questions as you go.”
Microsoft first started testing Copilot Vision on Windows earlier this year, and now it’s launching for free in the US for Windows 10 and Windows 11 users. A subscription to Copilot Pro is no longer required, but it is still part of Microsoft’s experimental artificial intelligence initiatives at Copilot Labs.
Copilot Vision for Windows works within the Copilot app and is activated by a glasses icon that lets you select the browser window or app you want to share with the AI, just like you would share your screen or apps in a Microsoft Teams meeting. This is an optional feature where you need to specifically share your apps for Copilot Vision to work; it’s not like Recall, which constantly takes screenshots of your screen when it’s enabled.
I wasn’t able to fully test Copilot Vision on Windows because Microsoft is limiting the experience to the U.S., but I was able to briefly work with it at Microsoft’s 50th anniversary event in April. Once you share the program, Copilot can highlight parts of the screen to help you and answer questions. You can also use Copilot Vision on iOS and Android.
