Windows Search is getting smarter, while a new Click to Do tool enables AI-assisted actions based on what's on a user's screen.
Microsoft on Tuesday unveiled the latest AI features for Copilot+ PCs, with improved Windows search and a tool that can detect and act on the contents of a user's screen.
Click to Do places an interactive overlay on a PC's desktop screen and provides suggested actions for ways to interact with text and images. This could mean running a "visual search" of an image in Microsoft's Bing search engine, for instance, or summarizing selected text on a webpage.
"Click to Do works by first understanding everything you've seen on your screen, then enabling useful shortcuts to actions that help you more quickly search, learn, edit, shop, or act on those items," Yusuf Mehdi, Microsoft's corporate vice president and consumer chief marketing officer, explained in a pre-recorded press briefing ahead of the announcement. "It works on any window, document, image or even video."