Microsoft Harnesses AI to Enhance Windows Search Functionality

Microsoft is enhancing Windows search on its new Copilot Plus PCs with AI models, introducing features like Click to Do, which mirrors Google’s Circle to Search. These updates improve the ability to locate and engage with content such as images, emails, documents, and videos. The AI-based enhancements will begin rolling out in November.

The revamped search will initially be implemented in File Explorer, enabling users to search for images using descriptive words, even if these words aren’t part of the file name. Yusuf Mehdi, Microsoft's executive vice president and consumer chief marketing officer, notes, “AI-powered search makes it dramatically easier to find virtually anything. You no longer need to remember file names and document locations. Windows will better understand your intent and match the right document, image, file, or email.”

This improved search functionality will also be integrated into the main Windows search interface and the Settings search box in the forthcoming months. For example, typing “add my headphones” in the Settings search box will direct you to the appropriate settings. Upgraded natural language search aims to address long-standing issues with Windows search.

Additionally, Microsoft is leveraging NPU chips on Copilot Plus PCs to facilitate local searches on OneDrive content, eliminating the need for internet connectivity.

The Click to Do feature will launch alongside these search improvements. By pressing the Windows key and clicking the mouse, users can access an interactive overlay that allows them to select images or text for quick actions. Mehdi explains, “Click to Do works by understanding everything you’ve seen on your screen and enabling useful shortcuts to help you more quickly search, learn, edit, shop, or act on those items.” This feature supports a range of actions, like conducting visual searches on YouTube videos and assisting with text-related tasks such as document rewriting or email drafting.

These new features will be tested with Windows Insiders in October, with a broader rollout planned for November. Additionally, Microsoft is introducing generative fill and erase tools to Microsoft Paint, further enhancing the suite of Windows AI features.