The Verge - Artificial Intelligences 2024年10月01日
Microsoft is using AI to improve Windows search
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

微软在新Copilot Plus PC上使用AI模型大幅改进Windows搜索,增加类似谷歌Circle to Search的Click to Do功能等。改进后的搜索可更轻松查找图像、邮件等,11月起这些AI功能将陆续推出,还将在Windows Insider上进行测试。此外,微软还为Microsoft Paint增加生成填充和擦除功能,并提供多种订阅选项。

💻微软利用AI模型改进Windows搜索,使其能更轻松查找图片、邮件、文档、视频等,下月将在Copilot Plus PC的File Explorer中率先呈现,且后续会在主Windows搜索界面和设置界面的搜索框中推出。

🔍该改进搜索还可通过在设置搜索框中输入相关内容来找到正确设置。微软利用新Copilot Plus PC上的NPU芯片,实现OneDrive内容的本地搜索,无需联网。

✨下月起,微软将在Copilot Plus PC上推出与谷歌Circle to Search类似的Click to Do功能,通过按Windows键和鼠标左键,屏幕会出现互动覆盖层,可对图像、文本等进行操作,且具有上下文感知能力。

🎨微软为Microsoft Paint增加生成填充和擦除功能,这是新Windows AI功能的一部分。

Illustration by Alex Castro / The Verge

Microsoft is using AI models to greatly improve Windows search on its new Copilot Plus PCs, including the addition of a new Click to Do feature that’s very similar to Google’s Circle to Search. These search improvements will make it easier to find and interact with images, emails, documents, and even videos and are just a few of the AI-based features coming to Copilot Plus PCs starting in November.

The improved Windows search will first show up in File Explorer on Copilot Plus PCs next month, allowing you to search for pictures using words, even if the search word isn’t found in the photo or file name.

“AI-powered search makes it dramatically easier to find virtually anything,” says Yusuf Mehdi, executive vice president and consumer chief marketing officer at Microsoft. “You no longer need to remember file names and document locations, nor even specific names of words. Windows will better understand your intent and match the right document, image, file, or email.”

Image: Microsoft
Windows search improvements inside File Explorer.

This improved search will also be available “in the coming months” in the main Windows search interface and through the search box that appears in the Settings interface. You can type things like “add my headphones” into the Settings search box and it will help you find the right settings.

Search hasn’t been great in Windows for years, so this AI-powered natural language search should greatly improve things — as long as it works as well as Microsoft promises. Microsoft is leveraging the NPU chips on new Copilot Plus PCs to enable local search on OneDrive content without having to be connected to the internet.

Alongside Windows search, Microsoft will also start rolling out Click to Do on Copilot Plus PCs next month, which is very similar to Google’s Circle to Search feature. With Click to Do, you hit the Windows key on a keyboard and left-click on a mouse to see an interactive overlay appear on your screen, which lets you select images or text to perform clickable actions.

“Click to Do works by first understanding everything you’ve seen on your screen and enabling useful shortcuts to actions to help you more quickly search, learn, edit, shop, or act on those items,” explains Mehdi. “It works on any windows, document, image, or even video.”

Image: Microsoft
The new Click to Do feature.

You can use Click to Do on things like a YouTube video you’re watching to do a visual search on an item that appears in the video using Bing. Click to Do is also context-aware, so it can help with text-related actions like rewriting or summarizing documents or explaining text and sending emails.

Microsoft will start testing these new search and Click to Do features with Windows Insiders on Copilot Plus PCs in October, followed by a gradual rollout in November. The previously announced Recall feature is also coming to testers in October on Qualcomm-powered devices, before being available to Windows Insiders on Intel- or AMD-powered Copilot Plus PCs in November. Microsoft says “timing details on the broad availability of Recall will be shared soon.”

Microsoft is also adding generative fill and erase to Microsoft Paint as part of these new Windows AI features. You can read more about the Paint and Photos AI additions right here.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

微软 Windows搜索 Click to Do AI功能
相关文章