Windows preview build teases searching your audio and video content — 'intelligent media search' referenced in newest build

News
By
published

References to the tool arrive through the Canary Channel.

Windows 11
(Image credit: Tom's Hardware)

Windows 11 Insider Canary Channel build 27695 references a new "intelligent media search" function, which may come to Windows soon. The function will make words in your local audio files and videos searchable thanks to a local AI model. In some ways this function is reminiscent of Recall, the controversial feature set to return to Windows Insider builds in October.

Intelligent media search is described as a tool that transcribes all audio files and videos on a Windows PC and will make those spoken words searchable through Windows. Think of a recorded meeting you need to get information from or an audiobook you need to find your lost place in. The tool is not currently available in any builds, but references to it have been added, presumably in preparation for its arrival.

Build 27695, which rolled out to Insider program members on August 30th, contains dev notes referencing the intelligent media search function. @XenoPanther on X (formerly Twitter) first found references to the new tool. The full description of the feature is as follows.

"Search by spoken words in your indexed video or audio files. By clicking 'I agree,' you consent to scanning the media files on your device. If needed, the required model will be downloaded and installed in the background. 

Once the AI model is set up, it needs to transcribe your media files and index them before enabling content-based search. We'll inform you once the process is complete."

Microsoft has so far not addressed the new feature publicly. Its purported functionality seems like a close relation to Recall, the currently postponed feature that would log images of user activity every few seconds and make everything seen on your computer easily searchable. Recall was postponed over widespread privacy concerns, but will be returning to Insider builds in October, with no news on its privacy updates expected until its release.

Recall requires a Windows Copilot+ compatible PC with an NPU of at least 45 TOPS and anywhere between 25GB and 150GB of storage space. It is so far unknown whether intelligent media search — also based on AI models — will carry the same requirements for prospective users. 

TOPICS
Dallin Grimm
Dallin Grimm
Contributing Writer

Dallin Grimm is a contributing writer for Tom's Hardware. He has been building and breaking computers since 2017, serving as the resident youngster at Tom's. From APUs to RGB, Dallin has a handle on all the latest tech news. 

26 Comments Comment from the forums
  • Dr3ams
    I know exactly where all my media files are. I meticulously categorize them in folders and subfolders, so I don't need Microsoft's bloodhound on my computer. You never know what hackers and agenda driven authorties could use that for.
    Reply
  • umeng2002_2
    Another feature no one but MS wants. Probably just for data value.
    Reply
  • ezst036
    This is truly evil and despicable.

    Microsoft has spent a few years now transforming Windows OS into an advertisement platform so that Microsoft can (even paying customers!) monetize the users and create more money. It's super self-serving.

    Now, Microsoft feigns this angelic "oh you can search your music, oh your videos" but let's not kid ourselves here. This is so Microsoft can scan your files and get a better idea of who you are, and target even further those advertisements.

    What a grotesque, disgusting racket.

    That's exactly what this is about. Just follow the money. You can always find the answer if you follow the money.

    It's just like Recall. They only want to scan so they can increase their ad revenue. It's ad placement and everybody knows it.
    Reply
  • ThomasKinsley
    It's actually a really neat idea, but the privacy and security risks are apparent. It's a shame that Windows is known for being an insecure platform. These tools would otherwise be useful.
    Reply
  • Findecanor
    I don't trust Microsoft with keeping that data secure.

    I don't even trust them not to take it for themselves for various nefarious purposes.
    Reply
  • Sleepy_Hollowed
    This is completely unnecessary and can be tackled with metadata on the right media format (closed captions, which can be searched, chapters with titles, title of the video as well as tags).

    Thanks, but no thanks.
    Reply
  • brandonjclark
    *edit for posterity
    Reply
  • Giroro
    So they're going to scrape all your files, presumably to mine data and train their AI.

    I guess that's one way to dodge copyright law, force users to waive their rights, and avoid paying creators and the platforms they use to license that content.

    Did you know that every time you log into Windows, you're also consenting to an arbitration agreement? So good luck suing them over this, Taylor Swift.
    Reply
  • usertests
    It keeps getting worse. If you're complaining, time to switch to Linux, or back to Windows 10 while it's still supported, or maybe a stripped down version like Tiny11.
    Reply
  • m3city
    Contrary to most of the comments, I'd say I like it. And I'm generally against ai, but in this case I think it actually might be useful. Not everyone has an OCD syndrome and categorize everything. If a locally trained ai indexes my files then I'm ok with that. If ms takes this training data then ok again, what are they gonna do with it? Let's wait for EULA.
    Reply