This week, Microsoft is hosting its annual developer conference, Build, at the Seattle Convention Center. Amid a wave of AI-related announcements, one feature has raised concerns among tech industry followers on X (formerly Twitter).
A key highlight was the unveiling of new Microsoft Copilot+PCs—laptops and desktops featuring a revamped version of Windows with the AI assistant Copilot integrated into the operating system. This latest iteration of Copilot is powered by cutting-edge AI models, including the newly launched GPT-4o from Microsoft partner OpenAI.
However, the Recall feature has caught the attention of detractors. Recall records a user's screen activity on Copilot+PCs, tracking mouse movements and application actions—whether sending messages, checking email, or editing documents. It allows users to revisit past activities to retrieve specific details or interactions. Microsoft describes Recall as offering users a "photographic memory" of their PC experience:
“With Recall, you can access virtually everything you've seen or done on your PC. It organizes information based on unique relationships and associations, helping you quickly find what you remember by using familiar cues.”
The feature aims to help users easily return to specific emails in Outlook or chat threads in Teams.
Despite its potential applications, the idea of recording PC activity has raised alarms about privacy and security. In response, Microsoft has emphasized that data is stored locally in a “personal semantic index,” stating:
“Your snapshots remain on your PC. You can delete individual snapshots, adjust time ranges in Settings, or pause recording at any time via the System Tray icon. You can also prevent certain apps and websites from being recorded, ensuring you maintain control and trust in your privacy settings.”
A Microsoft spokesperson reiterated that the stored data is encrypted, never sent to the cloud, and not used for training AI models, stressing user control over the information.
Nonetheless, many users on X voiced their concerns, likening the feature to spyware or keyloggers that can capture sensitive information such as passwords. Some pointed out the risks associated with having even a copy of PC activity stored if the device were seized by a government agency or accessed by malicious actors.
Critics also highlighted Microsoft's history as the largest software company, which has experienced numerous hacks and cyber attacks, making this on-device activity storage an enticing target for hackers. Concerns about losing a device or it being stolen were prevalent, with users worried that sensitive information could be exposed through the Recall feature.
Even X owner Elon Musk chimed in, comparing the situation to a "Black Mirror" episode, referencing the dystopian series on Netflix.
The backlash poses questions about its impact on sales of Microsoft Copilot+PCs and whether users' concerns will translate into real issues or risks. Ideally, Microsoft will find a way to provide the benefits of Recall while ensuring user privacy and safety remain intact.