Global fintech and funding innovation ecosystem

Microsoft to Launch Controversial Recall Feature

Data Privacy | Aug 26, 2024

Freepik rawpixel.com, privacy

Image: Freepik/rawpixel.com

Microsoft's new Windows Recall AI Faces Backlash Over Privacy Risks

Windows is launching Recall, a controversial AI feature to Windows Insiders this October 2024, that hopes to improve productivity by capturing the entire screen of a user's device in seconds-by-second screenshots including chat histories, web pages, files, and all user activities across multiple devices.

See:  Good, Bad, and Ugly of Project Strawberry’s Capabilities

While the data is to be encrypted using BitLocker and stored locally so that it isn't uploaded accidentally or transferred anywhere online, critics argue that Recall infringes on privacy as it captures sensitive information such as passwords, bank account details and private chats which can fall into the wrong hands.  What if malware penetrates your local machine, hackers could access/modify such screenshots or create new vulnerabilities resulting in a privacy nightmare.

Benefits

Among the handful of benefits, Recall is supposed to improve productivity as users can search for past content and work activity easier.  Instead of manually hunting for past documents, they can simply key in prompts like 'cybersecurity presentation I worked on last month' and get immediate results, thus saving time.

See:  Small Language Models Prioritize Privacy and Efficiency

Recall also supports voice search, so a hands-free environment.  It also integrates well with aligned apps and browsers potentially improving the overall user experience by providing easy access to past content and flows.

Unintended Consequences?

  • Companies might use an AI feature like Recall for employee surveillance to monitor activity at the workplace.
  • With vast amounts of sensitive user data at risk, it's a natural target for hackers to try and exploit.  It's kind of like having an expensive car in your driveway that's asking for robbers to steal it.
  • Many feel uncomfortable knowing that every move they make is digitally recorded (even despite Microsoft's claims that it's encrypted, and stored/analyzed locally).  Experts warn of physical access breaches.

When is the public release?

Recall's public release was originally postponed due to widespread concerns but Windows Insiders will be able to access it this October 2024 and wider distribution is expected thereafter.  Initially, it will only work on devices with certain AI ready hardware.

See:  5 Billion Profiles: Class Action Lawsuit Accuses Oracle of Privacy Breach and “Global Surveillance”

Outlook

The balance between improving productivity and ensuring data security will determine the feature’s success or failure.  We anticipate this AI feature to be full of conflicts and the risk to outweigh the benefits.


NCFA Jan 2018 resizeThe National Crowdfunding & Fintech Association (NCFA Canada) is a financial innovation ecosystem that provides education, market intelligence, industry stewardship, networking and funding opportunities and services to thousands of community members and works closely with industry, government, partners and affiliates to create a vibrant and innovative fintech and funding industry in Canada. Decentralized and distributed, NCFA is engaged with global stakeholders and helps incubate projects and investment in fintech, alternative finance, crowdfunding, peer-to-peer finance, payments, digital assets and tokens, artificial intelligence, blockchain, cryptocurrency, regtech, and insurtech sectors. Join Canada's Fintech & Funding Community today FREE! Or become a contributing member and get perks. For more information, please visit: www.ncfacanada.org

NCFA Financial Innovation MapNCFA Innovation Opportunity BriefsNCFA Fintech Insights
NCFA Fintech WhispererNCFA Fintech Fridays PodcastNCFA Weekly Newsletter

 

Leave a Reply

Your email address will not be published. Required fields are marked *