I asked Microsoft Copilot to write a song about Copilot+ Recall.
Managed to find out how BBC News printed in a headline story that it was not possible to steal Recall data without being physically at the device (which is false) - this is from the journalist:

Some screenshots of Recall's SQLite database here: https://mastodon.social/@detective/112513529733646088

Just to clarify, I can access it without SYSTEM too. Microsoft are about to set cybersecurity back a decade by empowering cyber criminals via poor AI safety. Feature ships in a few weeks.

The latest Risky Business episode on Recall is good, but one small correction - it doesn’t need SYSTEM rights.

Here’s a video of two MSFT employees gaining access to the Recall database folder - with SQLite database right there. Watch their hacking skills. (You don’t need to go this length as an attacker, either). Cc @riskybusiness

I’m not being hyperbolic when I say this is the dumbest cybersecurity move in a decade. Good luck to my parents safely using their PC.

Stealing everything you’ve ever typed or viewed on your own Windows PC is now possible with two lines of code — inside the Copilot+ Recall disaster.

My look at the feature, FAQs from the community etc

https://doublepulsar.com/recall-stealing-everything-youve-ever-typed-or-viewed-on-your-own-windows-pc-is-now-possible-da3e12e9465e

Stealing everything you’ve ever typed or viewed on your own Windows PC is now possible with two lines of code — inside the Copilot+ Recall disaster.

I wrote a piece recently about Copilot+ Recall, a new Microsoft Windows 11 feature which — in the words of Microsoft CEO Satya Nadella- takes “screenshots” of your PC constantly, and makes it into an…

DoublePulsar

this is the out of box experience for Windows 11's new Recall feature on Copilot+ PCs. It's enabled by default during setup and you can't disable it directly here. There is an option to tick "open Settings after setup completes so I can manage my Recall preferences" instead.

HT @tomwarren

You allow BYOD so people can pick up webmail and such. It’s okay, because when they leave you revoke their access, and your MDM removes all business data from the machine ✅

What the employee does: opens Recall, searches their email, files etc and pastes the data elsewhere.

Nothing is removed from Recall, as it is a photographic memory of everything the former employee did.

Just in time for Copilot+ Recall!

Security and privacy researchers - You can now install Copilot+ Recall on any ARM hardware (doesn’t need an NPU) or in Azure VMs.

Guide from @detective

The devices launch THIS MONTH to customers so I suggest people look at this.

https://github.com/thebookisclosed/AmperageKit

GitHub - thebookisclosed/AmperageKit: One stop shop for enabling Recall in Windows 11 version 24H2 on unsupported devices

One stop shop for enabling Recall in Windows 11 version 24H2 on unsupported devices - thebookisclosed/AmperageKit

GitHub
Nvidia just announced that Copilot+ and Recall are coming to AMD systems. https://www.theverge.com/2024/6/2/24169568/microsoft-copilot-plus-gaming-pc-nvidia-amd
Nvidia and AMD are bringing Microsoft’s Copilot Plus AI features to gaming laptops

Asus and MSI are launching AMD- and Nvidia-powered gaming laptops that include Microsoft’s Copilot Plus AI features.

The Verge
Somebody made a tool called Total Recall to dump Recall database and screenshots. https://x.com/xaitax/status/1797349055917416457?s=46
Alex (@xaitax) on X

Will release TotalRecall in a few days. Loads to play with and to work on. Thank you @GossiTheDog for the inspiration! #WindowsRecall #CyberSecurity #Microsoft #TotalRecall

X (formerly Twitter)

Recent DHS published report handed to the US President which said it had "identified a series of Microsoft operational and strategic decisions that collectively pointed to a corporate culture that deprioritized enterprise security investments and rigorous risk management"

Microsoft: let’s use AI to screenshot everything users do every 5 seconds, OCR the screenshots, make it searchable and store it in AppData!

Searching Recall database for passwords with @awakecoding
🫡

If anybody is wondering if you can enable Recall on a machine remotely without Copilot+ hardware support - yep.

I’ve also found a way to disable the tray icon.

I went and looked at YouTube for Recall to get out of the echo chamber and I can only find one positive video. Even the people at the event are slating it, including people with media provided Copilot+ PCs.

There’s some content creators who’ve realised it records their credit cards, so they’re making videos of their cards going walkies.

It’s going to be interesting to see how Microsoft get out of this one. They may have contractual commitments to ship Recall with external parties.

I thought they were risking crashing the Copilot brand with this one, but I was wrong looking at the videos and comments on them - I think they’re crashing the Windows consumer brand.

The reaction to photographic memory of what people do at home has - you’ll be surprised to know - not been seen as a reason to buy a device, but a reason why not to.

Windows Central, about the only outlet giving Recall positive coverage and having articles tweeted by Microsoft staff - have updated their take after being hands on with a device. https://www.windowscentral.com/software-apps/windows-11/microsoft-should-recall-windows-recall-security-researcher-finds-microsofts-new-ai-tool-woefully-insecure
"Microsoft should recall Windows Recall" — Security researcher discovers Microsoft's new AI tool is woefully insecure

The security story around Windows Recall hits a brick wall as it's discovered the data it collects is unencrypted.

Windows Central

Microsoft has been declining to comment on criticism of Recall for a week - but they have apparently told a journalist off the record at Future that changes will be made before Copilot+ devices drop in the coming days.

This may include an attempt to invalidate researcher criticism, we’ll see.

WIRED has a piece about Total Recall, a now released tool which dumps keypresses, text and screenshots (they’re JPEGs) from Microsoft Recall

https://www.wired.com/story/total-recall-windows-recall-ai/

Total Recall software by @xaitax https://github.com/xaitax/TotalRecall

Example search for ‘password’:

🪟 Captured Windows: 133
📸 Images Taken: 36
🔍 Search results for 'password': 22

📄 Summary of the extraction is available in the file:
C:\Users\alex\Downloads\TotalRecall\2024-06-04-13-49_Recall_Extraction\TotalRecall.txt

This Hacker Tool Extracts All the Data Collected by Windows’ New Recall AI

Windows Recall takes a screenshot every five seconds. Cybersecurity researchers say the system is simple to abuse—and one ethical hacker has already built a tool to show how easy it really is.

WIRED

I hadn’t been aware until today of the external reaction to Recall. Holy shit. Tim Apple must be pleased.

Everything from media coverage to YouTube to TikTok is largely negative. All the comments are negative.

These videos have tens of millions of views and hundreds of thousands of comments.

I knew it would be bad but.. it’s worse. I’ve spent hours looking at the sentiment and.. well, they probably would have got better coverage from launching an NFT of pregnant Clippy.

A key element of Recall is Microsoft say only you can access your Recall, it is per user.

ArsTechnica enabled Recall on Windows 11 box and tested the claim. By logging in as another user they could access the database and screenshots.

https://arstechnica.com/ai/2024/06/windows-recall-demands-an-extraordinary-level-of-trust-that-microsoft-hasnt-earned/

Windows Recall demands an extraordinary level of trust that Microsoft hasn’t earned

Op-ed: The risks to Recall are way too high for security to be secondary.

Ars Technica

If you want to know how Microsoft have got themselves into this giant mess with Recall, here’s what the documentation says between the lines:

you, the customer, are a simpleton who doesn’t want to be an AI genius yet. Have a caveman mode.

Recall and Copilot+ is also coming to ASUS systems, including AMD, in a deal with Microsoft.

ASUS Announces Complete Portfolio of AI-Powered Copilot+ PCs https://www.asus.com/us/news/pnm9tg6qccql6ern/

Nvidia announced they are bringing Copilot+ and Recall to PCs, in a deal with Microsoft: https://www.theverge.com/2024/6/2/24169568/microsoft-copilot-plus-gaming-pc-nvidia-amd

ASUS Announces Complete Portfolio of AI-Powered Copilot+ PCs at Computex 2024

Fremont, Calif., June 3, 2024 - ASUS today ushered in a new era of Copilot+ PCs — featuring advanced AI capability with 45+ TOPS NPU AI engines — during its Always Incredible

ASUS

Three Copilot+ Recall questions that keep coming up.

Q. Can you alter the Recall history?

A. Yes. You can change the OCR database and change the screenshots as the logged in user or as software running as the local user. There is no audit log of changes.

Q. Are they snapshots, as Microsoft says, or screenshots?

A. They are just screenshots, jpegs.

Q. What is to stop apps on your machine accessing your Recall covertly?
A. Nothing. There is no audit log of access.

.@awakecoding becomes the latest person reverse engineering Microsoft Recall https://x.com/awakecoding/status/1798168395583746216
Marc-André Moreau (@awakecoding) on X

@MalwareJake Recall is a melting pot of everything wrong with modern Windows: Per-user app and settings MSIX app setting virtualization Intune MDM per-user policies WinRT generated proxy code Enabled by default, opt-out If you hate it, it's in there, I tell you

X (formerly Twitter)

If anybody is wondering what Microsoft's reaction to any of the Copilot+ Recall concerns are, they're continuing to decline comment to every media outlet.

I've seen comments MS staff have been given for enterprise customers, which are nonsense handwaving.

Product ships live on devices from Dell, Lenovo etc this month. https://x.com/zacbowden/status/1798221879741931847

Zac Bowden (@zacbowden) on X

Microsoft has gone radio silent on Windows Recall.

X (formerly Twitter)
As @tiraniddo rightly points out, anybody can programmatically reach the Recall database without admin rights. https://infosec.exchange/@tiraniddo/112566044174482506
James Forshaw :donor: (@tiraniddo@infosec.exchange)

Damn, I really thought the Recall database security would at least be, you know, secure. Turns out Microsoft did pretty much what I blogged about for WindowsApps, except you need to find a specific WIN://SYSAPPID instead. So to bypass the security just get the token for the AIXHost.exe process, then impersonate that and you can access the database, no admin required. Or, as the files are owned by the user, just grant yourself access using icacls etc :D

Infosec Exchange
TotalRecall has been updated to exfiltrate Recall database and screenshots without needing admin rights: https://github.com/xaitax/TotalRecall
GitHub - xaitax/TotalRecall: This tool extracts and displays data from the Recall feature in Windows 11, providing an easy way to access information about your PC's activity snapshots.

This tool extracts and displays data from the Recall feature in Windows 11, providing an easy way to access information about your PC's activity snapshots. - xaitax/TotalRecall

GitHub

You can now remotely dump Recall data and screenshots over the internet from Linux etc. Changes in flight for parsing data too.

https://github.com/Pennyw0rth/NetExec/pull/335

Add Recall module for dumping all users Microsoft Recall DBs & screenshots by Marshall-Hallenbeck · Pull Request #335 · Pennyw0rth/NetExec

Gets all users Recall folders and dumps them, then renames screenshots to include .jpg (unnecessary but helpful). I cherry-picked the download_folder functionality from #320 and then improved it du...

GitHub
YouTubers are continuing to have fun with Recall

Turns out speaking out works.

Microsoft are making significant changes to Recall, including making it specifically opt in, requiring Windows Hello face scanning to activate and use it, and actually encrypting the database.

There are obviously going to be devils in the details - potentially big ones.

Microsoft needs to commit to not trying to sneak users to enable it in the future, and it needs turning off by default in Group Policy and Intune for enterprise orgs.

https://www.theverge.com/2024/6/7/24173499/microsoft-windows-recall-response-security-concerns

Windows won’t take screenshots of everything you do after all — unless you opt in

Microsoft is making its controversial AI-powered Recall feature optional. The changes come after security experts warned the feature could be a disaster for cybersecurity.

The Verge

Obviously, I recommend you do not enable Recall, and you tell your family not to enable it too.

It’s still labelled Preview, and I’ll believe it is encrypted when I see it.

There are obviously serious governance and security failures at Microsoft around how this played out that need to be investigated, and suggests they are not serious about AI safety.

Microsoft President Brad Smith is going to be grilled by US gov next week. https://therecord.media/microsoft-reverses-course-recall-opt-in
Microsoft reverses course, makes Recall feature opt-in only after security backlash

Recall allows the company’s new line of Windows 11 Copilot+ devices to screenshot every action a person takes on their PC.

I should be transparent btw that I took Satya and Charlie’s commitment to security at face value too - I even published a blog on it backing that up - and I have concerns (it isn’t just me).

They’re now going to have to win trust back about winning trust back.

I know somebody at a retailer in Europe that is selling Copilot+ PCs. They’ve had fewer than a thousand preorders through to customers.

In relative terms, for them it’s about as successful as Suicide Squad Kill The Justice League.

A reminder that a few weeks ago at RSA, Microsoft signed CISA's Secure By Design pledge... and then shipped an enabled by design keylogger that OCRs your screen constantly into AppData.

Edit: I should say that's less a reflection on Microsoft and more a reflection on CISA's Secure By Design pledge.. it's a good idea, but the scope is extremely limited.

I think MS are a way off extracting themselves from Recall situation they've got themselves into.

This is just one YouTube comments section on a video since the not-enabled-by-default change - 500k views - but there's loads more, similar on TikTok.

I imagine it's going to continue through week and into next week when the laptops ship.

I have heard rumblings MS are discussing trying to take action against me over the whole thing, which a) good luck and b) would be pouring petrol on the flames.

Some backstory - it's being reported Microsoft developed Recall in secret to try to avoid scrutiny. https://www.windowscentral.com/software-apps/windows-11/microsoft-has-lost-trust-with-its-users-windows-recall-is-the-last-straw

I'm hearing that various MSFT people are furious about how this played out over the past few weeks, which IMHO represents a serious lack of introspection.

A PR disaster: Microsoft has lost trust with its users, and Windows Recall is the straw that broke the camel's back

The world is up-in-arms over Windows Recall, but why? It stems from Microsoft's seeming lack of care for Windows and its users.

Windows Central

Microsoft have paused the rollout of Windows 11 24H2 in preview channel, it was the version containing Recall. Microsoft have not explained why.

https://x.com/brandonleblanc/status/1799478915582542199

I don't know if it was publicly known but it was possible to use Recall on more hardware via Mach2, before this was pulled.

Brandon LeBlanc (@brandonleblanc) on X

@techosarusrex @TarasBuria @NorthFaceHiker @windowsinsider I don’t have anything more to share beyond what’s in the blog post and that we are working to get it rolling out again shortly.

X (formerly Twitter)

To put this one into perspective, there's one broadcast TV network looking at Recall still, and an investigative journalist.

Plus I imagine @evacide, @wdormann etc would have something to say if MS tried holding anybody but themselves accountable for their own actions.

Cyber Threat Intelligence 2024 is going well

I have an image where when viewed on a Copilot+ Recall PC, a Windows process crashes as it tries to process the screenshot.

New email signature?

If anybody is wondering, with a Copilot+ PC, you can still programmatically access the Recall database as of today with a few commands. Launch is a few days away.

Microsoft’s President Brad Smith appears before US House Committee on Homeland Security tomorrow.

His testimony: https://homeland.house.gov/wp-content/uploads/2024/06/2024-06-13-HRG-Testimony-Smith.pdf

In this bit he talks about Recall (not named), where he pats himself and Microsoft on the back for “a feature change” and job well done.

Given it has been a complete cybersecurity and privacy car crash - and as of today the changes (plural) they’re referring to haven’t even been implemented - it seems like Microsoft fails to grasp customer needs: safety.

One other thing - Microsoft's written testimony to the US House says, quoting, bolded by MS:

"Before I say anything else, I think it’s especially important for me to say that Microsoft accepts responsibility for each and every one of the issues cited in the CSRB’s report. Without equivocation or hesitation. And without any sense of defensiveness."

Counterpoint: they publicly disputed the report in the media. https://www.theverge.com/2024/4/25/24139914/microsoft-cyber-security-incidents-trust-report

Microsoft needs to win back trust

Microsoft has faced a series of security issues in recent years. Now, the company is trying to win back trust and focus on security as a top priority.

The Verge

I should say that if Brad is asked about Recall tomorrow, the answers may raise some.. uh... eyebrows here.

I don't know what MS SLT have been told, but expect fun when the feature drops on consumer laptops in a few days.

As I mentioned in my blog, there is some more security hardening there on Copilot+ PCs (this was before MS put out their blog)... but it's still easily bypassable.

Nessus, a vulnerability scanning tool, detects Recall as an informational

Microsoft’s Recall puts the Biden administration’s cyber credibility on the line

https://cyberscoop.com/microsoft-recall-secure-by-design/

Interesting article. All through this, CISA and the DHS have declined to comment.

Microsoft’s Recall puts the Biden administration’s cyber credibility on the line

Why has the White House remained silent on the launch of a product that violates the spirit and letter of its flagship cybersecurity initiatives?

CyberScoop

The Verge reports today that "Windows engineers are scrambling to get additional changes tested and ready for the release of Copilot+ PCs next week."

It also says "Recall was developed in secret at Microsoft, and it wasn’t even tested publicly with Windows Insiders."

I've also been told Microsoft security and privacy staff weren't provided Recall, as the feature wasn't made available broadly internally either.

https://www.theverge.com/2024/6/13/24177703/microsoft-xbox-game-showcase-windows-recall

Xbox delivered and Windows scrambles to secure Recall

Microsoft had one of its best Xbox showcases ever. There were new game reveals, a handheld tease afterward, and more.

The Verge
Microsoft President Brad Smith just testified to the US House that Recall is a good example of Secure By Design, and that they have the time to get it right (it’s supposed to launch in 3 working days).

Brad Smith just said Recall was designed to be disabled by default. That is not true. Microsoft’s own documentation said it would be enabled by default - they only backtracked after outcry.

He has somehow got almost every detail about Recall wrong while testifying.

@GossiTheDog Do you think these politicians would ask you to testify and give your expert opinion? Also, if they did, would you go?

We need people in power to be accountable for their words, especially when they’re blatantly false and easily disproven.

@khalidabuhakmeh @GossiTheDog
He'd probably have to testify with pre-school level words for these politicians to come close to understanding. 😂

@GossiTheDog

Clearly it appears that Brad has memory fault 😟🤷‍♂️

@GossiTheDog Nah, he is just twisting words really well from a certain point of view.

There is a documented group policy to disable Recall which was shared and published long before their backtrack on making Recall start enabled. Microsoft, by default, always makes group policies to control 'features'. So it was designed to be disabled, 'by default.'

So yeah, scummy but passes lawyer muster. 🙄

Wow...working in government infosec has really corrupted me when I can see that wordplay junk instantly 🫤

@zombie042 @GossiTheDog Ooh, I see:

  • Interpretation 1: "The default state of Recall is to be disabled. This is by design."
  • Interpretation 2: "Recall was designed to have an off switch. Creating such an off switch is a matter of course according to Microsoft developer guidelines."

That's messed up.

@zombie042 I’m not watching, but if the Congressperson questioning him lets Smith get away with that statement, it’s a missed opportunity. It sounds like “technically true with his intended meaning, but misleading”.
@zombie042
@GossiTheDog Agreed. Worked in Gov't IT for over a decade. Yes corporate and government agencies can disable it. The public and possibly smaller contractors may not be as informed....😬
@GossiTheDog Looks like Brad is one of the guys in Recall's target market 🤷‍♂️

@GossiTheDog

"He has somehow got almost every detail about Recall wrong while testifying."

"somehow" - Uh, I think you misspelled "intentionally"

@GossiTheDog but is the security gonna be tested verified by external parties first?

I mean, the security is gonna be tested by external parties anyway, the question is if it's gonna happen before or after release.

@GossiTheDog

72+hr DogFoodHackathonGoGoGoGoGoGoooooHellooooGoGoGOgOooo! 😂

@GossiTheDog Recall is the nightmare that just will not end. I am almost suspecting that they push through to draw attention away from today's ProPublica article on the vuln that enabled the Solarwinds breach.
@GossiTheDog
by
adverb
so as to go past.
"a car flashed by on the other side of the road"
@GossiTheDog Don't worry, no one will be held responsible
@GossiTheDog “we said secure by design, not secure by implementation! The design’s great, we’re just not there yet.”

@GossiTheDog More and more the whole recall and copilot+ seems like a rushed product. In the classic Microsoft way they try to be the first but also ends up being half baked.

Something something Miyamoto quote.

@GossiTheDog the fact that they think there is any level of hardening or encryption that make this insecure-by-design “feature” safe is just the biggest load of shit.

You literally cannot make it safe. It is not a safe feature. It’s like adding a constantly spinning saw blade to a cell phone. I don’t care if you add a safety lock and add an off button, why the fuck did you add a spinning saw blade to a cell phone!? It shouldn’t be there!

boggles the mind. I know some MBA shithead already signed contracts to ship it but for the love of god break the damn contracts.
@GossiTheDog Hmm, I wonder how the US would react if products made in another country were built with this 'tool' inside. 👀

@GossiTheDog This is a bullshit title. If anything, it puts Microsoft's credibility on the line.

(In my eyes, Biden's administration has no credibility whatsoever to begin with, but that's a completely different issue; not related to Recall.)

@bontchev @GossiTheDog

The article mentions Biden ten times:
- once in the title
- eight times describing various ways in which the Biden administration is focusing on security, working to improve computing security, and "deserve immense credit" for their public focus on cybersecurity.
- and one, at the end, criticising their "relative silence" on Microsoft Recall -- relative to other corporate "flawed strategies and harmful practices" that they did call out.

...

@bontchev @GossiTheDog

I think that the MS Recall issues have been moving rapidly, and have triggered a huge public outcry. And so there's probably no need for the federal government to hastily "add more fuel to the fire." A measured response over time, possibly with appropriate legislation in Congress, would be wise.

And it's not like there aren't pressing international issues to attend to.

@GossiTheDog “and how did you come to make the decision to release the feature?”

“I.. uh.. can’t recall”

😎

csimiamatheme.wav

@GossiTheDog
We just got it pushed to our tenant today.
@GossiTheDog

Meh... A lot of members of that Congress are familiar with "say one thing in the press; say the opposite under oath".
@GossiTheDog
What if I'm using a PC for watching DRM content?
Should content producers demand Microsoft?
I'm thinking yes, absolutely.
@GossiTheDog isn't Recall a super GDPR violation?
@morten_skaaning @GossiTheDog probably not, as the data is stored in your machine and never sent to the cloud. There are many issues, but I suspect GDPR is not one of them.

@gigantos @morten_skaaning @GossiTheDog

What about the data you view of other people (thinking in the context of BYOD or just businesses that don’t disable it)

@gigantos @morten_skaaning @GossiTheDog

the never sent to the cloud thing is funny to me

it reminds me of this joke riddle

“i have two coins that add up to 26 cents, one of them is not a quarter; what two coins do i have?”

sure, the app that takes the picture doesn’t upload it to the cloud, but i’m not sure i believe you don’t have any cloud based backup solutions in your portfolio of “technically the other one is a quarter” terms of service sauce.

@morten_skaaning @GossiTheDog
How would GPDR play with training an llm?
I can't be the only one wondering if microsoft is just trying to build the biggest training dataset.

Captive audience, change a few words in the EULA in a year or two implying you agree to helping build this thing.

I'll be honest though, I have limited knowledge on how llm ai works. Totally possible my tinfoil hats to tight.

@GossiTheDog I am already switch windows on Linux on my main PC. Next update with Recall is not my problem anymore 🙃
@Xen4n @GossiTheDog It is most definitely still a problem for you. All it takes is for you to interact with someone else who has it enabled and everything will get captured on their end.
@GossiTheDog Didn’t they change it to opt-in now? So now the hacker has to preemptively enable it before they can start collecting data?
@GossiTheDog thank christ I don't need windows
@GossiTheDog do make sure to share it with us 😄, is it a buffer overflow?
@GossiTheDog Rub salt into the wounds, ask Microsoft for a bounty for reporting it

@GossiTheDog Next stop RCE?

Now get to it!

cat cat.png wincalc.opcodes > meow.png

@GossiTheDog @evacide @wdormann

I wonder what the Beeb's take on this & if their investigative reporters have this feature turned on? 🤔

@BBC_News_Labs
@BBC
@BBCWorld

Also asking here:

https://twitter.com/infosec_jcp/status/1799890848034799934

@infosec_jcp@infosec.exchange🐈done different 👻🃏 (@infosec_jcp) on X

Hey 🙋‍♂️ @BBCTech @BBCNews @BBC Interested in getting comment on this if your investigative news users at the Beeb if / are they using Recall from MS. Send via here or on the #fediverse 👇 https://t.co/wDfs1cjE6s

X (formerly Twitter)

@GossiTheDog @evacide @wdormann lol.

Your tinfoil hat might be a bit too tight.

×
Managed to find out how BBC News printed in a headline story that it was not possible to steal Recall data without being physically at the device (which is false) - this is from the journalist:

Some screenshots of Recall's SQLite database here: https://mastodon.social/@detective/112513529733646088

Just to clarify, I can access it without SYSTEM too. Microsoft are about to set cybersecurity back a decade by empowering cyber criminals via poor AI safety. Feature ships in a few weeks.

The latest Risky Business episode on Recall is good, but one small correction - it doesn’t need SYSTEM rights.

Here’s a video of two MSFT employees gaining access to the Recall database folder - with SQLite database right there. Watch their hacking skills. (You don’t need to go this length as an attacker, either). Cc @riskybusiness

I’m not being hyperbolic when I say this is the dumbest cybersecurity move in a decade. Good luck to my parents safely using their PC.

Stealing everything you’ve ever typed or viewed on your own Windows PC is now possible with two lines of code — inside the Copilot+ Recall disaster.

My look at the feature, FAQs from the community etc

https://doublepulsar.com/recall-stealing-everything-youve-ever-typed-or-viewed-on-your-own-windows-pc-is-now-possible-da3e12e9465e

Stealing everything you’ve ever typed or viewed on your own Windows PC is now possible with two lines of code — inside the Copilot+ Recall disaster.

I wrote a piece recently about Copilot+ Recall, a new Microsoft Windows 11 feature which — in the words of Microsoft CEO Satya Nadella- takes “screenshots” of your PC constantly, and makes it into an…

DoublePulsar

this is the out of box experience for Windows 11's new Recall feature on Copilot+ PCs. It's enabled by default during setup and you can't disable it directly here. There is an option to tick "open Settings after setup completes so I can manage my Recall preferences" instead.

HT @tomwarren

@GossiTheDog @tomwarren poor form. But they want the big number of "x number of installs use recall"

@GossiTheDog @tomwarren It occurs to me: people are perhaps worried that the natsec issue here is that someone gets a screencap of an email with our nuclear launch codes or something. No, the problem is when someone gets the screenshots of the emails between that person and their paramour from their private PC.

If I were a counterespionage analyst...I would suddenly want to do healthcare policy as the less clusterfucked option.

@GossiTheDog "You're in control of your privacy"

which is why we're literally not giving you any controls over your privacy

@GossiTheDog @tomwarren *long aggravated sigh*. Oh good, the typical current era Microsoft choice screen. 
@GossiTheDog @tomwarren wait, does it at least open the relevant Settings screen? Or do you need to navigate to it manually?
@GossiTheDog Is it time for the "fake shock" gif again?
@WhyNotZoidberg @GossiTheDog It’s a bit on the nose that they called it “Recall”, the thing automakers do when they have a product defect so catastrophic and widespread even they can’t ignore it or cover it up.
@GossiTheDog What the utter fuck were they thinking?
@GossiTheDog Probably bigger news than the Trump conviction.
@phaedral you know, if MS we’re smart they’d have used the Trump conviction noise as a great smokescreen for walking this back. Do the right thing and catch minimal media flack for it while the Big Story is playing out.
@GossiTheDog it's rare that I see a Q+A section that has the q and a I want to see

@GossiTheDog "A lot of Windows users just want their PCs so they can play games, watch porn, and live their lives as human beings who make mistakes.."

The rest is good too, I just really liked this part.

@GossiTheDog
All I really want to know is how to turn it off until I can switch to LINUX permanently.

@GossiTheDog

People were telling me to calm down about this.

I AM CALM OKAY WHAT THE FUCK IS GOING ON?!

Lol.

@GossiTheDog I wonder if https://www.microsoft.com/en-gb/windows/copilot-plus-pcs#shop explains the inability to walk this back.

It is one thing to walk it back after a pre launch preview and an insider build, but to do so after a panel of hardware vendors have built production laptops is another thing entirely.

I also wonder if the at edge dragnet is part of trying to do safer, personalised AI, like we would want, and a competitive advantage compared to Google, but which shows that would never be safe either.

Shop Copilot+ PCs: A New Era of Windows AI PCs and Laptops | Microsoft Windows

Shop the newest Windows Copilot+ PCs on the official Windows site. Explore Windows AI features built into a new class of AI PCs and laptops.

Windows
@GossiTheDog better now than later, I guess
@GossiTheDog
So if this is everything ever done and kept forever on the local PC, how long till the storage capacity is exceeded ?
@the5thColumnist @GossiTheDog Don't quote me on this but what I've seen so far is that by default Windows will set aside 50Gb (yes gigabytes) of storage from YOUR pc to save this data. Once it reaches that limit I guess it removes older 'snapshots' so it has room to continue recording. Apparently the size can be user defined but I'm sure there will be some minimum size (still gigabtyes) that can't be changed.
@Bot4Sale @GossiTheDog
There have been a few times when programs have just inexplicably closed on me when I would have wanted to get material not saved back, BUT that would be a maximum of the last hour's work, and a rare occasion. If I could trust the data would only be stored locally and not accessible by others, maybe a useful feature, BUT I don't think I would trust Microsoft enough to opt in if I had the choice.
@GossiTheDog Microsoft think most users run as admin? Srsly, having set up Windows systems so the users don't get to run admin and then tried to set up some third-party software for them, I think there's certainly third-party developers who think all users run as admin.

@hairyvisionary @GossiTheDog I think they’re right.

Most users don’t understand the difference between a normal user and admin, they just want to install their apps. So they run as admins.

The only time they are saved from themselves is if they’re running a work rig that’s managed by IT.

@GossiTheDog tl,dr:

ABSOLUTELY FUCKING NOT on any PC of mine.

@GossiTheDog so if you happen to be looking at your medical records.....

ummmmmmm.........

@GossiTheDog this is a nightmare in the corporate world. Personal and sensitive information has to be protected and appropriately destroyed. Organisations are already struggling with that with users saving personal information to places like OneDrive. Many organisations disable saving to PCs for this reason.

The idea of every PC becoming a repository of personal and corporate information with no clear retention controls is horrifying.

@jhpalin @GossiTheDog
I imagine anyone in a reasonably security conscious org will disable this via GPO.
@GossiTheDog yep we’ve since discovered that… nice to see something concrete on this, cheers… And we’ve been enjoying your recall adventures, nicely done!
@GossiTheDog @riskybusiness the pc i gave my parents is perfectly fine for what they need to do but with the end of win 10 i gotta replace it and now this even tho the pc they will get wont support recall, it just makes me even more mad :/
@GossiTheDog @riskybusiness @hacks4pancakes I continue to be amazed by how apt the product name is, and eagerly await the release of the Microsoft Recall Recall.
@GossiTheDog @riskybusiness So admin rights are all that's required to access it?
@GossiTheDog @riskybusiness I'll try to answer my own question lol - it seems like you only need access to a specific profile: "Recall snapshots are only linked to a specific user profile"
https://www.microsoft.com/en-us/windows/copilot-plus-pcs?r=1#faq2
Shop Copilot+ PCs: Windows AI PCs and Laptop Devices | Microsoft Windows

Shop Copilot+ PCs, the fastest, most intelligent Windows PCs ever. Explore Windows AI tools and features built into the latest PCs, desktops, and laptop devices.

Windows
@GossiTheDog @riskybusiness Not clear if this is a complete fix anymore but this site has reg keys to nuke copylot. https://www.elevenforum.com/t/completely-disable-and-remove-copilot-in-windows-11.23264/
Completely Disable and Remove Copilot in Windows 11

This tutorial will show you how to completely disable the Windows Copilot preview feature and remove Copilot from the taskbar, Windows Search, and Microsoft Edge for all users in Windows 11 and Windows 10. Copilot in Windows provides centralized generative AI assistance to your users right from...

Windows 11 Forum
@GossiTheDog @riskybusiness the fundamental idea behind Recall is actually pretty good. Offering the feature within a reasonable risk appetite is really hard to do, though. And it seems like it was designed without a serious security review.
@GossiTheDog so, full history stored in a db that is almost certainly as easy to forge sessions in as it is to read

@GossiTheDog isn't it like the other "secure" directories? They are quite secure unless you visit them once and click continue on the shield. And once that is done, the protection is gone for good.

But hey, they warned you when you clicked continue. It's not like it's reasonable to expect it to only apply to the current instance of explorer or anything.

@GossiTheDog

This ist also worth noticing:

According to Axios Microsoft is "exploring if there are ways that make sense to allow the feature to work across devices."

https://www.axios.com/2024/05/21/microsoft-windows-11-ai-recall-copilot-pc

Microsoft promises AI will give PCs total recall

A Windows 11 feature will allow anyone to find anything they've ever done on their PC.

Axios
@docht @GossiTheDog wait, do they have a source? Where is Microsoft supposed to have said that?
@bou @GossiTheDog Sorry, the article doesn't give a source. If you want further information, you'll have to ask the autor.
@GossiTheDog could a user with brief access to my computer use the browser to copy the entire database and then look at it on another computer?

@GossiTheDog

Right. Because Microsoft never, ever, told a lie to a reporter before, right?

Right?

@GossiTheDog

So they republished a press release or press statement?

Last time I checked that was called Public Relations not Journalism 🫤

@simonzerafa @GossiTheDog All tech journalism is public relations.
@GossiTheDog It's those beautiful blue eyes. Windows to the soul.
@GossiTheDog But... Microsoft told them... Are you insinuating that Microsoft was *gasp* lying? Whatever should a poor, impressionable journalist ever do?
@GossiTheDog oh to see the world with the innocence of that journalist 🥹
@GossiTheDog :amidala: so you're changing the online story, right?
@GossiTheDog not if attackers are able to break the encrypted screenshots being sent to microsoft

and yes, i know microsoft insisted the screenshots stay on your PC, but i have absolutely no reason to believe that considering the potential profit incentive from using the screenshots for data harvesting or AI training
@mjdxp @GossiTheDog profit disincentive of being fined a kajillion dollars
@ipg @GossiTheDog only if they're caught, and they'd most likely be fined a few million max, a tiny fraction of potential profits
@GossiTheDog That's real journalism for ya. You go straight to the offender and ask if he strangled his dog. That's how you get the truth. Because fuck evidence.
@GossiTheDog rule one of journalism, always check and double check your sources