"Note that Recall does not perform content moderation. It will not hide information such as passwords or financial account numbers."

The computer, however, will stop you from recording DRM'd content.

Find it fascinating that when faced with drawing safety and security boundaries, the primary beneficiary is not the owner of the device, or the person using it, but random corporations who control the intellectual property rights.

The system doesn't work for you.

I find it equally fascinating that in order to get anywhere near an integrated computing experience in 2024 we apparently need constant recording and transformer models.

No structured file systems, no permission models, no shared stores, no capabilities - just firehose the display output and hope for the best.

@sarahjamielewis Yep. The whole point of these AI tools is that they "think" for us, "organize" our information, make inferences and send out agents to do our bidding. And we become useless blobs of flesh and bone and blood.

@fbajak

Microsoft recall is not "AI." AI is simply a marketing term

@sarahjamielewis We could certainly get a simpler & more capable solution to the problem Recall addresses with modern Computer Science by essentially reimplementing the entire OS to use CRDTs, but who's got the time for that?

The next best thing would be filesystems with efficient backups... Like BTRFS!

@sarahjamielewis it's infuriating to me that every operating system is full of APIs for rendering text to the screen, only for us to take pictures of that text and scrape it back out with OCR.
@tedmielczarek @sarahjamielewis definitely, definitely not trying to defend Microsoft at all here but it does seem the only rational response to a world which birthed Electron apps. if only they used their near monopoly power to actually innovate actually futuristic operating systems and not this mundane dystopia bullshit. shame
@sarahjamielewis to be fair, this feature where you looked at ugly fish a while ago but don't remember where and then just type "ugly fish" and it gives you the site if you're lucky seems hard to obtain in any other way. Not saying it's worth it, though.
@hllizi @sarahjamielewis A lot of people who use #Firefox don't know it is there, but in the top-left corner there is something which looks like a briefcase, and if you click it you get to explore your history!
@khleedril @sarahjamielewis I know, but it won't help you find a picture you saw by describing what it depicts. It also - and this might be a good thing - won't tell you which password you entered on this or that site.
@sarahjamielewis They've finally invented a black box that produces moderately appropriate outputs as long as you shove literally everything into them first. Apparently that's good enough to supersede the entire field of Computer science, not to mention all human knowledge and skill, at least, according to Capitalists.
@sarahjamielewis Kinda reminds me of http://www.incompleteideas.net/IncIdeas/BitterLesson.html : "The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. [...] Seeking an improvement that makes a difference in the shorter term, researchers seek to leverage their human knowledge of the domain, but the only thing that matters in the long run is the leveraging of computation.".
The Bitter Lesson

@sarahjamielewis It's more that that list of things is artificial constructs imposed on the user to make the computer's life easier. It's bending the user's mental model to be more machine like.

Far better to bend the machine to think more like its user, so that the user can say "Hey, what was that article I was reading yesterday? The one about the whales?" And the machine has any hope of answering that question.

@sarahjamielewis

The right way to do it requires a lot of people to agree in a lot of things. Even worse, most of that people doesn't care about that kind of things. So, brute force.

Current AI is pure brute force. We don't know how to do something, we feed a program with billions of examples, in the hope that it gets the idea of what all of them have in common. So now we have a program that is doing something it doesn't have a clue of what it is about, programmed by literally a brainless programmer. And it hallucinates. Surprise!

@sarahjamielewis Interoperability is for filthy commies. All hail the profit motive!
@sarahjamielewis greatly looking forward to the mass exodus from windows systems
@Viss @sarahjamielewis sorry but that's not gonna happen
@sarahjamielewis I’m just glad Microsoft is letting us turn it off

@deepthoughts10 @sarahjamielewis
Ah yes, the "you do you" of safety and security

(are they, though; for how long; and it's still going to be a massive shitshow when it's a legitimate feature on by default rather than dodgy)

@sabik For people who have bad memory: "Disabling" "telemetry" when spyware10 was introduced didn't disable shit. It merely reduced the frequency of data collections (which was still quite frequentl).

Then when people started sniffing network and noticing there was still data collection, M$ changed their options nomenclature in its menu. So M$ wouldn't be accused of lying… But still, they DID lie in the first place, by implying you can "disable telemetry"…

@deepthoughts10 @sarahjamielewis

@sabik @deepthoughts10 @sarahjamielewis Also, you’d just have to trust that the settings actually do what they say they do. I didn’t trust Microsoft for a bit when I turned off all their data-collecting settings, and monitoring all outgoing traffic confirmed my suspicions were correct.
@sabik @deepthoughts10 @sarahjamielewis So, I wrote up a whole bunch of scripts and URL filters to proxy all outgoing connections. I like to think I’ve been reasonably successful, but that’s only because I don’t want to patch all the system files that do this in the first place in case it breaks something.

@sarahjamielewis Microsoft Information Protection will certainly require a massive overhaul for any of these devices to be permissible in sensitive networks with “Recall”. From what I can see, they’ve essentially limited the existing screenshot protection functionality to Microsoft apps like Word and Outlook where you can apply sensitivity tags.

Or we’re about to see a lot of vendors advertise 3rd party tools to mask/blank application windows system-wide with dummy DRM flags

@sarahjamielewis it will be fascinating to see how Recall interacts with environments where data access is legally required to be controlled. Medical offices, financial data (eg pci dss), defense secure processing. They’ll probably have to pay more for a custom version.

@metaphase @sarahjamielewis
I suspect the vast majority of places where data access is legally required to be controlled have neither the expertise nor the funding nor the institutional support to do anything of the sort

Every teaching assistant entering last week's marks (or, worse, sick notes)

@sabik @sarahjamielewis I am prepared for my 50 cent check and year of sketchy identity theft monitoring for breach of my personal data from multiple institutions.
@sarahjamielewis I wonder if this change is going to affect all of the Windows editions?
@sarahjamielewis
They will let us turn it off … if we even know it exists … if we have the technical skills … if we don't live with an abusive partner who turns it on again … or demands to know why we wanted it off …
@sarahjamielewis - Damned astute observation. Wow. I am just flabbergasted at their approach. It makes sense in their own perverse logic... but, as you point out, this system is meant to exploit us, not work for us. Wow. Just wow.
@sarahjamielewis I'm sure this is also to avoid potential lawsuits. Create the problems and make everyone else suffer the consequences. That tracks.

@sarahjamielewis

If this thing is so secure and without downsides, why does it need to exclude DRM'd content?

@skjeggtroll @sarahjamielewis Now that is, quite frankly, a pretty good question.
@sarahjamielewis it's the obvious and so far unavoidable consequence of capitalism and copyright (that is, the extreme commodification of information): who will sue the producer of the hw/software, the user, or the corporations going after copyright fares? Besides the new EU directive on product liability the user has virtually no rights whatsoever. https://www.europarl.europa.eu/legislative-train/theme-a-europe-fit-for-the-digital-age/file-new-product-liability-directive
New Product Liability Directive | Legislative Train Schedule

Parliament adopted the text in its March 2024 Plenary. The directive will now have to be formally approved by the Council too

European Parliament
@sarahjamielewis come on, the DRM thing is a bit of a cheap shot, you know it's not so much them specifically excluding DRM'd content but rather mostly the way high-end video DRM itself works
@valpackett @sarahjamielewis and why does it work that way?
Because Microsoft specifically built it into their product. They could trivially do it differently, but they don't want to.

@sarahjamielewis It doesn't, and I don't trust Microsoft to *not* eventually offload it into the cloud at some point into the future.

However, at least for the time being, they seem to promise that Recall is being done exclusively locally, including analyzing the periodic screenshots.

https://support.microsoft.com/en-us/windows/privacy-and-control-over-your-recall-experience-d404f672-7647-41e5-886c-a3c59680af15

That being said... if I was using Windows still, I would turn that off *immediately* anyway. Even with their promises of only processing it locally.

Privacy and control over your Recall experience - Microsoft Support

@sarahjamielewis One thing of note though is that filtering out websites or Private browsing sessions will apparently only work in Edge and other flavors of Chrome, so not Firefox.
@sarahjamielewis Okay, looking further into this... people would presently have to explicitly purchase a Copilot+-PC with built-in AI accelerator anyway to even use that.
@sarahjamielewis apparently the reason they can't record drm'd content is because of something called "encrypted surfaces" which is copyright lawyer for "a portion of your screen is an illegal number"
@sarahjamielewis i believe it’s already not possible way before this bs
@sarahjamielewis It's funny how they go to such lengths to protect their copyrights.
@sarahjamielewis Oh that's brilliant! Then I just need to have a movie using 1/4 of the screen at any moment. Awesome!
@sarahjamielewis it will not do content moderation except when it's doing content moderation. Well ok then
@sarahjamielewis
better yet that they are taking content from random users and teaching AI to plagiarise it.
@sarahjamielewis So if you have a DRM'd video on your desktop playing in the background it won't record any content?
@sarahjamielewis So begins the cat-and-mouse game of unapproved utility software to fight it, and people downloading malware by accident.
@sarahjamielewis
>The system doesn't work for you.
[Strong agree] It's 'bait and switch', pitched as user benefits, but their use of the data is open-ended.
@sarahjamielewis I realise I'm just adding to the conversation for readers - I respect your experience and knowledge, and I'm not adding to _your_ knowledge :)
@sarahjamielewis The system doesn't work unless you have rich monies. There's not many people in lower and middle 'class' that have that anymore.
The fragile ego'ed have maxed out the upper 'class' arena and made it clear they don't value anyone except for their use as a cash cow.
@sarahjamielewis We can and should push everyone to switch over to Linux.

@sarahjamielewis That's mostly a side-effect of how the data is tagged.

We already have enough "bit coloring" guardrails in place to decide whether is_drm is True for every pixel on the screen. We don't have a similar oracle for is_password_field or is_pin_number. Note that for Edge, it will exclude their version of Incognito Mode, because the OS does have visibility into whether those windows should be considered private.

@sarahjamielewis This is a perfect example of POSIWID: Purpose of System Is What It Does.
@sarahjamielewis Seems like they're inheriting the baked-in screenshot feature from Windows which does the same. Still sucks though.