Why does #Microsoft want to implement #Recall? It's not about *images*. It's about modelling what workers do on Windows, and then replacing them.

The most expensive part of a computer is the fallible feelings-filled unpredictable meat sack that operates it.

Google has YouTube, Google Photos, Maps, and a bucket load of search data, Google Analytics, advertising, as well as it's #GCP data (e.g. #STT transcriptions). And a bunch of data from Android services. From this data they can model speech, model videos and model advertising systems, and how humans respond to them.

But they can't model what people do on computers.

Amazon has Prime data, and a bucket load of compute. But no operating system data. They can build models based around e-commerce and advertising systems.

But they can't model what people do on computers.

Meta has *waves hands* enough analytics to model human behaviour in the Metaverse.

But they can't model what people do on computers.

Microsoft has GitHub.
Microsoft has LinkedIn.
Microsoft has SharePoint.
Microsoft has Teams.
Microsoft has Dynamics.
Microsoft has O365.
Microsoft has Windows telemetry data.

Microsoft can model what people do on (Windows) computers. Like fill out spreadsheets.Write emails. Synthesize web pages of research. Interact with colleagues on Teams. Create and edit documents.

Microsoft wants #MicrosoftRecall data so they can model what people *do* with operating systems.

Then replace them.

Imagine a CoPilot that doesn't just write buggy code. Imagine one that also does spreadsheets. That creates documents on SharePoint. That communicates with colleages on Teams. That has a customer pipeline on Dynamics.

That's what Recall is about - 360 degree surveillance of the worker, to model their functions, make them fungible, replicable - and replaceable.

@KathyReid I can’t wait for Windows to assume that going to talk to a coworker was actually an unproductive lunch break

@yaakov what bothers me is how this can be used to more closely surveil workers. Knowledge work, by definition, is generally not routine, and we tend to automate routine work.

By modelling work, and *making* it routine and seeking to automise it, will it actually hinder creative, knowledge production work?

If I'm worried about some sort of productivity metric (remember Goodhart's Law), will I be as creative? Or will I be performative?

Will I generate lacklustre, superficial documents because that's what the algorithm wants, rather than thoughtful, creative, "slow" work that is more meaningful and more impactful?

When books had to be written by hand by monks over years, their words were carefully chosen prose. When books are regurgitated by an LLM then printed on demand, do they carry the same (cognitive) weight?

@KathyReid yes no yes yes no (I think)
@KathyReid @yaakov yes. Look at the result of managers trying to manage stuff.
@KathyReid @yaakov by definition a llm has no true cognitive weight.

@KathyReid @yaakov

In every attempt to reconstitute slavery, it begins with the devaluation of labor and workers.

So much of the Republican & Tory bigotry can be explained by an attitude that people should not be paid a fair wage. They hate the lower & middle classes.

Xenophobia, misogyny, antisemitism, islamophobia, & homophobia are wage suppression schemes in disguise.

AI Initiatives are funded to monetize bigotry.

@KathyReid @yaakov

I feel that you have your answers here.

@yaakov @KathyReid Whenever you leave your PC, start some porn and lock your office. That'll teach em 😈
@brezelradar @yaakov @KathyReid
Recall does not do DRM-ed content.
@yacc143 @yaakov @KathyReid Not sure free web porn is drmed, usually no problem for yt-dl.

@yaakov @KathyReid

The Tech industry is predicated on a model of 24×7 work schedule.

Slave owners from the 19th century would have adored this system of surveillance.

@yaakov @KathyReid

It's sort of already happened.

My wife got into trouble for taking long breaks while working from home.

She wasn't taking long breaks. She was signing out of Teams, because annoying messages kept distracting her while she was trying to work.

Turns out, her work was using "logged into Teams" as the main check that you were at work.

@KathyReid it's an incredibly awful reflection on us that most of corporatopia is absolutely ripe for this - it's the perpetual Colony in action, even with meat robots pushing keys.

We could have done almost anything, and we chose to do this :/

@adamsteer exactly - all the while consuming fresh water, increasing the need for energy and kicking the can to the next generation.
@KathyReid ...it will absolutely schaden all of my freudes if Microsoft do this and it does some hyper mode "create moar SharePoints and fill them with LLM generated stuff because that's what its training data says is Good Work", at a faster rate than storage can be added and everything just glitches.
@adamsteer I would literally pay real fiat money to watch this.
@adamsteer @KathyReid It absolutely won't do anything useful. What you describe sounds like what it'll do. But that's what the biz/finance class expects and wants human workers doing too. It's not about doing anything useful to humanity. It's about projecting vibes of "doing important things" so bigger suckers will "invest" and you can move on to next scam. That's modern capitalism.
@adamsteer @KathyReid "We"? 🤔 My own control of global finance capital is somewhat limited.
@KathyReid my first reaction to hearing about recall was what are they scraping all that data for and why and this is a really good answer to that question.

@KathyReid my problem with all of this automation is, if people lose jobs, who is going to buy stuff?

The race to get rid of people at companies is so silly, capitalism can’t help itself 

@josheron @KathyReid exactly, this is a dead end for the ultra wealthy. This is going 1 of 2 ways: 1) the death of capitalism and a state where increased productivity from automation props us all up. Or 2) death robot overlords
@josheron @KathyReid true, but fundamentally the problem is between now and then, some people can get rich replacing their workers, so the incentives for them to try are too high. The company running out of customers is somebody else's problem, they'll have cleared off with their money by then, if they're really thinking that deeply at all
@KathyReid I rebel by being terrible at my job! My career is a poison pill for AI. 😤 😉
@KathyReid It's not just about replacing workers. It's about surveiling all activity to prevent revolutions and protests, and silence dissent.
@pinkdrunkenelephants @KathyReid the right to form labor coalitions is constitutionally protected
@tessarakt @KathyReid Not gonna matter when big tech companies do the shit that's unconstitutional for the government to do and anonymously passes them the info.
@pinkdrunkenelephants @KathyReid it's also illegal for corporations and other people.
@tessarakt @KathyReid Implying the law has ever stopped them before

@KathyReid

And eventually all the humans have no job, no income, and the producers have no one to whom they can sell their goods.

Happily, climate breakdown will wipe us out before we get to there.

@KathyReid it's the new "Embrace and Extend"
@vitriolix @KathyReid Embrace, Extend, Extinguish, Extinction
@rasterweb @vitriolix More Embrace, Extend, Enshittify, Extinguish
@KathyReid we have to decide if we want a society centered around the common ordinary working person or the 1%. That involves rejecting such systems.

@KathyReid this implies a rather strange future dystopia:

Humans building new inefficient human-oriented UIs so the trained-on-2020s-human-behavior AIs can inefficiently act like humans and use them.

Which does sound like what the shareholders want, so... seems plausible.

@KathyReid

> It's not about *images*. It's about modelling what workers do on Windows, and then replacing them.

So like WOPR, but for cubicles?

@KathyReid - and then, after they've broken the world to build their Replicant Worker™️, they find out it isn't able to actually produce anything of value, because all it will be able to do is replicate the externalities of work. Like making a replica of a cake out of wood & insulation foam & expecting it to taste like the real thing.

We truly live in the stupidest timeline.

@jwcph @KathyReid IMO the goal is to sell it to a greater fool before anyone cuts the cake.
@cwicseolfor @KathyReid True - they don't care if it works, as long as they can sell it to someone who thinks it does. Just like the current crop of "AI" "services".

@KathyReid

AI training on porn, so much porn.

Prepare for some delightful AI PowerPoint presentations.

@KathyReid they (M$) also own Typescript and are a major contributor to the Linux foundation.

@KathyReid

This makes so much sense, there is not enough data for them for general purpose computing compared to -- let's say images and text.

@KathyReid They may not be able to replace people any time soon but they will very easily be able to identify outliers with this data. Whatever their intent it’s quite nefarious.
@KathyReid you are giving Microsoft too much credit. They are still fixing teams and windows 11. Microsoft is not this smart - otherwise there wouldn’t be an OFF button.

@KathyReid
Something like this exists partially.
The last buzzword relating to this was AFAIK "Robotic Process Automation".

Scraped sequences of pressed buttons and filled-out checkboxes give you a great basis to train your LLM.

And of course, this approach has two "great" benefits:
a) You can tell your workers that you could replace them with AI, so you can pressure them to take less payment.
b) If you introduce it, you can demote your workers to mere "content checkers" who get all the fault and only part of the payment.

@KathyReid

There is absolutely zero doubt that MS would love to model human workers as you suggest.

However, from my understanding of how Recall is implemented, all that history data is encrypted & stored locally on the machine. The OCR is handled by a local Copilot instance. MS says they are not uploading any of that to their cloud. For now, anyway.

So assuming this is correct, how could they build *anything* with Recall data? I'd just assumed it was a workplace turbo-surveillance tool.

@ralfmaximus My thinking is that you don't need the raw data in the cloud if you do federated learning ...

@KathyReid @ralfmaximus with electricity becoming more expensive, scaling out yet more DC's, outsourcing CPU+GPU is key to out competing their competition then.

Force the "customer" to do the work for you?

This only works on desktop PCs, not laptops/phones/mobile... ?

@kim @KathyReid

That would align nicely with their push for AI hardware to be included by default on new Intel based PCs. https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/ai-pc.html

The AI PC powered by Intel is here. Now, AI is for everyone.

AI acceleration built into every Intel® Core™ Ultra processor.

Intel
@KathyReid also #Microsoft is just a #GAFAM and #PRISM collaborator as well as falling under #CloudAct, which are 3 reasons to not trust them further than one can piss agaist the exhaust of Turbofan and not get wet!