So, one thing I'm wondering is why is China hopping in on the "AI" bullshit train anyway?

Are they just that prone to falling for grifts?

Is the spam/propaganda generation ability worth that much to them?
Or is the "AI race" a complete fiction pushed by the USA and simply not happening?

(I cannot read Chinese so it's a bit hard to get answers at the source.)

@lispi314 The idea that "AI" can be used for anything prosocial is a scam, but it's very useful for simulating widescale popular agreement with hegemonic narratives (popularly known as "bots"). It's also good for policing people's behavior when you don't care if you make grossly unjust mistakes.

Jumping in with low-budget "AI" with outputs that look just as convincing as what US companies spent tens of billions of dollars building also serves a role of destabilizing/undermining these US company valuations. Which is probably good for them, but also good for us.

@lispi314
Cause you can make money with it. When you look at China you always need to differentiate between what they allow inside of China and what they allow outside.

Outside it's mostly "everything goes" except for fraud. They still prosecute that as it would undermine their position in the world if people would get worried about "not receiving" the thing they paid for. So you generally always get the thing, but it may not be what you thought it would aka. "monkeys pawed".

@agowa338 The articles made it sound as though it were for internal use, which I find questionable.

@lispi314

Well yea, but not for everything. They're monitoring for what and where you can use it.

@lispi314 @agowa338 I mean, they do have the social credit system already; it's possible they're looking into expanding it and that's why they find any sort of AI research worthwhile

@reiddragon @lispi314

When you actually talk to people that were there then they tell you that their "social credit system" is way less "getting in the way" than our "wester" equivalents with credit scores. And it apparently isn't nearly as Black mirror as it gets painted in media here.

However on the other hand they regulate how many hours per day you're allowed to do things like online gaming using a governmental ID and age verification system.

@reiddragon @lispi314

Oh and what esp. in the US is also often projected onto a social credit system is that you can't be the worst human being possible in ingame chats and expect there to be no consequences.

You will get banned for insulting and harassing people and you also will get prosecuted for it. And because they have your account bound to your ID you also can't just make another account and re-buy the game to continue...

@reiddragon @lispi314

Can't say anything to the part about predictive policing which is what I think you're implying with the last part of your post though.

@agowa338 @lispi314 I mean, predictive policing seems to be all the rage so it wouldn't surprise me in the least if the Chinese government wants to get into that as well

@reiddragon @lispi314

Well I don't think we've to worry about China getting into predictive policing while our own police here in "the west" is basically already doing it and wants to extend the efforts using stuff like Palantir and data bought from advertising agencies and platforms...

Edit: Except you're in China of course.

@agowa338 @lispi314 look, I'm not doing the trumpist "hurr durr china's the devil", I'm just responding to the original premise of this thread about why China would be interested in AI crap

And yes, I'm already well aware predictive policing is already ruining lives in the west; just yesterday I linked to a video about a woman who was arrested for a crime she didn't commit and held in the slammer for 6 months in a state she had never been in before just because some AI flagged her as the perpetrator.

@reiddragon @lispi314

Ok, on that note I just don't think that China needs it for that. I feel like they're currently more focused on the making money with it part...

@agowa338 @lispi314 I don't know what the exact goal is, but I'm pretty sure they'll use it for both

@reiddragon @lispi314

True, but they already had good enough things so far, so I also don't really know what they'd use it for.

But as always time will tell and we'll see. In the mean time we should focus at the cluster fuck of surveillance in front of our own doorsteps...

All of this is still a bit too much China bashing for me. Ultimately it is up to the citizens of China to work it out with their government.

@agowa338 @lispi314 you mean YOU should focus on that. Romania isn't anywhere nearly competent enough for that shit. We're still dealing with soviet-style corruption here.

@reiddragon @lispi314

Well I ment in the discussion we both had just now. Where do you get the part about Romania from?!?

@agowa338 @lispi314 I live here.
@agowa338 @lispi314 People who live in countries with actual predictive policing should fight it, I live in Europe's bumhole where we only hear about that shit in scifi movies because we're still at the stage of embezzling EU funds with overpriced benches and garbage can in a park build in a town with a population of 12

@reiddragon @lispi314

Sorry didn't get that in the moment.

Germany has it in some parts (even though it is technically not legal). It is currently one of the fights going on here. Esp. because they want to role out even more Palantir shit. (You're selling moving to Romania quite hard right now, btw)

Then at the EU level well the #ageverification and #idwallet (EU Digital Identity Wallets) surveillance bullshit and all.

@agowa338 @lispi314 > You're selling moving to Romania quite hard right now, btw

Eh, Idk, our president told us we're just dumb for protesting his proposal for Attorney General of a lady who withheld evidence in a child sexual abuse case by a priest. We're a shithole just like the rest of the world, just not a high tech one

@reiddragon @lispi314

Well have you seen what the church has been getting away with here in Germany? That's nothing new.

(Also many figures in the church are actually Vatican diplomats and have diplomatic immunity too)

@agowa338 @lispi314 No Vatican intervention here (Romania's not Catholic), instead we have the Romanian Orthodox Church function more like the mob in '50s America

@agowa338 @reiddragon That really only works if they're willing to prosecute.

South Korea tried it and their net was not any less toxic. The contrary, apparently.

Because people that would've spoken otherwise were just avoiding the system or actively blocked by it in various ways instead.

@lispi314 they have the most advanced human surveillance technology in the world. And this is just the next phase of that technology. Putting this on people's phones and in their houses is like the ultimate in surveillance and control.

Venture capitalists love to talk about the single person billion dollar company. The Chinese Communist Party has 100 million members. If a technology like this can get rid of even a percentage of those, it allows you to tighten your grip as an Autocracy.

The companies building this technology today are all basically State assets. So they get direct access and control without any of the public fights like Anthropic.

So I'll flip this around, why do you think they shouldn't be doing this? What grift do you think they are being subjected to?

@gatesvp Because it's stupidly unreliable and might lead to them purging completely uncompromised party members.

@lispi314

"Purging completely uncompromised party members...

Who cares? The purpose isn't to find or purge compromised members, the purpose of having an automated system is to replace the number of party members you actually need to keep the system running. The best way to minimize compromises is that you have less people in the system.

Because it's stupidly unreliable...

I mean, have you met humans?

They lie. They cheat. They steal. They try to undermine your control and authority.

And they don't have built-in control and auditing systems like the robots do. And they're more expensive.

I'm still not understanding your arguments here.

@gatesvp

Who cares?

It was literally the thought experiment asked. The fact no one does is irrelevant.

Hastening the system falling over under its own dysfunction is not keeping it working with minimal resources unless you have a very generous definition of "working".

And yet, despite all that, humans still do better at somewhat-durable dynamic systems.

They still do better at semantic and logical reasoning (making a computer worse at logic than a human is an achievement, if a very dubious one).

And they're more expensive.

Not even remotely. The actual costs of the logistical chain behind "AI"? Ridiculous.

@lispi314

It's clear that you and them have very different base level assumptions about the cost and value generation of these systems.

Sure, if I take your cost and values, then none of this makes any sense.

But they're clearly operating from different cost and values. So to them, this makes sense.

They're running the world's most advanced AI-powered surveillance system. Currently pointed at their own people. But they've been running that system for a very long time. Quite successfully, by authoritarian government metrics.

Before ChatGPT was launched, China already had years of experience using LLMs. Years of experience using automated image and facial recognition. At huge scale.

You're operating from the baseline assumption that this is some American grift being pushed by a couple of companies trying to make some money. China is not.

And the only way you're going to understand their perspective is to restart your interaction with this technology, from scratch, wearing Chinese glasses instead.

@gatesvp > And the only way you're going to understand their perspective is to restart your interaction with this technology from scratch, wearing Chinese glasses instead

I already confessed to being hanzi illiterate though. I can't do that.

@lispi314 So you're operating under two technological assumptions. Number one, the AI technology works poorly. Number two, the AI technology is prohibitively expensive to develop and operate.

I used to work at Roblox, on the trust and safety team. We are basically an authoritarian regime on what you are allowed to say on the platform. Particularly for people under 13.

We used LLM technology for years before ChatGPT was available. It was not only affordable, it performed text interpretation and redaction that was literally impossible for humans to complete. It was able to escalate particularly dangerous text up to moderators for further review. It supported multiple languages. It interpreted weird utf-8 characters in multiple ways to prevent people bypassing the filter system with emoji or weird characters.

This thing did not work poorly, it worked very well. And it did so at an efficiency that was unmatchable by humans. And this was 2021.

@gatesvp You were externalizing the cost of building the datacenters, maintaining them, and building the computers and hardware to use in them & powering them.

Obviously it's "cheap" if you just ignore the majority of the costs.

China's use-case implies end-to-end TCO & OpEx.

@lispi314 back before we were public, the books were pretty transparent... that system ran on a small percentage of Roblox's infra.

We spent 100x the resources on the servers for hosting games. It was so cheap to operate, nobody noticed. I was the senior tech lead on the team, not once did anyone wave a bill in front of me or ask me to justify costs.

And all of this stuff is cheaper now because we have better GPUs for even less money.

You have a vision of cost, but I don't know where it comes from?

@gatesvp From the entire transformation chain (China won't simply use someone else's infrastructure).

Did you own a single one of your servers or were they all rented?

And the fact it was so cheap, you were using some off the shelf model or yet another service you couldn't recreate yourself if the provider decided to misbehave? Or did you actually have the in-house expertise to do all of that (which would indeed dwarf the actual cost of the servers)?

You were were also mainly/only processing text. That's a lot lighter.