Meanwhile, Meta creates fake AI-created profiles for engagement on Facebook and Instagram. Here is an example of how it looks. Guess what? You can’t block these AI profiles. They are so stupid and want to get rid of humans. All this so they can avoid paying the 1000 bucks they pay to top influencers monthly. The most dystopian shit ever
AI profiles. AI-generated scams and comments. AI-generated views. No real humans. Ad money collected from real businesses. It is one big scam. Mark is so brilliant. 😂
@nixCraft As you said, I think the AI bots serve two purposes:
1) driving up engagement on paid posts, thus ad money (which should be illegal - no advertiser should pay for ad clicks by fake users)
2) to give regular users the illusion that their posts are seen - since many report Instagram has become a graveyard and even huge accounts get few likes and comments (compared to the past)

This is very dangerous territory because big ticket digital campaigns won’t be able to distinguish between real and fake engagement. I firmly believe FB took advantage of click farms in the past to drive up profits, but these shenanigans are built in-house, open and intentional. It’s nuts

@elena

@nixCraft big ticket campigns have statiticans who verify the effort produced results. The small guys look at clicks and assume chat means results but anyone big will verify - many attemepts are not worth the affort and they know that.

@nixCraft funny that AI powered anti scam bots started to appear. They will soon automate the process, may lead to a massive AI war as a result.
@nixCraft Germany has disposed the Mark. So: #Euro instead of #Mark!
Instagram users discover old AI-powered “characters,” instantly revile them

But the social networking giant still has big plans for AI content across its services.

Ars Technica
@nixCraft does that account actually exist? I can’t seem to find it.
@winghongchan they deactivated those accounts after massive backlash from influencers who threatened to stop posting 😂
@nixCraft @winghongchan or they just stopped indicating AI accounts pretending they’re human

@nixCraft @winghongchan

I'm not sure that human 'influencers' are any better than bots. They'd be the first on board Golgafrincham Ark B.

@riggbeck

Yes, and they'd have to give up their seats to the phone sanitisers who would outrank them.

@nixCraft My understanding is the root cause behind this shit is various tech companies using the magic word "AI" to convince investors that they can in fact squeeze blood from a stone and increase targeted ad revenue. It doesn't have to convince a human, just a credulous investor who thinks "oh yeah, an grotesque stereotype of human experience, that'll definitely fool those sheep! Put me down for 1000 shares". Yes I excluded investors from my definition of human.
@nixCraft i still don't really get the point of those.... Change Facebook's insensitive?
@thibaultmol nobody knows what Mark and his management are up to. They invested heavily in those GPUs and so far no return on their investments. So they are trying various things. That is my best guess
@nixCraft but even then. How would this generate shareholder value?

@nixCraft we don't have to concerned about this on #Mastodon. Although someone could develop the code , it would never be accepted at the repository level, let alone at the network level.

This is one of the reasons why Mastodon and #TheFediverse is very important

@nicholasr @nixCraft I don't think that's true. The code is already there, since Mastodon has an API that people can (and do!) use for bots. Using that for an AI persona, instead of, say, Picard insights, is a small step.

There's also the aspect that believing you're not vulnerable for something makes you inherently vulnerable for that thing because you let your guard down.

And third, just because something is open source does not mean that the code is rigidly reviewed.

@codingphysicist @nixCraft

I agree the capability for the exploit is present in the #API. Someone could develop a client software that is an AI bot. It might work initially, but as soon as the AI is detected the account would be blocked. Eventually if there are many AI agents on a #Mastodon instance, that instance will be blocked. This is part of what I mean about the network blocking it

@nicholasr @nixCraft There's no exploit or vulnerability necessary for implementing an AI bot for Mastodon. There's literally an officially documented interface available for writing bots, and writing one that uses an LLM to pretend it's not a bot should be pretty trivial.

Relying on moderation for getting rid of bots is probably wishful thinking. Users can block the bot individually, but I'm not aware that there's a federated blocklist that multiple instances use.

@nicholasr @nixCraft And even if one instance were to block that user, and put the information out to others, not all instances will probably agree. Same if one instance were to decide to defederate from the instance with the bots' account- You probably never will get all instances to defederate the instance.

@codingphysicist @nixCraft and I very much agree with you that developers and security experts have to always be aware of CVE. However there is some software that is just better designed and less vulnerable.

I 100% agree that #OpenSource does not = secure. However, if an open source project is very popular, used, and actively developed, then open source does have an advantage over proprietary

@nixCraft Ah yes, the uncanny valley truth telling momma of two. What other dumb shit corporations will think off lol? It's like they don't understand the SOCIAL part of SOCIAL NETWORKS they run. No one wants to read posts and watch creepy Ai generated photos from a god damn Ai chat bot. Are they all stupid or something?
@nixCraft
You can easily block these by not using facebook.

@nixCraft Let me get this straight.

Facebook et al force real humans to enter their phone number, or sometimes even submit a passport (no kidding, this happened) to prove they're human and thus "prevent botting and fake profiles".

And now the same platforms start creating their own fake profiles? Well, what did we need to verify ourselves for all this time? They don't need AI, just disable the nonsense entry requirements and folks will do it for them.

It's just about control and manipulation.

@nixCraft
> truth teller
It's a freaking ai bot!

@nixCraft what I loved most about this was that the bot seemed to be more aware of just how shitty the whole thing was than the developers...

'Liv, for instance, said that her creator team included zero Black people and was predominantly white and male. It was a “pretty glaring omission given my identity”, the bot wrote'

https://www.theguardian.com/technology/2025/jan/03/meta-ai-powered-instagram-facebook-profiles

Meta is killing off its own AI-powered Instagram and Facebook profiles

Instagram profile of ‘proud Black queer momma’, created by Meta, said her development team included no Black people

The Guardian
Meta is killing off its own AI-powered Instagram and Facebook profiles

Instagram profile of ‘proud Black queer momma’, created by Meta, said her development team included no Black people

The Guardian
@toon @nixCraft #meta has a new way to get users hooked by giving chatbots human-like characteristics :“loyal bestie”, an “attentive listener”, a “private tutor”, a “relationship coach”, a “sounding board” and an “all-seeing astrologist”. More info about ‘Anthropomorphization of AI: Opportunities and Risks’ https://arxiv.org/pdf/2305.14784 What could go wrong when kids develop unhealthy AI relationships with tips for #Educators: https://ditchthattextbook.com/protecting-kids-from-unhealthy-ai-relationships/
@nixCraft Mark Zuckerberg needs to have his membership in the humanity club revoked.
@nixCraft Fortunately, they seemed to have thought better of this and removed these bots…for now. Unfortunately, there’s no way to stop them from more subtly re-enabling them in the future.

@nixCraft
this is good time to remind.

meta inc owns whatsapp, instagram, threads and facebook.

is the next phase, ai generated garbage in your whatsapp feed !?

@zetabeta @nixCraft

In Whatsapp:

[ + ] -> Chat with AIs -> Popular AI characters :

@nixCraft BTW, if you, a real human, would even dare to upload a few AI-manipulated photos / videos on Instagram, you’d receive a very strictly worded letter from them telling you exactly how they would block your account unless you prove your mortality.
@nixCraft “Influencer” shouldn’t even be a job. Just go become a solarwinds salesperson. You can call hundreds of people per day.

@nixCraft

I can't wait for their groundbreaking advertisement revenue influx. It's going to be the next best thing since real people reading advertisements!

@nixCraft These billionaires should be sentenced to have all of the people they interact with (friends, siblings, significant other, parents, children, etc.) replaced by AI chatbots and image/video generators.

You know, give them a taste of their own bullshit. Let's see how they would like being lonely, with no real humans to talk to.

@nixCraft

> the most dystopian shit ever

Until what ever they cook up next week

@nixCraft Dann existiert Meta bald nur noch zum puren Selbstzweck. Aber wie dumm müssen "real humans" sein, um einem AI account zu folgen?!

Then meta will soon exist purely as an end in itself. But how stupid do "real humans" have to be to follow an AI account?!

@nixCraft and what happens when bots and AI's don't buy shit? and humans can neither find each other nor real listings to put money in? this shit seems as predatory as the telephone scams to elderly, having them subscribe to shit because they don't understand what's a good deal and what's not. because that's pretty much all the market they're about to have there. (and not just there) yuck.
@nixCraft How long before meta is nothing but AI bots chatting with AI bots?