My Experience With Algorithm Extremism:

So, most of us have been through this. I needed to buy a rug, so, I searched a few websites, and purchased what I needed. Now over a week later, I'm still getting ads for rugs. You bought a rug, DON'T YOU WANT A DOZEN MORE!

This is mostly an annoyance, an Algorithm missing it's mark, but what if this also applied to ideas? Let me tell you another story:

If you follow me, you probably already know I'm a pretty ardent feminist. Occasionally, I will peruse other websites, and social media (not X, ffs get off X) that use Algorithms. I had liked a few feminist posts, so the Algorithm said she likes these let's give her more, which was nice, at first. I started noticing they were getting more extreme, less women deserve equality, and moving more into Fuck all men, I hope they die, territory. Not a fan of that, but I figured it's a one off no big deal. Within a few days it had moved into full TERF territory. It took several weeks of me aggressively blocking and reporting every post I saw for it to disappear from my Timeline.

Now imagine if you're a young man who searches or asks on social media, Why won't women date me?, think about how quickly they could get pulled into a world of lies and extremism. Imagine asking any question about a group of marginalized people. This is why places like Mastodon will become more and more essential, and why teaching children critical thinking skills is paramount.

@RickiTarr well said. The biggest problem with most algorithms is not that it learns what I consume and what I like. That’s usually ok and somewhat useful even if a bit creepy too in many ways.

The bigger issue is how it starts slowly changing what I actually THINK that I like and want to consume. It’s not been talked about enough imo, since no one is really immune to that type of manipulation no matter what they might claim because the change happens with such small increments you’ll actually come out thinking that you’ve just “had your eyes opened for the first time” or “did your own research” or “grown as a person”. You’ll start thinking they’re all your own ideas while the people who own the algorithm have been playing you for a fool. Hell, that sort of happened to me too at one point (though I didn’t become a right wing nut, quite the opposite actually).

I’ve last heard any major discussion around the topic when Facebook was still the social media site that was on the rise. But even then most of those voices that warned about this were dismissed as conspiracy theorists and overreacting doomsayers.

Social media with an algorithm is just a tool to radicalize and sell useless crap in the process. And it’s very fucking effective, unfortunately.

@taxet YES, when people say, I did my own research, this is exactly what they mean!

@RickiTarr it’s really scary stuff too! Once someone is down that rabbit hole it’s near impossible to convince them to look at their past changes and reflect how their often very tight relationship with social media has affected that.

Most people kinda understand how algorithms work, as in, like content A, you get more content A and maybe content B as well because some people who liked A also like B. But when it goes to the territory of how you won’t notice when suddenly they’re pushing you to also view content C that is very aggressive and extreme, because you might at first scoff at it a couple of times but with enough time you cave in once, then twice, and suddenly content C is actually pretty good to you, so then you get recommended content E, etc etc taking you deeper and deeper.

It does kinda sound like something that if you don’t have either first hand experience of this effect or have some understanding of human psychology it must be false because how could *I* fall for such an obvious tactic. Kinda like with propaganda, it’s not as much about winning you over and having you cheer for the nazis with one poster and a slogan, but the constant bombardment of it all and the minute changes you won’t even notice.

Or I guess it could be simplified further; if you’ve ever found an old picture of yourself or a loved one and thought “wow look how I/they got so old, I/they look completely different now!” — that’s exactly the same effect. You see the small changes constantly so you don’t see the bigger shift. It happens to everyone and no amount of logic and critical thinking will prevent it.

As an anecdote, I’ve said to my fiancée multiple times that I’m not letting our kid anywhere near social media until they’re at the very least 16, but favorably closer to 18 if even then. She disagrees because of the whole “all the other kids will be there and our kid will be an outcast” and I’ve tried to make the same case I’m ranting about now (sorry about that btw, got carried away) but it’s such a difficult concept to explain and truly understand that it’s a struggle when the other side is still selling the whole “we’re just connecting the people and nothing else” shtick, which is much easier to see and understand even if it is only a mirage. But I’m not giving up for as long as I live. This is too serious stuff to just let go.

@taxet @RickiTarr Yup, I say my mother was 'pushed down the rabbit hole', not 'fell' or 'tripped' or 'wandered'... There was a very conscious effort to make her think this batshit insane nonsense.

@JustinDerrick

@taxet @RickiTarr
It's a design feature. The more radical one gets the more you use the platform. The most ardent extremists have very loyal users. That's what advertisers and data miners are looking for. You get hooked on the rush of anger and self righteousness. Then the endorphin rush of getting with others of like mind.

@JustinDerrick

@taxet @RickiTarr
A lot of people are just not super smart or clever. (not their fault, not a character flaw but either) many are intellectually lazy or not at all introspective.

@Asbestos @JustinDerrick @taxet @RickiTarr
I don’t think they do it for endorphins. Clicks are way easier to turn into cash.

Also, if anyone believes Trump thinks Asylum seekers *are* serial killers, and get free Visa cards, I have a bridge to sell you.

Nothing to do with validation.
It’s all transactional. 🥹

@RickiTarr @taxet It makes me want to haul out my cricket bat and bop anyone who says "I did my own research", thus guaranteeing that they've succumbed to confirmation bias, aided and abetted by an algorithm. I took two grueling years of research methodology courses and have a fair idea of what genuine research entails. Ten minutes on Google ain't it.
@taxet @RickiTarr reminds me of something B F Skinner said about advertising. I don't have a quote or reference, sorry, but he observed that advertisers were not benignly informing us about their products and services, they were actively trying to convince us we wanted their stuff. The incremental mind shift thing you mention seems like the lastest weapon in their toolbox. Ugh.