I don’t know what was worse, Stack Overflow’s moderation system, which many IT communities find annoying, or AI killing the site 🤔 Both extremes seem bad for the open web…. I still think that we don’t need three chatbots controlling everything. I fear Wikipedia might be next. This is not good for the Internet
@nixCraft seconded, very worried about wikipedia. for me that's the most important site on the internet

@bazkie @nixCraft
Wikipedia offers free copies of all available content! Yes, you can legally download the entire Wikipedia in your language for offline usage here:

https://en.wikipedia.org/wiki/Wikipedia:Database_download

Feed this to your local running LLM or use other free tools to make it conveniently usable.

Wikipedia:Database download - Wikipedia

@tjunker @bazkie @nixCraft as long as you share alike, provide attribution and don't add anymore restrictions on the information then this is correct

@tjunker @bazkie @nixCraft and yet still the detachment between source and answer is real.

I know LLM are useful for this *BUT* i personally fear we will lose our sources when we separate where the source is edited/curated and where it is read.
Having a clear pointer to wikipedia and its edit button invites upkeep, addition and change. Without people will consume the knowledge but never feeding back

@saxnot @bazkie @nixCraft I fully agree. I just wanted to show a solution that if Wikipedia online database somehow disappears or gets purposely manipulated with false information, you can have the entire database as offline backup to preserve our knowledge.

@tjunker @bazkie @nixCraft knowledge is under attack

spreading mistrust in established sources has been and still is important for fascism to thrive.

It's no coincidence we have grokipedia and garbage LLM text everywhere (even when nut using LLM oneself!)

@tjunker @nixCraft yeah this is nice! I planning to make a local copy soon and just keep forever that while the real thing ensloppifies or whatever
@tjunker @bazkie @nixCraft
Sadly it doesn't stop the ai training bots pummelling it constaltly because if they asked they would have to follow the licence. See the phrase in one of the copyright lawsuits from one of the companies 'if we pay for one thing we have to pay for everything'. I forget which compqny as they've all taken this stamce
@nixCraft The web has already changed, half of the traffic is bot-generated, and even content is heavily AI-authored. Handcrafted stuff is slowly becoming a minority for a minority of users.
@nixCraft It's a bit like blackberry, if you don't catch up to the competition you will end up 6ft under
@nixCraft The problem is not even that technology changed (LLMs are not necessarily bad on their own) but that what we call AI is simply software running on someone else computer, where someone else means someone very rich.

@nixCraft I don't agree with that narrative. ChatGPT didn't kill Stackoverflow : managers of SO did.

After ChatGPT launched, SO team decided that from now on, every question and answer on the site were going to be used to train a local LLM model. Everybody was angry at this, and everybody left. Including me.

I posted questions and answers on SO for more than ten years. After that decision from the team, I just logged out for the first time in years and never came back.

@rusty that makes sense. Why would anyone provide free labour to build llm ?
@rusty @nixCraft LLMs have scrapped everything anyways.
@f4grx @nixCraft They scrapped the content, but the community has been destroyed from within.
@rusty @nixCraft 99% agree. I publicly disagreed with their stand and requested, since the terms and conditions of my involvement in the platform were violated without me consenting, that my data were removed. And I knew of top contributors doing the same.
The remaining 1%, could be attributed to AL.

@rusty @nixCraft Similar story. I joined in 2009, wrote over 5,700 answers, received over 300k reputation, currently (still) ranked #215 on the site.

I haven't answered a single question since 2024, and it was because of how the team treated contributors.

It might be true that AI killed SO. Maybe nothing could have saved it. The way people are treated when they ask questions is terrible.

But the reason *I* left was because of how SO leaders reacted to AI, not because AI replaced it.

@rusty @nixCraft The funny thing is that the actual, specific thing that caused me to leave wasn't directly about AI. They were desperate to do *something* and kept messing with the UI, moving things around and "experimenting" till I couldn't find interesting questions any more. It broke my habit of going to the site every time I had a few minutes to kill. And breaking my habits made me rethink whether I even wanted to be there.

Folks should remember that when they feel they must A/B something.

@nixCraft stackoverflow and Wikipedia's raison d'être are very different. Fingers crossed for it still.

@nixCraft

I still don't get why everyone is still carrying that false "AI killed Stackoverflow" framing?

Stackoverflow was slowing as most RTFM questions were already asked, so anyone able to search didn't have to ask a new one - AI just made the finding those answers ahead of time much more likely.

SO (and other SE sites) are simply down to a higher degree of real questions.

@Computeum @nixCraft The graph includes deleted questions but does not include any context to contrast with answered, duplicated, or spam questions. It's like it's designed to carry only one narrative.

Stack Overflow was never meant to be where every single person asks the same "How do I add an item to an array in [language]?" except maybe one person once per language. It's where you go to find the answer but that involves surfacing existing answers via search, not asking it again.

@nixCraft i think most people don't read Wikipedia even before GPTs. The site is mostly visited by people who care more about true facts than quick facts. And Wikipedia is the place for true facts. Without it, the Internet will be dead.
@harrier17 @nixCraft Wikipedia is an important source of information and the quality has improved over the years. Yes it's great for *many* things, like #technology and #popculture, but I still run into pages that are amateurish and poorly written, often to the point where #ChatGPT could do a better job.

@nixCraft There'll be few tears shed by people who were starting out with a new technology, wanted a place where they could ask a question to clarify their understanding, and then got told:

  • "read the fucken manual, it's all in there"
  • "this question has already been answered, did you bother searching? "
  • "don't do that, do this instead"
  • "this question is off topic, closed"

They could have remained relevant if they provided genuine value and true knowledge, not rewarded gatekeeping.

@brendan @nixCraft

I can favourite this only once, but please feel it at least 10 times stronger.

@brendan @nixCraft

Your post was closed as a duplicate

You go to the duplicate only to find a 5 year old post with one matching key word which was never answered

@rumbles @brendan @nixCraft or my personal favorite:

the top answer from 5 years ago has 637 upvotes because it solved a widespread but very temporary bug that happens to also show the same error message, without explaining anything.

below, there are 50+ "same here, tried X, idk" "answers" scattered through the years with various scores.

two thirds of the way down, the correct answer sits with 19 points, one comment that says "this is the answer", and the other says that it doesn't work on their hair dryer's WiFi.

Stack Overflow was killing itself through a decade of extreme stagnation and user hostility. do not mourn its passing.

@brendan @nixCraft

Where needs gathered to pool their ignorance.

@brendan @nixCraft I contributed to Stack Overflow so much I even got a free T-Shirt from them. On the other hand, I stopped contributing because their culture was annoying me.

It makes sense that people loved LLMs: even when those were trained on those toxic comments, RLHF takes care to trim this toxicity out, leading to a "somehow better" perceived UX than SO.

@nixCraft as long as #wikipedia stays open and free and sourced it wont go away. LLMs have just scraped all the novel data from Stack overflow and docs and there is no need for the question-answer-vote model anymore. A good chunk of people use Wikipedia because it's NOT an LLM.
@nixCraft I don't think the same fate will strike Wikipedia. For one thing, people didn't generally form any fondness (or, if anything, did feel offended or unjust) with SO, so when people heard of an alternative tech, they might have thought "Screw that. I'm jumping ship" without thinking too deeply about topics like free internet. On the other hand, (I think) people generally see Wikipedia very favorably and easily associate it with free internet
@nixCraft so much so that, if it closes down, it'll be perceived as a real threat to internet collapse. I think that's one big reason why people think they should "protect" it, but not exactly SO. (And SO being a proprietary company is another big reason why the cases may not be the same.)
@nixCraft Even Google Maps seems to become increasingly unreliable.
@N0tSure @nixCraft Google Maps is relying way too much on AI nowadays: there are so many ghost roads that are inserted because their AI threats pavement as roads, leading to private parking being considered public roads. Asking them to remove doesn't work.

@nixCraft Not exactly to your point. I'm just wonderening: Wouldn't the numbers before ChatGPT be exactly what to expect from a knowledgebase platform? As soon as there is a solid stock of answered question, the need to ask new questions diminishes.

I created my account 12 years ago and asked exactly one question, but found many others already answered.

@nixCraft cant wait for that stinky bubble to crash
@nixCraft The day they allowed ai to train on answers marked the end for me. When I tried to delete my posts which were then restored and I was threatened to be blocked the internet as it was died for me. Not going to share my stuff online on any platform anymore unless I have some control over it.

@nixCraft I hated asking questions on SO. Every time I asked a question along the lines "How do I do X in Y without Z?" a bunch of smartarses would pile on saying "You should really do Z or Q instead".

I'll be happy to see it go. The brigading trolls can go moderate reddit or some other shithole.

@elricofmelnibone @nixCraft

Plus the block wardens downvoting within seconds of using wrong vocabulary which may remotely be interpreted as "off topic". And downvoted questions are mostly dead.

But this developed over the years.

Keep the News in the Wayback Machine | Internet Archive Blogs

@nixCraft stack overflow ca. 2011 was an amazing upgrade from experts-exchange

@nixCraft Idk the wack mod stuff came in once the questions got pretty niche. For years you could answer obvious questions and score huge rep, which, imo, helped drive the site’s actual growth — the growth of its knowledge base.

Then once the knowledge base was lain and questions became more user/use case-specific (or, yes, unf, also super simple ones that were often poorly written dupes, probably b/c there’s a correlation between bad search skills & bad composition), it felt like the good-natured, selflessly motivated answerers lost interest and moved on to more rewarding tasks.

TL;DR: It wasn’t the moderation that was killing SO before AI. It was SO’s natural conclusion.

(And, sure, b/c Joel & Co. sold the company, but don’t get me started on that disaster.)

@nixCraft I deleted my account when a question of mine had the code heavily edited by a mod for no reason. I objected, reverted it and was the banned for a week and was given a self righteous justification for the edit and ban. After that I CBA’d with helping them with questions and answers.
@nixCraft The terrible people policing Stack Exchange, especially on the physics board, are the reason SE sucks. They're arrogant, clueless (too many grad students), jerks who think they're God's gift to science when they're really failed souls desperately clinging to some semblance of petty power because it's all they have in their miserable meaningless lives. I long for the day the entire SE network goes away.
@nixCraft I'm not sure Wikipedia relies on its users in the same way. Both predominately rely on a small group of unpaid editors for content generation. But Wikipedia's donation funding model means that if visits drop to zero it has no immediate effect on their ability to pay the bills. I've been donating monthly for years, and the amount hasn't changed.
@nixCraft does the graph actually go to zero?
@saxnot @nixCraft Yeah are there really 0 questions being asked in stack overflow or is the chart just off

@nixCraft this is going to back fire spectacularly or things will evolve.

Who knows. There's more accessible self hosting solutions than ever before. Maybe we just end up creating a more decentralized version of the web.

Imagine getting rid of having to pay for a registered domain and having a system of automated and endlessly federated domains.

@nixCraft I gave up after 4 attempts to get a question through the moderators, pre LLM
@nixCraft I thought Wikipedia was already falling apart & selling out to LLM companies. Weren't they allowing LLM contributions & selling articles to LLM companies?

@jackemled @nixCraft
Form what I understood, the public URL of Wikipedia was getting hammered by AI agents scraping their content, to the point where their servers were going down and users had trouble accessing it. So Wikimedia provided a high bandwidth content API for LLMs for a fee, relieving the pressure on the public URL. Given that the LLMs were going to extract the content one way or another, that seemed like the best approach for Wikimedia.

https://futurism.com/artificial-intelligence/wikipedia-ai-deal

After Being Pillaged By AI Companies, Wikipedia Signs Deal to Get Paid By Them

Wikipedia has signed licensing deals with a host of major AI companies in a bid to recoup the costs of being pillaged by data scrapers.

Futurism

@nixCraft

One can clearly see that the trend had started much earlier - then COVID gave it a shot in the arm, but then it just continued. LLMs only hastened that

@nixCraft wait!
people got so bored and desperate during covid that they started learning computer stuff??!!
(I really missed that while doing my own bread and beer).
@nixCraft stackoverflow seemed good for lots of mediocre advice. I wrote off wikipedia back in 2001 as useless, I'm worried about 2 things: w3schools, and the internet archive/waybackmachine, both of which have been invaluable to me along the way.
@RueNahcMohr @nixCraft w3schools used to be awful, I hear it's much better these days