Today I learned two new ‚words‘:
- #HabsburgAI
- #BoomerBrowsing

#til

@davidgerard among others, have long been warning that the #GenAI giants are running out of content to consume for “training”, and they're getting desperate for more.

No surprise at all: #SamAltman, being the kind of person who's so contemptuous of human #culture they think an #LLM can do it, proposes the robots will just generate more training data themselves! What could go wrong?

“Prof. Sammut says generative AI systems have big limitations because chatbots lack critical thinking.

““These systems are based on doing pattern matching, they are very good at that, but they can’t do any sort of logical sequential reasoning.”

“A chatbot can only tell you 1+1=2 because someone told it so, not because it learned how to do arithmetic.”

https://newshub.medianet.com.au/2024/11/a-synthetic-solution-for-ai-as-chatbots-run-out-of-road/78949/

#ArtificialStupidity #HabsburgAI #Ouroboros

A synthetic solution for AI as chatbots run out of road - News Hub

A leading UNSW computer scientist says a touted solution to a big problem for generative AI is better suited for other forms of artificial intelligence. AI chatbots, like ChatGPT and Google Gemini, are running out of data to eat. Generative AI models have swallowed up most of the data they’re legally allowed to process that

News Hub - Medianet News Hub archive

From the post I just retooted:

"I don't think anyone has reliable information about post-2021 language usage by humans.

The open Web (via OSCAR) was one of wordfreq's data sources. Now the Web at large is full of slop generated by large language models, written by no one to communicate nothing. Including this slop in the data skews the word frequencies."

#genai #habsburgai #wordfreq

Source: "Why wordfreq will not be updated" - https://github.com/rspeer/wordfreq/blob/master/SUNSET.md

wordfreq/SUNSET.md at master · rspeer/wordfreq

Access a database of word frequencies, in various natural languages. - rspeer/wordfreq

GitHub

I'm sorry, how is any of this surprising? If you put a bucket of mixed veggies through a blender & then pour the result + maybe one fresh cherry tomato into some other blenders, what would you expect & if your answer isn't "the same veggie slushie, re-blended" what's wrong with your brain?

What, exactly, did people think would be coming out of these blenders - a bucket of different, even more fresh & delicious vegetables?

https://futurism.com/ai-slowly-killing-itself
#HabsburgAI #ModelAutophagyDisorder

AI Appears to Be Slowly Killing Itself

AI-generated content flooding the web. That could be a problem for AI models, which are widely trained via web-scraped data.

Futurism

Finally, another episode of #grumpyoldgeeks podcast! The only podcast that actually makes me walk around with a wide grin in my face 😄

https://podcasts.apple.com/de/podcast/grumpy-old-geeks/id626471856?i=1000667243884

#habsburgai #podcast

Habsburg AI

Hey, hey we're all Monkees; Waymo rides; Sober Outfitters; the cruel passage of time; Telegram CEO arrested in France; Zuckerberg's bizarre open letter; Uber sl

Apple Podcasts
To me, the most impressive thing about OpenAI (and other companies who followed in its footsteps) is how they managed to scale copyright infringement and violation of Terms of Service (and established practices such as complying with robots.txt) to unprecedented levels. And have so far gotten away with it.
Their content licensing agreements with News Corp, Reddit, etc demonstrate clearly that they're fully aware about their original approach being illegal. #LLMs #openai #Nvidia #habsburgai

People are calling output from an inbred generative AI trained on a corpus that accidentally includes AI-generated inputs "Habsburg Art" or "Habsburg AI", and I approve.

I didn't expect this to be becoming a problem already.

#HabsburgArt #HabsburgAI
#GenerativeAI #AI

"Are We Watching The Internet Die?" by Ed Zitron

#HabsburgAI

https://www.wheresyoured.at/are-we-watching-the-internet-die/

Are We Watching The Internet Die?

Sometime this month, Reddit will go public at a valuation of $6.5bn. Select Redditors were offered the chance to buy stock at the initial listing price, which it hasn’t announced yet but is expected to be in the range of $31-34 per share. Regardless of the actual price,

Ed Zitron's Where's Your Ed At
Large AI models can now create new, smaller AI on their own: scientists

"This is the first step in the path to show that AI models can build AI models," Yan Sun, CEO of the AI company Aizip, told Fox News.

Insider