no notes

@karl

europe needs to implement climate goals and develop a high quality ai that does not need nor use amerikkkan it garbage fraud ...

@dibi58 @karl this is literally incompatible. Every LLM needs huge quantities of resources to run, and that won't magically change because we'd use an European one.

@orange_lux @dibi58 @karl for most purposes you don't need a LLM at all

cut 95 % of all car usage
we want public transport

cut 95 % of all LLM usage
(i don't know the details but I do know the LLM garbage on e. g. immoscout or visualping is useless to me ; just drop all of that)

@saxnot @dibi58 @karl and for what purposes should we NEED an LLM ?

@orange_lux @saxnot @dibi58 @karl llms are useful for NLP. Inference is actually relatively cheap, it's the training that's really expensive and resource intensive. We've probably already maxed out LLM capabilities, so most of this training is not useful. Companies keep training because they need to convince investors that infinite growth is possible. What actual gains are being made are coming from architectural changes, not from training.

Basically, "AI data centers" should not exist. Local models can do everything that's needed. If we need to train new models, those need to be balanced against climate goals (basically, don't fucking do it). And LLMs should be removed from basically everything they've been shoved into recently.

If you don't know why LLMs are useful, you shouldn't have to interact with LLMs. Even some of the places where they are useful, they can be used to construct cheaper models.

There are a few things, like correlation across huge data sets, that they're useful for. But even then, simple encoding can give you semantic search, where inference is not necessary or only provides minimal additional benefit.

Yeah, basically, 95-99% reduction in cars and AI. It's basically the same thing.

@Hex @orange_lux @saxnot @dibi58 @karl I suspect you're underestimating the compute being dedicated to running (not training) the models.

I was recently observing a conversation between small startup founders who are buying €100k EGX Station AI workstations to move their developers from Cursor/Claude to local models. The same person seemed both to be questioning the value of all this LLM use by his dev team, at the same time considering buying €100k in hardware to reduce his LLM costs.

@sherbang @Hex @orange_lux @saxnot @dibi58 I work at a cloud provider and can confirm that running ai isn't as cheap as it sounds.

My take is that most models are so general purpose that they're very inefficient (versatile, yes, but inefficient). Think "sorting an array through a bogo sort" inefficient. LLMs trained for a specific purpose may be more cost-effective to run long term, but that's not the norm.

@karl @sherbang @orange_lux @saxnot @dibi58 I know how much it takes to run at least basic models because I'm running local models for experiments. I won't use hosted models because I'm not giving them money or training data. But yeah, capitalists are trying to sell something that doesn't exist and that they don't understand.

I would be entirely unsurprised to find out that even inference on corporate models can't cover costs. To sell "AI" it has to be a thing that just works for everything all the time. It must take no thought. That's incredibly wasteful.

It needs to stop being subsidized, just like cars.

@Hex @karl @sherbang @orange_lux @dibi58 100 % agreed

the AI hype is absolute madness
can't wait for the bubble to burst

@Hex @orange_lux @dibi58 @karl

> Companies keep training because they need to convince investors that infinite growth is possible.

jup
once again it's capitalism

@Hex @orange_lux @dibi58 @karl > like correlation across huge data sets, that they're useful for

uh do they?
isn't this a domain already domineered by other ML?

dont misunderstand me:
Transformers can see structures noone else can see
but why an LLM for that... feels misplaced

@orange_lux @dibi58 @karl same we use CNN, RNN, ... etc
LMM is just another useful helpful machine learning type.

in contrast: blockchain was useless from the start.
LLM is boring tech blown into weird proportions due to greed, capitalism, tech-oligarchy, etc.

@orange_lux @dibi58 @karl e. g. the sort of stuff which ranks search queries, recommends videos, "people also bought", ads, mall layouts, etc

site note: my degree has focus on data/ml stuff

@saxnot @dibi58 @karl I'm not working into data, I'm "just" a normal dev, but we had ways of recommending stuff (also bought, recommendations) way before LLMs. I don't think this is an example of why we would need them.

@orange_lux @dibi58 @karl yeah so?
we had recommendations long before our current gen (pre llm) stuff

so?

data science is a trillion dollar industry
yeah there was more than one generation of recommendation algorithm
llm are a new tool and at some things they are better

@orange_lux @dibi58 @karl those amazon recommendation matrices are not cheap either

not really a comparison that is fair but LLM is just a minor evolution in a field with centuries of real life usage, development etc

@orange_lux @dibi58 @karl today I don't have the capacity for whataboutism

you're missing the engineering point

there is already enough misinformation out there

@saxnot @dibi58 @karl so let's end this conversation here, then.

@orange_lux @dibi58 @karl technically we don't "need" anything
are llm a useful tech with pros ans cons?
aee gasoline engines a useful tech with pros ans cons?
are paperweighr a useful tech with pros ans cons?

but there is no "AI"
no A(G)I was ever invented
the media around llm is detached from reality, frentic, toxic and more positive than the reality warrants

@orange_lux @dibi58 @karl Technically, given the kind of compute for energy ratios that human brains (and other dynamic nanosystems) manage to accomplish, it should be quite possible to accomplish with synthetic biology.

We just need to get much better at it and forget ever accomplishing it on static compute (stop even trying, the efficiency is too bad).

The efficiency of digital static compute is laughably bad at the best of times.

@dibi58 @karl Then more focus on machine learning, less on large language models? I agree, LLMs are a hideous waste by design.
@nini @dibi58 there's an in-between where you still train an LLM but it's more focused, but in essence, yes.
@karl @dibi58 Can't see why LLMs need to be involved, they're not very good and the sheer amount of effort in training an LLM from data collection to tagging to getting anything useful out of it is in opposition to any climate goals, moderate as even the most radical ones proposed will be.

@nini @dibi58 I would like to see research supporting such an assertion.

I dislike LLMs very much, which I why I don't want to make unsubstantiated claims that can be debunked by LLM supporters, which would discredit any other concern, however valid, that I have with LLMs.

@karl they are like a plague, they are going to kill you with heat, floods and bombs. Destroy their nightmare so we can dream again
@karl They are not wrong... hoping Europe chooses life
@karl they're going to choose both - by building their data centres in Asia/Africa. Like how they bought their plastic waste problem down by exporting their garbage.
@karl Computer haben andere Bedürfnisse als Menschen. Menschen sind nicht mehr notwendig, wenn es KI gibt.
@rumpelheinz @karl Ein gutes Argument dafür, warum wir keine KI brauchen.
@karl The article has been amended to remove the quote "Editor’s note: This is an updated version of the article. The previous version wrongly quoted Jeff Bezos. The error is regretted."

@th @karl LLM is a dead end towards AGI and I thought that was shown to be true since years?

what a crazy take
we need established solutions to established problems
e. g. de-carbonize agriculture, steel, energy, etc.

total water recollection (closed loop)
never pollute wastewater with pfas
those are already bare minimums i would say
and just don't build them in the first place we already have an over-supply for this no-benefit bubble

@th @karl i want established solutions to established problems

Gimme a wind turbine, veggie-first food, gimme free train rides etc
all of this has been invented a generation ago and we can switch once the [imaginary thing] has invented better

e. g. hyperloop is garbage and was never better than e. g. railroad
(and we knew the vacuum train idea is a dud centruries musk "invented" it (patented 1799 and shown to be a dud >50 years ago)
and yet the hyperloop hindered the california rail expansion

@th @karl assuming a hyperloop thing is invented tomorrow and it's better than trains
until then we go all-in on trains

assuming a better energy source is invented tomorrow
great
until then we go with wind / solar / storage / etc
but UNTIL THEN we do that
e. g. german politiclowns are obsessed by fusion power (the same party which starved fusion research funding now wants to start building today).

should be obvious common sense (because it is)
musk, cdu, etc are "ideology" to use their lingo

@th @karl satire is dead (example #7372726382927)

@karl ok easy choice

continue living
v
billionaire pet project

easy choice

@karl maybe we can get the tech bros to care about the environment if we spin it that they need to save the fresh water needed for the data centers 🤔
@karl i cannot comprehend how this is something to choose.

how stupid can you be to pick between those two
@karl we lost france to the great freezing ​​ (guillotine the guy who colored this map)

@Stellar @karl

Coloring makes sense, if you interpret the grey as "dead land".

@Stellar @karl C'mon, that's good, so nobody can call this map alarmism. 😉

https://www.mimikama.org/rote-wetterkarte/

Das Geheimnis der roten Wetterkarte!

Auch heute gibt es wieder Wetter, Wetter, Wetter!

Mimikama
@karl Imagine a group of hyper-intelligent beings building an incredibly powerful computer AGI in order to find out the answer to the ultimate question of life, the universe and everything ​

@karl jzzz Data Centers can be optimize by a lot.
If we are still able to contact Voyager 1/2 how the help we can’t optimize IA, datacenters, etc.

Buy buy buy, crap crap crap …
We need to get to basics and build with few and what we have.

It’s possible to reach climate goals and have computer power. But for that we need to have the essential and work with it.

@karl Difícil elección. O morir de calor en pos del beneficio de los ricos o no hacerlo. Dadme por favor 9ms para pensármelo...
@cucufaiter @karl 9 minutes? Yep same with me, spent all my tokens, query still running.

@karl That's true, but the temperature info graphic is horrendous. It is in absolute temperature and goes from -30°C - 50°C... that's bonkers.

Don't use stupid graphics, if the good ones are out there. (relative Temperature for a day is much better. )

@karl I would like the @EUCommission to take note and do something USEFUL for a while instead of saying just "yes my lord" to whatever tech lobby comes to them.
@karl En Politico zal ons even vertellen wat wij moeten doen of laten? And Politico is the instance telling us what to do or not?
Europe must choose between AI and climate goals, data center lobby says

Tech sector says only carbon-emitting gas plants are reliable enough today to power the EU’s AI goals.

POLITICO
@karl Clear choice there, except for absolute idiots who think they can exist without the environment their species is adapted to.
@karl They need to really think about that. https://www.youtube.com/watch?v=SPQNPJ0CEPo
Cory Doctorow: AI Is Turning Workers Into Tools

YouTube
@karl we have #gaskathi katharina reiche
@karl So this is how the fight of humans vs machines will go.