europe needs to implement climate goals and develop a high quality ai that does not need nor use amerikkkan it garbage fraud ...
@orange_lux @dibi58 @karl for most purposes you don't need a LLM at all
cut 95 % of all car usage
we want public transport
cut 95 % of all LLM usage
(i don't know the details but I do know the LLM garbage on e. g. immoscout or visualping is useless to me ; just drop all of that)
@orange_lux @saxnot @dibi58 @karl llms are useful for NLP. Inference is actually relatively cheap, it's the training that's really expensive and resource intensive. We've probably already maxed out LLM capabilities, so most of this training is not useful. Companies keep training because they need to convince investors that infinite growth is possible. What actual gains are being made are coming from architectural changes, not from training.
Basically, "AI data centers" should not exist. Local models can do everything that's needed. If we need to train new models, those need to be balanced against climate goals (basically, don't fucking do it). And LLMs should be removed from basically everything they've been shoved into recently.
If you don't know why LLMs are useful, you shouldn't have to interact with LLMs. Even some of the places where they are useful, they can be used to construct cheaper models.
There are a few things, like correlation across huge data sets, that they're useful for. But even then, simple encoding can give you semantic search, where inference is not necessary or only provides minimal additional benefit.
Yeah, basically, 95-99% reduction in cars and AI. It's basically the same thing.
@Hex @orange_lux @saxnot @dibi58 @karl I suspect you're underestimating the compute being dedicated to running (not training) the models.
I was recently observing a conversation between small startup founders who are buying €100k EGX Station AI workstations to move their developers from Cursor/Claude to local models. The same person seemed both to be questioning the value of all this LLM use by his dev team, at the same time considering buying €100k in hardware to reduce his LLM costs.
@sherbang @Hex @orange_lux @saxnot @dibi58 I work at a cloud provider and can confirm that running ai isn't as cheap as it sounds.
My take is that most models are so general purpose that they're very inefficient (versatile, yes, but inefficient). Think "sorting an array through a bogo sort" inefficient. LLMs trained for a specific purpose may be more cost-effective to run long term, but that's not the norm.
@karl @sherbang @orange_lux @saxnot @dibi58 I know how much it takes to run at least basic models because I'm running local models for experiments. I won't use hosted models because I'm not giving them money or training data. But yeah, capitalists are trying to sell something that doesn't exist and that they don't understand.
I would be entirely unsurprised to find out that even inference on corporate models can't cover costs. To sell "AI" it has to be a thing that just works for everything all the time. It must take no thought. That's incredibly wasteful.
It needs to stop being subsidized, just like cars.
@Hex @karl @sherbang @orange_lux @dibi58 100 % agreed
the AI hype is absolute madness
can't wait for the bubble to burst
@Hex @orange_lux @dibi58 @karl
> Companies keep training because they need to convince investors that infinite growth is possible.
jup
once again it's capitalism
@Hex @orange_lux @dibi58 @karl > like correlation across huge data sets, that they're useful for
uh do they?
isn't this a domain already domineered by other ML?
dont misunderstand me:
Transformers can see structures noone else can see
but why an LLM for that... feels misplaced
@orange_lux @dibi58 @karl same we use CNN, RNN, ... etc
LMM is just another useful helpful machine learning type.
in contrast: blockchain was useless from the start.
LLM is boring tech blown into weird proportions due to greed, capitalism, tech-oligarchy, etc.
@orange_lux @dibi58 @karl e. g. the sort of stuff which ranks search queries, recommends videos, "people also bought", ads, mall layouts, etc
site note: my degree has focus on data/ml stuff
@orange_lux @dibi58 @karl yeah so?
we had recommendations long before our current gen (pre llm) stuff
so?
data science is a trillion dollar industry
yeah there was more than one generation of recommendation algorithm
llm are a new tool and at some things they are better
@orange_lux @dibi58 @karl those amazon recommendation matrices are not cheap either
not really a comparison that is fair but LLM is just a minor evolution in a field with centuries of real life usage, development etc
@orange_lux @dibi58 @karl technically we don't "need" anything
are llm a useful tech with pros ans cons?
aee gasoline engines a useful tech with pros ans cons?
are paperweighr a useful tech with pros ans cons?
but there is no "AI"
no A(G)I was ever invented
the media around llm is detached from reality, frentic, toxic and more positive than the reality warrants
@orange_lux @dibi58 @karl Technically, given the kind of compute for energy ratios that human brains (and other dynamic nanosystems) manage to accomplish, it should be quite possible to accomplish with synthetic biology.
We just need to get much better at it and forget ever accomplishing it on static compute (stop even trying, the efficiency is too bad).
The efficiency of digital static compute is laughably bad at the best of times.
@th @karl LLM is a dead end towards AGI and I thought that was shown to be true since years?
what a crazy take
we need established solutions to established problems
e. g. de-carbonize agriculture, steel, energy, etc.
total water recollection (closed loop)
never pollute wastewater with pfas
those are already bare minimums i would say
and just don't build them in the first place we already have an over-supply for this no-benefit bubble
@th @karl i want established solutions to established problems
Gimme a wind turbine, veggie-first food, gimme free train rides etc
all of this has been invented a generation ago and we can switch once the [imaginary thing] has invented better
e. g. hyperloop is garbage and was never better than e. g. railroad
(and we knew the vacuum train idea is a dud centruries musk "invented" it (patented 1799 and shown to be a dud >50 years ago)
and yet the hyperloop hindered the california rail expansion
@th @karl assuming a hyperloop thing is invented tomorrow and it's better than trains
until then we go all-in on trains
assuming a better energy source is invented tomorrow
great
until then we go with wind / solar / storage / etc
but UNTIL THEN we do that
e. g. german politiclowns are obsessed by fusion power (the same party which starved fusion research funding now wants to start building today).
should be obvious common sense (because it is)
musk, cdu, etc are "ideology" to use their lingo
(guillotine the guy who colored this map)
@karl jzzz Data Centers can be optimize by a lot.
If we are still able to contact Voyager 1/2 how the help we can’t optimize IA, datacenters, etc.
Buy buy buy, crap crap crap …
We need to get to basics and build with few and what we have.
It’s possible to reach climate goals and have computer power. But for that we need to have the essential and work with it.
@karl That's true, but the temperature info graphic is horrendous. It is in absolute temperature and goes from -30°C - 50°C... that's bonkers.
Don't use stupid graphics, if the good ones are out there. (relative Temperature for a day is much better. )
Reference, for whoever might care…
https://www.politico.eu/article/europe-choose-ai-climate-goals-data-center-chief-warns/
