Thomas Fuchsso if AI is so amazing, why don’t articles and books written with it have huge “proudly made with AI” banners and stickers on it
we all know why
Rene Wooller@thomasfuchs the largest LLM has something like a trillion parameters. A little more than the number of synapses of a mouse. So I guess you can think of an LLM as an extremely learned mouse that is trained to appease
CohenTheBlue@renetron @thomasfuchs A mouse will truly learn *without 3rd party input* to respond to situations, like if the cheese in the middle of the dungeon that their mouse friend ate kills the friend, they'll avoid it.
LLM is not intelligence, it is a statistical generator with a huge amount of exceptions (not like synapses). I don't think the mouse and an LLM equate in the least.
@cohentheblue @thomasfuchs cohen what do you mean by “huge number of exceptions (not like synapses)”?
@renetron @thomasfuchs 1/2 As I understand it, an exception (parameter) is a rule describing how to act in case a certain situation comes up.
I was referring to the use of the word synapse by you, @renetron
"... trillion parameters. A little more than the number of synapses of a mouse."
A synapse is something both much more specific than an exception (parameter), flexible but also more general. I don't know enough to say if using "synapse" in this context is correct.
@renetron @thomasfuchs 2/2
What I was trying to get at is that LLM parameters are not an indication of intelligence / sound learning decisions.
Not directly relevant, just trying to figure out synapses and intelligence:
This paper
https://pmc.ncbi.nlm.nih.gov/articles/PMC4685590/
states that equating the number of synapses with intelligence is debated. EDIT: clarified, added original publisher link to study
@cohentheblue @renetron generally you cannot compare brains with computers because they work fundamentally differently (the most fundamental one is that a brain doesn’t run software but is a physical object subject to, well, physics; and doesn’t “compute” things, there’s no conversion of symbols happening)