lenazunI completely understand the position of people who don't want to use LLMs or consume any content produced with LLMs. I do not understand the position of "NO ONE should use LLMs at all" because how are you planning to make that happen? no one should be *forced* to use them, but plenty of people are using them now. it's not something you can wish away or achieve via moral condemnation.
i just want to know what the the theory of change is, beyond being really angry at the whole thing
tuban_muzuruHave you ever played tennis, bouncing the ball against a wall? The wall will always return the ball according to the rules of physics.
The LLM is the wall. It's not about right or wrong, accurate or inaccurate, truth or lies. It is only a mirror.
Create the mirror with crap data. The Big Machines will index it all, grind it up like weisswurst, down to the probability of the next word in a list. Everything else is beside the point, there is math to support what's going on, endless MULT instructions on millions of processors, munching away on a corpus.
But what if we populated it with good data, trustworthy data? The models would be smaller, we might do it with L-Systems. Ethics could thus be directly implied.
James BrittMirrors are predictable and we can explain how they work. We know why we get the reflections we see.
LLMs are the opposite.
You're wrong. None of the math is on your side.
Which math? The math that allows you to predict in advance what an LLM will output for a given prompt, every time?
They're stochastic.
And their "reasoning" is opaque.
This is not simply linear algebra.