L4sBotTop physicist says chatbots are just ‘glorified tape recorders’
jadenA physicist is not gonna know a lot more about language models than your average college grad.
That’s absolute nonsense. Physicists have to be excellent statisticians and, unlike data scientists, statisticians have to understand where the data is coming from, not just how to spit out simple summaries of enormously complex datasets as if it had any meaning without context.
And his views are exactly in line with pretty much every expert who doesn’t have a financial stake in hyping the high tech magic 8-ball. On the Dangers of Stochastic Parrots.
Okay but LLMs have multiplied my productivity far more than any tape recorder ever could or ever will. The statement is absolute nonsense.
Do you imagine that music did not exist before we had the means to record it? Vinyl happened before tape but in the early days of computers, tape was what we used to save data and code. Kids TV programmes used to play computer tapes for you to record at home, distributing the code in an incredibly efficient way.
Kids TV programmes used to play computer tapes for you to record at home, distributing the code in an incredibly efficient way.
Could you expand on this? Sounds interesting.
They just played the tapes on TV, kinda screechy, computer-y sounds. They’d tell you when to press record on your cassette recorder before they started. You’d hold it close to the TV speakers until it finished playing, then take the tape and put it in your computer, and there’d be some simple free game to play. I didn’t believe it would work but it did. I still don’t believe it worked. But it did.
There must be a clip somewhere on the internet but my search skills are nowhere near good enough to find one.
[New comment instead of editing the old so that you see it]
I managed to find a video of an old skool game loading. That’s what it sounded like when you loaded a program and it’s exactly what they’d play on the TV so you could create your tape.
Sinclair ZX Spectrum Loading - Jetpac
Thank you very much for the effort! I also searched for text or video, but found none.
I understand now what you previously meant, streaming code via TV.
That’s what it sounded like when you loaded a program and it’s exactly what they’d play on the TV so you could create your tape.
Now I have a new confusion: Why would they let the speaker play the bits being processed? It surely was technically possible to load a program into memory without sending anything to the speaker. Or wasn’t it, and it was a technical necessity? Or was it an artistic choice?
I assume it was because they used ordinary tape recorders, that people would otherwise use as dictaphones or to play music. I guess there wasn’t a way to transfer the data silently because the technology was designed to play sound? We had to wait for the floppy disk for silent-ish loading. Ish because they click-clacked a lot, but that was moving parts rather than the code itself.
The 3.5" Floppy Disk Drive sound
Your statement and the original one can both be in sync with another.
Microsoft Word is just a glorified notepad but it still improves my productivity significantly.
LibertyLizardI think describing word processors as glorified notepads would also be extremely misleading, to that I would describe that statement as incorrect.
Those are all gross oversimplifications. By the same logic the internet is just a glorified telephone, the computer is a glorified abacus, the telephone is just a glorified messenger pigeon. There are lots of people who don’t understand LLMs and exaggerate its capabilities but dismissing it is also bad.
Nope. Biologists also use statistical models and also know where the data is coming from etc etc. They are not experts in AI. This Michio Kaku guy is more like the African American Science Guy to me, more concerned with being a celeb.
Biologists are excellent statisticians too, you’re correct. That’s why the most successful quants are biologists or physicists, despite not having trained in finance.
They’re not experts in AI. They’re experts in the statistical models AI uses. They know an awful lot more than the likes of Sam Altman and the AI-hypers. Because they’re trained specialists, not techbro grifters.
I had that paper in mind when I said that. Doesn’t exhibit a very thorough understanding of how these models actually work.
A common argument is that the human brain very well may work the exact same, ergo the common phrase, “I’m a stochastic parrot and so are you.”
ComradeKhoumragI disagree, physics is the foundational science of all sciences. It is the science with the strongest emphasis on understanding math well enough to derive the equations that actually take form in the real world
Therefore, if you know physics, you know everything.