Them: "LLMs passing exams shows they are capable of deductive reasoning"
Me: "LLMs passing exams prove that exams do not test for deductive reasoning"
Jon Ayre
@JonHAyre
- 38 Followers
- 17 Following
- 69 Posts
Strategist with a fascination for human dynamics & a talent for tech. Father & Husband. Pessimist & optimist: It WILL go wrong & it CAN be fixed. He/him
James Arthur CattellI'm reading, "Is living in the present the best strategy?" https://jonayre.uk/blog/2022/10/04/is-living-in-the-present-the-best-strategy/ by @JonHAyre from October 2022.
If LLMs prove anything it's that many people are easily fooled into seeing intelligence in eloquently phrased vacuousness.
Show me an AI that can get anywhere near the intelligent action of a cat & maybe I'll listen to your claims of "emerging AGI"
https://jonayre.uk/blog/2023/04/20/the-problem-with-large-language-models/
The problem with Large Language Models - Jon Ayre
Excitement and fear are rife as a result of the recent surge in generative AI. There is talk of LLMs replacing search as an information source, but this ignores one important point. Words, in themselves, convey no meaning. In this respect LLMs are a dead duck.
Ed EverettThe armed Met police that are too worried about illegally shooting unarmed black men to do their jobs can fuck right off.
Their 'strike' is the manifestation of the Met's institutional racism. Sack every one that hands in their weapon, they are labelling themselves as incompetent. #London is safer without them
A point of order if you're claiming the brain isn't a computer.
"It doesn't store memories and process inputs" is nonsense.
"It stores memories and process inputs in a different way to our current CPU based computers" is correct.
The brain is a computer - it's just a fundamentally different type.
@jasongorman My original background is in electronic engineering so I tend to use terms and design systems in the same way. I find that software development spends a lot of time reinventing concepts and evolving them into the approaches that engineers have practiced for centuries (agile is an example). There's no harm in that as it leads to a deeper understanding, but it would be better if it was more clearly recognised. Hence "unit" to me is "component".
@jasongorman hence the unit/component test is itself a system into which you fit the component to be tested, akin to a test rig in engineering terms.
@jasongorman Component as in a self-contained piece of code that performs a generic task. E.g. a reusable class in object oriented development. Also components can contain other components. An analogy: a spark plug is a component, as is the engine into which it is fitted. Each can be tested in isolation to ensure it behaves as required. The car is the product into which the components are installed. Component tests make sense independently for the component as well as for the system as a whole.
@jasongorman I prefer "component test" because that's the key difference. You're testing individual components to ensure they behave as expected.
@edeverett Product Design predates UX design by a significant period. Its use in software development is borrowed from the more general term. I agree it's much more company oriented as it focuses on the creation of a product rather than the experience of the user but I'm not sure I agree one is better than the other. That's more about what you do with it.