Does anyone have the "Big Assembly" or "SuperCoder" benchmark sets? These seem cool (big sets of inputs for superoptimizers) but I don't see any way to download either.
@regehr might know?
@geofflangdale
- 90 Followers
- 13 Following
- 308 Posts
Lucius Shepard (extremely good SF author, albeit with a few oddities - a bit too horny for my tastes and rather prone to writing short stories whether he's writing a novel or short stories) set Life During Wartime in a US invasion of South America, and opened with this banger:
Glyphit's truly amazing what LLMs can achieve. we now know it's possible to produce an html5 parsing library with nothing but the full source code of an existing html5 parsing library, all the source code of all other open source libraries ever, a meticulously maintained and extremely comprehensive test suite written by somebody else, 5 different models, a megawatt-hour of energy, a swimming pool full of water, and a month of spare time of an extremely senior engineer
The answer to "where's all the software" is "nowhere, because these things are just getting used to cheat on assignments and build amateur-hour demos and prototypes". They are really not that far advanced from simple plagiarism. For student assignments and boilerplate they work well, but if examples aren't in the corpus they're rubbish.
needless to say, I am being helpfully corrected over this observation by a horde of the Bad App's dumbest users, the majority of whom couldn't software engineer their way out of a wet paper bag
oof have been raging out on the Bad App about this one
weirdly, those in possession of the Magic Software Generator are letting others use it and posting huge losses, rather than, idk, making bank selling software. It's curious.
Poor old Chuck.
Just recently went down a Faith No More Wikipedia k-hole after the Guardian article on their keyboard player.
A fine, mature article that managed to discuss how Roddy Bottum* was, or at least claimed to be, the first out gay man in rock without ever using the words "nominative determinism".
* the name he was born with, to be clear
SMTLIB2 folks: is there a good way of mechanically estimating the cost of a doing an assert ahead of time based on some sort of mechanical trick? In the theory of bit-vectors, we have everything from bvand (easy) to bvmul (!) and bvdiv (!!?). Quantifier-free answer OK.
@regehr seen anything like this?
I think of this quote when I think about the idea of AGI meaning "human and artificial intelligence have reached functional parity". Many effects of AI will help achieve this; unfortunately, most function by lowering effective human intelligence (e.g. hollowing out education).
“The junk merchant doesn't sell his product to the consumer, he sells the consumer to his product. He does not improve and simplify his merchandise. He degrades and simplifies the client.”
― William S. Burroughs, Naked Lunch: The Restored Text
