croFeb 17, 2024
Richard Carlsson
I just love how we've now spent far more computational resources on generating funny pictures and spitting out flawed code than was ever spent on running formal verfication and exhaustive testing on important software because it was thought to be "too expensive".
Feb 17, 2024 at 1:05pmWeb
Show threadJanne MorenFeb 17, 2024

@richcarl
This gave me pause for thought.

I think it's because machine learning is relatively easy - it's just a technical problem, and we're good at solving those.

Changing development practices, languages and tools is a social and cultural change - a people problem - and that is very hard.

Show threadJeremy WadhamsFeb 17, 2024
@richcarl OMG my two biggest AI enthusiast coworkers were just yesterday saying “we don’t want to write too many Selenium tests they’re really resource intensive” 😂😂
Amazing how a zillion dollar company buying market share can distort your perception of sustainability.
Show threadFionaFeb 17, 2024
@richcarl One looks fascinating to people with money and no understanding of the technology, the other doesn't. Somewhat sarcastic, but I think it's likely close to the truth.
Show threadSpud_CoolzipFeb 18, 2024
@richcarl Yeah, but which one gives the public bigger dopamine surges?
Show threadLars Wikman (OLD, find new)Feb 18, 2024
@richcarl the dull part of it is that there is a lot of effort required to do formal verification amd exhaustive testing while instructing an LLM and hoping for the best is trivial effort.
Show threadmirabilosFeb 18, 2024
@richcarl @lawik GIGO applies though
Show threadLars Wikman (OLD, find new)Feb 18, 2024
@mirabilos @richcarl well companies have a poor record of separating well-articulated garbage from valuable insights...
Show threadthe hatterFeb 18, 2024
@richcarl No one gets rich testing code.
Show threadgramFeb 18, 2024

@richcarl

It's called priorities.

Show threadFeacher? I hardly know 'erFeb 18, 2024
@richcarl memes are more important tbh
Show threadAlex ☕🇨🇦Feb 18, 2024
@richcarl we expend resources on things to further conflict, prestige or money. People can see the money behind AI cats. I'm afraid the only thing that would drive forward formal verification is conflict.
Show threadpxiFeb 19, 2024
@richcarl
Not to mention fake money...  
Show threadAndy KFeb 19, 2024
@richcarl How do I monetize tested, correct software?
(/s)
Show threadAndrei KucharavyFeb 19, 2024
@richcarl I guess nobody sold formal verification as “it allows you to save money by firing developers and replacing them with X”, or “it’s so easy you yourself can do it”.
Show threadJes WolfeFeb 20, 2024
@richcarl okay that’s because formal verification stops you from making mistakes while AI helps you make them faster
Show threadStefan Rother-StübsFeb 20, 2024
@richcarl
"too expensive" === "too less fun"
Show threadJ Paul GibsonFeb 20, 2024
@richcarl was there ever a better opportunity to say « the sarcasm is strong with this one »?
Show threadColin CurtinFeb 20, 2024
@richcarl I really feel like llm making formal methods proofs will be an incredible moment