Carl T. BergstromNov 15, 2022

It looks like Meta just quietly (?) rolled out a new Large Language Model trained up on the scientific literature. At first glance it's not terrible—I was thinking I had reviewed worse—but it starts talking nonsense after a while.

Still, interesting and makes me think about the research papers I'll be receiving from students in coming years.

https://galactica.org/?prompt=literature+review+on+costly+signaling+theory&max_new_tokens=1400

literature review on costly signaling theory - Galactica

Show threadCarl T. BergstromNov 15, 2022
"If the seller does this, then the buyer will buy the phone at a higher price than it is worth, and the seller will lose money."
Show threadCarl T. BergstromNov 15, 2022

Feeling a bit bad now TBH.

Maybe I didn't give them enough credit.

I thought it was just a language model that produced middling results. I didn't realize this was "a new interface to access and manipulate what we know about the universe."

Show threadMike Taylor 🦕Nov 15, 2022
@ct_bergstrom Galactica has a ways to go yet. The answer is was looking for was "CM 84, CM 94, CM 307 and casts from other specimens", but I would have accepted "CM 84".
Show threadMike Taylor 🦕Nov 15, 2022
@ct_bergstrom Much better answer on this one, "which dinosaurs are included in the group diplodocidae". It missed Torneria, Kaateodocus, Galeamopus, but the ones it did name are correct. Sort of "good enough for high-school homework" level.
Show threadMike Taylor 🦕
@ct_bergstrom Oh dear ... And it seems so certain! But, no Xenoposeidon does NOT belong to Tyrannosauridae!
Nov 15, 2022 at 10:22pmWeb
Show threadMike Taylor 🦕Nov 15, 2022
@ct_bergstrom It's pretty darned poor on the causes of Brexit, too.
Show threadMike Taylor 🦕Nov 15, 2022
@ct_bergstrom LOL at the 1977 publication date of Marsh 1880.