Good morning folks

*sees 'we don't know what dinosaurs sound like' tumblr post*

Buuuuut... we do. We're pretty fuckin' certain.

See, I dunno how to tell you people this, but we did some modelling back in the 1990s...
Turns out, folks, Scientists are batshit fucking cool.

You know.

when we're not maliciously defunding them.

Spending a bit of time, tonight, slowly reworking/expanding the finetune dataset instead of dumping more into pretrain.

Pretrain SEEMS to be coming along, but glancing at the finetune, I think some of these simpler examples can be enhanced quite a bit.