Soatok DreamseekerDec 24

Honestly, the thing that will probably kill LLMs the hardest is someone writing a small language model that fits in JavaScript in a browser and hits comparable benchmarks.

Why bother with all those GPUs and energy usage if your Raspberri Pi could get comparable results?

Show threadAriadne Conill 🐰
@soatok already on it :))))))
Dec 24 at 1:05amWeb
Show threadSoatok DreamseekerDec 24
@ariadne Oh hell yeah
Show threadAriadne Conill 🐰Dec 24

@soatok i should clarify: i am working on two models, one which takes an input and tries to spit out structured data

and another which takes structured data and outputs prose

Show threadAriadne Conill 🐰Dec 24
@soatok in an assistant scenario, this allows the assistant to ascertain what the user wants, and then allows the assistant to report back with the results.
Show threadAriadne Conill 🐰Dec 24
@soatok all of this will be AGPL because fuck Big Tech