Local LLM App by Ente

https://ente.com/blog/ensu/

Ensu - Ente's Local LLM app

Introducing Ensu, our first step toward a private, personal LLM app that runs on your device and grows with you over time.

ente

I would love to see a "distributed LLM" system, where people can easily setup a system to perform a "piece" of a "mega model" inference or training. Kind of like SETI@home but for an open LLM (like https://github.com/evilsocket/cake but massive )

Ideally if you "participate" in the network, you would get "credits" to use it proportionally to how much GPU power you have provided to the network. Or if you can't, then buy credits (payment would be distributed as credits to other participants).

That way we could build huge LLMs that area really open and are not owned by any network.

I would LOVE to participate in building that as well.

Oh yeah, and maybe call it "SkyNet" or something.