Ariadne Conill 🐰
can i talk to an openclaw bot using internet relay chat? if not, then what is the point
my suspicion is that i can *handwaves in the direction of kent overstreet*
you see, i have built my own LLM, using the most ethical method possible: i trained it on the entire corpus of IRC logs in my possession, 2003 to present
no giant water vaporizing data centers needed here, just a GPU, a dream and some cold hard chats
time 2 implant this brain into an openclaw and give it full access to my email
mostly because i don't want to retain any of my email
so i installed it into the openclaw meme thing. and it's not like, doing the stuff it claims it is doing.
like it is hallucinating things like "i updated SOUL.md with xyz"
i seriously do not think this stuff is real now
like i need you to understand, i haven't even gotten through *setup* because the model apparently does not know how to use tools correctly. admittedly it has less than 1 billion parameters, and i don't know what the hell i am doing, but still.
can we get to the part where it is AI winter again already? this is not even fun. i want to throw my computer and its' very expensive RTX 6000 Blackwell GPU out my window.
i just wanted to put an openclaw on irc as a fucking shitpost man
and you tell me people legitimately are using this software.
how?
is it really magically better when you hook up claude?
(don't worry, i am running this in a MicroVM under kubernetes, I wouldn't dare give it access to anything I care about.)
i wonder if the problem is that the model i trained is too shit to do anything other than really bad ERP
ok, i incorporated the feedback of some of the ML researchers who follow me, and dropped the openclaw-as-IRC-bot idea. it just isn't feasible.
instead, i've written a very simple vector database in Elixir, and a very simple IRC client in Elixir.
it can remember things about people in the vector database, those factoids are spliced into the system prompt.
the last 10 messages are also spliced into the system prompt
and then the new message is the user-supplied prompt.
no sliding context window.
Dan
Not a Spring Onion
fraggLe!
Laurent Bercot
mx alex tax1a - 2020 (6)
Toasterson (Till Wegmüller)@ariadne yes. For 3B and lower you need targets. You could try hooking it up to my Akh-Medu experiment as there I only need a. Small LLM that does Natural Language https://akh-medu.dev But I think the NLU is still quite broken or hooked up in the wrong way. But A Kluge system like that should use muuuu h less power than a pure LLM
@ariadne Also for tool calling you need targeted fine tuning best with the exact samples for the tools