Today's #anvilope update, you can now use llama.cpp for inference! Sort those emails!
there is a reason I haven't added the ability to delete emails to #anvilope
https://www.404media.co/meta-director-of-ai-safety-allows-ai-agent-to-accidentally-delete-her-inbox/
Anvilope has gotten to the point where it can actually be somewhat useful, categorizing emails and labeling them over IMAP. There's still a lot of messy behavior scattered about, but I took the time to write up a more complete README.
Admittedly one of the hardest tasks was figuring out what kind of screenshot to post for a headless program.
Take a look and hit the mailing list if you feel like it.
https://sr.ht/~dvshkn/anvilope/
#llm #rustlang #foss #selfhosted #selfhosting #ollama #anvilope
(Always fun to add to a thread a month later!)
The first integration tests are now pushed up. Fresh eyes helped, and the tests now seem to run repeatedly without issue.
As for what's next, the temptation to yak shave is really strong. Eventually I want to try replacing rusqlite with sqlx, but I should probably try to get to a spiritual version 0.0.1 first. The basics of running emails through the prompt work okay. It's just the rough edges that need sanding down.
Working on #anvilope some more this weekend. Initial support for writing labels to emails after classification seems to be working, which is kind of the crux of the whole project.
The operation isn't difficult because it's just copying between IMAP folders, but I had to stop cutting corners in a couple places to get it hooked up:
a.) Reworked the IDLE handling so it can be properly interrupted when the LLM finishes the classification
b.) Got rid of a bunch of &mut self functions by being more specific with mutexes, just #rustlang things
Anyways, I need to run it overnight to make sure I didn't make things too unstable. I am very satisfied with this simple screenshot though!
For kicks I swapped out mistral 7B for a bit and tried out qwen3 1.7B for sorting emails. It seems more inconsistent but also more skeptical than mistral was. Pretty interesting, will try a larger size.
ǝʌɐp