For my #FIAF presentation & workshop in Bologna end of the week, I've put together a clean "#PlugAndPlayAI" setup:

#USB #LiveDistro: #MXLinux #GNU #Debian with #Ollama, #LLava and #OpenWebUI in #Docker and #LLM files on another USB3 #nvme

Fast like a local install. Given enough RAM and CPU/GPU.

Scary how easy it is to do that.

Bonus: Creates self-replicating #ISO boot images of itself (in current configuration) in less than 5 minutes. 🤯 😎 .

Wow.

Managed to sort out a remotely accessible LLM on one of my computers before heading out this morning. Next step is sorting it on my older Macbook Pro (smaller quantized models work on it so far).

#ollama #openwebui #llm #ai

Im Blogpost hats jetzt ein Update drin, wie man sich eine fancy Oberfläche bastelt, dass die lokale KI aussieht wie "richtig".

#OpenWebUI #LocalAI

Je commence un nouveau petit side project « Setup une instance personnelle d'Open WebUI connectée à OpenRouter »

https://notes.sklein.xyz/Projet%2030/

#SideProject #OpenWebUI #OpenRouterAI #LLM #generativeAI

Projet 30 - "Setup une instance personnelle d'Open WebUI connectée à OpenRouter" - Jardin numérique de Stéphane Klein

Projet 30 - "Setup une instance personnelle d'Open WebUI connectée à OpenRouter"

#OpenWebUI + #ollama + #qwen3 = 🥰

leute, wenn ihr #KI zeugs machen wollt, holt euch ne rtx 3060, die hat 12GB vram und kostet noch so 250.- und installiert openwebui mit docker
ihr könnt auch 2 holen dann habt ihr 24GB (ollama kann das so nutzen), immer noch billiger ist als die billigste mit 24GB

I went to the limit for what #openwebui offers to my #sovereignAI, NGL thing is nifty but kinda shoddy sometimes...

Like a voice control so sensitive that ANY movement pauses answers, defeating the whole point of using voice while walking, in a cafe, cleaning, etc.

Reddit community is kinda ineffective, so now I'm writing straight on repo, as issues

https://github.com/open-webui/open-webui/issues/14500

feat: Improve Voice Input Usability in Noisy Environments · Issue #14500 · open-webui/open-webui

Check Existing Issues I have searched the existing issues and discussions. Problem Description When using voice input, the system continuously listens and responds. However, it is overly sensitive—...

GitHub

From OpenWebUI:

> 🦻 Screen Reader Support for Response Messages
All chat responses are now fully compatible with screen readers, making the platform more inclusive and accessible for everyone.

Well um, I mean, I don't use a hearing aid... But um, that's... Good... I'll see if it works.

#AI #OpenWebUI

The added "knowledge" in #openwebui is a 8kB text file from Wikipedia. Tinyllama is finally able to read it through.
Llama has not got that "knowledge" and is luckily honest about that.
Build a private, self-hosted LLM server with Proxmox, PCle passthrough, Ollama, Open WebUI & NixOS

YouTube