Dr. Fortyseven 🥃 █▓▒░#LocalLLM update! I was able to implement this rather complicated feature using Pi and Qwen3.6 27B.
It added a rendering state to my #Chit LLM chat app that renders rectangles over the uploaded image.
Basically you ask for a specific JSON format back, and if it detects it in the stream, it'll create a new image, rendering the rectangles over the objects.
It didn't work immediately out of the gate, but it took a couple turns to fix some bugs. But ultimately it DID work, and so far it works great. :D
But the real headline is that I didn't use Claude or OpenAI stuff. All local. 4090. 24gb.
That's the future we need to head towards if we're going to be using AI for coding going forward. If we're going to shift towards this method of development, we CANNOT be bound to any company, with their leash around our necks and wallets.
aparatorul
Scott Williams 🐧
cs