The Local Alternative

#webcomic #krita #miniFantasyTheater

@davidrevoy And that is exactly the big lie. The magic of brute force token jumping your way to a patch only works if you have gigawatts of Nvidia filled data center powered by methane jet engines. And nobody knows the actual cost of any of this. You try it locally and it's just making your m4 laptop, that normally churns Blender Cycles renders in seconds, crazy hot to touch and takes hours instead of seconds. It seems way less efficient than ... blockchain.
@jimmac True, my local tests here were mostly with https://flathub.org/en/apps/com.jeffser.Alpaca (advantage of being easily removed and leave the computer clean after test). I tried few models available, but even on my workstation, I saw it was slow. Very educational to imagine how screaming some distant CPU and GPU must be on the servers of the AI compagnies, and how they make it totally invisible to the end users who are asking questions on their phone 'for the fun', not even questioning the (hidden) cost of it...
Install Alpaca on Linux | Flathub

Chat with AI models

@davidrevoy @jimmac that's the huge point Ed Zitron has been making for some time now: if you expose the true cost of this product to the users and bill them for every stupid prompt, oopsie and hallucination, nobody will want to pay for it.
@davidrevoy @jimmac and it's so obvious and anyone with a PC can test it locally like you did and see for themself, and yet nobody cares, it's so frustrating