I've been playing around with hosting local #LLMs on my laptop and the results for coding have not been encouraging. I've tried Qwen and Gemma mostly, ranging in size from 0.8B to 30B parameters but all have been beaten in both speed (expected) and quality (unexpected) by even basic free online hosted models. As #AI first #coding becomes the norm, it's more vital than ever before that we don't get locked into proprietary commercial platforms for software development.
Musings on people, processes, technology and the overlaps between them.
Passionate about #FOSS and #OpenData.
I do pro-bono work for non-profits. If you are a #nonprofit, #NGO, #charity, #coop or the like and you need a #fractional #CTO to help you with your IT strategy, implementation or vendor management, then feel free to get in touch.
| website/blog | https://bitfish.in |
| arsalan.zaidi [at] gmail [dot] com |








