Mike FraserIn the trenches I've been making investments in being able to host and run our own open weight models as I wait for the inevitable rug pull from the big AI companies. Surprisingly if you use the right combination of models and some specific used equipment you can achieve good results.
Kerry Stevenson@mike What gear are u using?
@krst We are using a 4u supermicro chassis with eight GPU bays. I'm adding GPUs as cash flow allows. We also have a new strix halo box that we use for development, etc. So far under 15k in gear. As always more compute would be lovely.