cshotton
Manton ReeceCatching up this morning on all the OpenAI and Microsoft news. Hard to overstate how dramatic a weekend this was for the tech world. As a (small) OpenAI customer, I’m not sure where this leaves me. One thing is clear: Satya Nadella is a really impactful CEO. He turned a crisis into a triumph.
@manton If I were you, I'd skip worrying at all about OpenAI. Go get a copy of LM Studio, pull down one of the Mistral LLMs from HuggingFace, and never look back. OpenAI was dead in the water before it started. The Open Source LLM scene is going to eat their lunch in not too long.
@cshotton I should play with that. I don’t think I want to run my own AI stuff, though, at least not yet. Because of the processing power needed it’s such a nice thing to outsource.
@manton I have a pretty vanilla Mac Studio M1 and it runs these things fine. LM Studio replicates almost all of the OpenAI APIs and runs all of the Llama-derived LLMs as if you are talking to ChatGPT 3.5 or 4. The only missing piece at the moment is function callbacks. You'd be amazed at how well a 4 GB model like Mistral 7B does running locally. It takes about 5 minutes to get it all going. Give it a try! https://lmstudio.ai/
