Less than a week until #AIFORWARD in Charlotte! Excited to close out the event with "Trust, But Verify: A Practical Path to the 5% of AI Pilots That Make It To Production." 🎤✨
Oh, and I might have a FREE pass or two.. More info 👉 https://bit.ly/3WkmEps
Excited to share that I'll be speaking at #AIFORWARD in Charlotte, NC! 🎉
My session, "Trust, But Verify: A Practical Path to the 5% of AI Pilots That Make It To Production", is happening Tuesday, Oct 28, at 4:00 PM ET.
More info 👉 https://bit.ly/42JZsVb
In case anyone wants to run their own #LLM on their personal devices, I can suggest #lmstudio It allows you to download any major model that's out there to your own laptop/desktop, and then you can use it's Graphical Interface to interact with it in a familiar interface environment, as you would #Claude or #ChatGPT or #Gemini. It will also let you know if your device has enough resources (power) to run a specific model variant: https://lmstudio.ai/
For those of you who love the Terminal (aka: Command Line Interface or #CLI), check out https://ollama.com/
For starters, I suggest the #gemma3n model (works great on tablets, laptops, or phones), or #llama3.1 for the most common interactions. While most of us geeks will have very powerful personal systems, or servers in our home racks, most people do not have high-end systems/devices. The gemma3n model is lightweight, very powerful, and a solid general purpose LLM.
What's the benefit of running LLM's locally? #Privacy is a big one (it's running on your local machine, not a cloud server) - so you can ask it questions against sensitive business data, PHI/PII, etc.. You can also run it #offline (no Internet connection required) so if you wanted to #airgap your interactions, or play with it on vacation (on a plane, lost in the back country, etc.), you can absolutely do that - even with the Deepseek model.
I started playing with both LM Studio and ollama myself - been asking models basic questions like "what is the capital of Italy" and also more complex questions like "write me a #powershell script to add users of a specific OU to a number of Security Groups within AD" and so far, it's been very accurate. The PowerShell script llama3.1 provided worked out of the box (after I revised variables to match my environment).
#DARPA is holding an #AIForward event this July and I am an invited participant.
https://www.darpa.mil/news-events/2023-02-24
The event will explore answers to the most pressing questions related to #AI #ML.
How do we intelligent systems safe, useful in real-world applications, and are trustworthy?
My own perspective is that insights from #SocialSciences are crucially important. Ranging from intelligent reasoning theory all the way to longitudnal, ecological experiments.
David vonThenen
Geekmaster 👽
Shiwali Mohan | शिवाली मोहन