In our basement, an old gaming PC with an Nvidia GeForce RTX 3060 with 8 GiB VRAM (which breaks down when used for 3D rendering) runs a quantized GLM-4.7 on llama-agent. It's great for getting a feel for what marketeers call "Agentic AI" without exposing my data (or my thinking) to big-tech.

I get mixed results, but it was really useful for getting CI/CT of my old hobby project on GitHub back on its feet. I wouldn't have started doing that without using that system.
#llama-agent #homelab

RE: https://fairdinkum.one/@John/116298933901515490

#alpaca #llama #ROFLMAO #movie #Alpacalypse

https://youtu.be/_ndPugSivwU?si=SwQds001olFnYAeq

#alpaca #llama #ROFLMAO #movie #Alpacalypse

https://youtu.be/aC7U7Y4lDA8?si=UMV1hsMGOr9slTno

Adivina como se llama la película. #peliculas #quizchallenge #cinemalovers #terrorymisterio
https://www.youtube.com/watch?v=7WsX5nLycmU

#adivina #llama #pelicula

🪵 Lleva la esencia de los Andes a tu hogar: Arte en Madera con Alma ⛰️
¿Buscas una pieza que cuente una historia?
🏡 Perfecto para dar un toque rústico y elegante a tu sala con una #llama 🦙 alegre.
Un regalo inolvidable para los amantes del diseño sostenible y los productos artesanales.

compras en:
⏩ https://tinyurl.com/66dhpfbt

#ArteAndino #DecoraciónSostenible #HechoConAmor #CulturaAndina #InteriorismoRústico #RegalosÚnicos #arte #artesania #artesano #grabado #andino #grabadoandino #lapaz

Ever since I bought my #AI mini #workstation from HP, my goal was to run hardware accelerated #ArtificialIntelligence workloads in a #Linux environment. Read more to learn how things turned out on #Ubuntu and @fedora !

https://peter.czanik.hu/posts/new-toy-first-steps-with-ai-on-linux/

#AMD #ROCm #llama #pytorch

AISatoshi (@AiXsatoshi)

Namazu의 Llama-405B Dense 모델 개선이 매우 인상적이라고 언급한 트윗입니다. 대형 오픈 모델 기반의 성능 개선 소식으로, 모델 최적화와 오픈 AI 생태계 측면에서 주목할 만합니다.

https://x.com/AiXsatoshi/status/2036275737511207078

#namazu #llama #openmodel #llm #opensource

Install and configure llama-swap (llama.swap), hot-swap local models via OpenAI or Anthropic APIs, compare with Ollama and LM Studio, and troubleshoot common errors.

#Cheatsheet #Self-Hosting #LLM #AI #AI Coding #DevOps #Docker #llama.cpp #OpenAI #SelfHosting

https://www.glukhov.org/llm-hosting/llama-swap/