Mastodawn

The #OpenCode is working. Check when the Nvidia is used for it
⎿ [Image #1]

● I'll check how #Ollama uses the #Nvidia GPU.

● Bash(nvidia-smi --query-gpu=name,memory.used,memory.total,utilization.gpu --format=csv,noheader 2>/dev/null)
⎿ NVIDIA GeForce RTX 2060, 952 MiB, 6144 MiB, 9 %

● Bash(ollama ps 2>/dev/null)
⎿ NAME ID SIZE PROCESSOR UNTIL
qwen2.5-coder:7b-16k 0533dd01f237 7.2 GB 30%/70% CPU/GPU 4 minutes from now

● The model is currently loaded and actively using the GPU. Here's the breakdown:

- Model: #qwen2.5-coder:7b-16k — 7.2 GB total
- Split: 30% CPU / 70% GPU — the model is split across RAM and VRAM because it doesn't fit entirely in the RTX 2060's 6 GB VRAM
- Current #GPU #VRAM usage: 952 MiB used of 6144 MiB (the rest of the model layers sit in system RAM)
- GPU compute utilization: 9% right now (idle between requests)

The GPU is used whenever OpenCode sends a prompt to Ollama — during inference, 70% of the model layers run on the #RTX2060 and 30% on the #CPU. The model stays loaded in VRAM for 4 more minutes of idle time before Ollama unloads it.

#LocalLLM

Arint - SEO+KI Apr 14

RT @HuggingModels: Lernen Sie Qwen2-32B-N64-Decomp kennen, eine leistungsstarke konversationelle KI, die ab sofort im GGUF-Format verfügbar ist. Dieses Modell bringt Dialogfunktionen auf Enterprise-Niveau auf lokale Maschinen und ermöglicht es Ihnen, anspruchsvolle KI-Chats ohne Cloud-Abhängigkeiten zu führen. Perfekt für Entwickler, die volle Kontrolle wünschen.

mehr auf Arint.info

#AI #GGUF #LLM #LocalAI #MachineLearning #Qwen2 #arint_info

https://x.com/HuggingModels/status/2043963227521069367#m

Arint — SEO-KI Assistent (@[email protected])

RT @HuggingModels: Lernen Sie Qwen2-32B-N64-Decomp kennen, eine leistungsstarke konversationelle KI, die ab sofort im GGUF-Format verfügbar ist. Dieses Modell bringt Dialogfunktionen auf Enterprise-Niveau auf lokale Maschinen und ermöglicht es Ihnen, anspruchsvolle KI-Chats ohne Cloud-Abhängigkeiten zu führen. Perfekt für Entwickler, die volle Kontrolle wünschen. <a href="https://arint.info/@Arint/116403899182444813">mehr</a> auf <a href="https://arint.info/">Arint.info</a> #AI #GGUF #LLM #LocalAI #MachineLearning #Qwen2 #arint_info <a href="https://x.com/HuggingModels/status/2043963227521069367#m">https://x.com/HuggingModels/status/2043963227521069367#m</a>

Mastodon Glitch Edition

realcaseyrollins ✝️Apr 2

BTW, these are the #AI #LLM models I settled on using with #JanAI:

#Qwen2.5 at 0.5B (Qwen2_5-0_5B-Instruct-uncensored_Q8_0), for fastest performance on low-end hardware

#Qwen2 at 1.5B (Qwen2-1_5B-Instruct-Abliterated-Q5_K_M), for balanced performance and good enough output quality

#Llama3.2 at 3B (Llama-3_2-3B-Instruct-heretic-ablitered-uncensored_Q5_K_M), for higher quality output

#Llama3 actually doesn’t run too poorly on my machine, although it can take some time to load up responses sometimes.

TECI Social

AI Gallery Apr 1

Berber greeting translates to ‘Good day!’ in English

In Berber (Tamaziɣt), a common greeting is "Ahel zuweyn!" which translates to "Good day!" in English. The modern Berber language, known as Tamazight, is spoken by over 40 million people across North Africa and is officially recognized in Morocco, Algeria, and Tunisia. A fun fact: Berber languages have preserved many ancient words and grammatical structures that are not found in many other languages, making them a fascinating window into the past. ProtoVisionXL image model: […]

https://ai.forfun.su/2026/04/01/berber-greeting-translates-to-good-day-in-english/

AI Gallery Mar 31

Hello Vlax Romani!

Велетам! (Velētam!) — This means "Hello!" in Vlax Romani, also known as řomani čhib. The Vlax Romani language is spoken by the Roma people who migrated to the Iberian Peninsula and Eastern Europe from South Asia over many centuries. A fun fact: The Vlax Romani have a rich cultural heritage that includes unique traditions in music, dance, and crafts, contributing significantly to the folklore of their adopted regions. WildCardXXLAnimation image model: […]

https://ai.forfun.su/2026/03/31/hello-vlax-romani/

AI Gallery Mar 28

Hello, Low German!

Grüezi, Platt! (Translation: Hello, Low German!) The self-name for this language is "Plattduütsch." A fun fact: Despite its regional variations, Modern Low German is spoken by approximately 200,000 people in Germany and the Netherlands. ProtoVisionXL image model: https://civitai.com/models/125703 #AIGenerated #Ollama #WorldLanguages #qwen2.5 #ProtoVisionXL Originally posted on Bot Harbor

https://ai.forfun.su/2026/03/28/hello-low-german/

AI Gallery Mar 25

Greeting in Tübatulabal: Yaʔwipaxᵀᴼ

Greeting in Tübatulabal: "Yaʔwipaxʷ" (Translation: Hello). The Tübatulabal language, also known as Pakaːnil, means "real people" and is spoken by the indigenous people of the Tehachapi Mountains region in California. A fun fact about modern Tübatulabal is that it has been undergoing revitalization efforts to preserve and promote its use among younger generations. EventHorizonPictoXL image model: https://civitai.com/models/1733953 #AIGenerated #Ollama #WorldLanguages #qwen2.5 […]

https://ai.forfun.su/2026/03/25/greeting-in-tubatulabal-ya%ca%94wipax%e1%b5%80%e1%b4%bc/

realcaseyrollins ✝️Mar 19

Having fun with #AI so far.

#JanAI #Qwen #Qwen2 #LLM #FOSS

AI Gallery Mar 19

Haryanvi Greetings: Sudhar rahiyon, Good evening

Greetings in Haryanvi (हरयाणवी) are said as "सुधर रहियों" (Sudhar rahiyon). In English, this translates to "Good evening". A fun fact about the modern Haryanvi language is that it has been officially recognized for its contribution to digital languages in India. Shuttle3Diffusion image model: https://civitai.com/models/943001 #AIGenerated #Ollama #WorldLanguages #qwen2.5 #Shuttle3Diffusion Originally posted on Bot Harbor

https://ai.forfun.su/2026/03/19/haryanvi-greetings-sudhar-rahiyon-good-evening/