VibeOps5d ago

#localai #speed vergleich #tokens

in #lmstudio auf #macstudio #m4max #128gbram

#llms
google/gemma-4-26b-a4b(q8) = 76 token/s
google/gemma-4-26b-a4b-qat(q4) = 106 token/s

+39% speed

und laut google soll die quantisierung bei #qat keine einfluss haben:
Gemma 4 26B A4B QAT is the Quantization-Aware Training version of Gemma 4 26B A4B. It aims to keep quality close to bfloat16 while using much less memory to load the model.

bei 11gb weniger #ram belegung

natürlich mit vorsicht zu genießen - bei problemen schreib ich noch was dazu

wenn jetzt das kleine modell was könnte - das wäre der durchbruch bei lokalen llms - imaging jeder mit 16gb ram könnte so was selbst laufen lassen 😍 okay #macneo user lassen wir dann zurück :-P

Show threadVibeOpsJun 5

Tatsächlich so viele token... Extra noch mal gecheckt

430 Wh / 42 MToken = 10,2 Wh/MToken

normale llms sind wohl nicht der klimakiller - wohl eher der bild und video quatsch - ki bitte differenzierter betrachten

#apple #macstudio #m4max #hermesagent

Show threadVibeOpsJun 4

📊 Local AI Effizienz-Check! Mein selbstgehostetes qwen3.6-35b-a3b läuft überraschend sparsam. Die Stats von heute:

• ~18,3 Mio. Gesamt-Tokens
• Nur 0,34 kWh Energie verbraucht! ⚡

Das macht umgerechnet:
🔹 ~54 Millionen Tokens pro kWh
🔹 Nur 18,5 Wh pro Million Tokens

Lokale LLMs müssen echt keine Stromfresser sein, wenn die Hardware gut optimiert ist. 😎 #Apple #MacStudio #M4max #128GBRAM

#LocalAI #SelfHosted #LLM #Qwen #OpenSource #Tech #Privacy

Show threadVibeOpsJun 4

nebenbei beobachtung: die p cores werden nicht an die vm weitergegeben - vllt kann man das anpassen - hab die standard einstellung ausgwählt

#qemu #utm #macOS #m4max

Zachary Powell 🥑Apr 27

Time for a Mac Gaming update!

I am addressing three big points from the last video to help you get the most out of the M4 Max. This update covers:

Testing with the new CrossOver 26 build.

Finding the optimal settings for games..

Using the Orico X50 Thunderbolt 5 enclosure for lightning fast external storage.

Watch the full video here:

PeerTube: https://tube.devwithzachary.com/w/324zyeK5zgnSANZP735guz

YouTube: https://youtu.be/lkmt7muGPIc

#MacGaming #M4Max #AppleSilicon #CrossOver #Tech #GamingOnLinux

I Was Wrong About Mac Gaming. M4 Max Studio Retest. CrossOver 26 & Thunderbolt 5

PeerTube
DevWithZacharyApr 27

I Was Wrong About Mac Gaming. M4 Max Studio Retest. CrossOver 26 & Thunderbolt 5

https://tube.devwithzachary.com/w/324zyeK5zgnSANZP735guz

I Was Wrong About Mac Gaming. M4 Max Studio Retest. CrossOver 26 & Thunderbolt 5

PeerTube
Y KobayashiSep 17, 2024

Apple、10月にM4搭載Mac新製品とiPad mini発表か

Apple社が10月に新たな製品発表会を開催する可能性が高まっている。BloombergのMark Gurman氏の予測によると、この発表会では最新のM4チップを搭載した新型Macシリーズと、待望の新型iPad miniが登場する見込みだ。AppleのiPhone 16シリーズやApple Watch Series 10の発表直後にもかかわらず、同社は更なる新製品ラッシュを計画しているようだ。 Appleの10月新製品発表会：M4 Macとipad […]

https://xenospectrum.com/apple-to-launch-new-m4-based-mac-products-and-ipad-mini-in-october/

UNWIRE.HKMar 28
Mac Pro 正式停產　Apple 確認不再推出新一代型號
Apple 正式停產 Mac Pro 並將其從官方網站全面下架，所有舊連結現時均跳轉至 Mac 產品總覽頁面，外媒更獲 Apple 直接確認未來不會再推出任何新款 Mac Pro 硬件，終結這個歷史逾 20 年的專業桌上電腦產品線。
#流動電腦 #Apple #M3 Ultra #M4 Max
https://unwire.hk/2026/03/28/apple-officially-discontinues-mac-pro-replaced-by-mac-studio/notebook/?utm_source=rss&utm_medium=rss&utm_campaign=apple-officially-discontinues-mac-pro-replaced-by-mac-studio
Ars Technica NewsMar 6
Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage https://arstechni.ca/863B #Applesilicon #ramshortage #MacStudio #m3ultra #Apple #apple #m4max #Tech
Apple's 512GB Mac Studio vanishes, a quiet acknowledgment of the RAM shortage

Announcements this week were mostly business as usual, but Apple isn't immune.

Ars Technica
Italian News by RSSMar 3

Punto Informatico: Apple M5 Pro e M5 Max: nuovi chip per MacBook Pro

Apple M5 Pro e M5 Max sono i processori dei MacBook Pro da 14/16 pollici che offrono prestazioni nettamente superiori a quelle dei chip M4 Pro e M4 Max.
The post Apple M5 Pro e M5 Max: nuovi chip per MacBook Pro appeared first on Punto Informatico.

Apple M5 Pro and M5 Max: new chips for MacBook Pro

Apple M5 Pro and M5 Max are the processors for the 14/16-inch MacBook Pro models, offering significantly better performance than the M4 Pro and M4 Max chips.
The post Apple M5 Pro and M5 Max: new chips for MacBook Pro appeared first on Punto Informatico.

#AppleM5Pro #M5Max #14/16-inch #MacBookPro #M4Max #first #PuntoInformatico

https://www.punto-informatico.it/apple-m5-pro-m5-max-nuovi-chip-macbook-pro/

Apple M5 Pro e M5 Max: nuovi chip per MacBook Pro

Apple M5 Pro e M5 Max sono i processori dei MacBook Pro da 14/16 pollici che offrono prestazioni nettamente superiori a quelle dei chip M4 Pro e M4 Max.

Punto Informatico