sayzard15h ago

Jun Kim (@jundotkim)

oMLX 0.3.9rc1이 릴리스됐다. 저메모리 Mac에서 OS 종료 방지 안정성 개선, DFlash v0.1.7 반영, Qwen의 thinking/GDN 수정, 긴 프롬프트가 다른 요청의 디코드를 막지 않도록 하는 chunked prefill 지원이 핵심이다. 로컬 LLM/MLX 운영에 실용적인 업데이트다.

https://x.com/jundotkim/status/2056666955466383521

#omlx #mlx #localllm #mac #inference

Jun Kim (@jundotkim) on X

oMLX 0.3.9rc1 released. Highlights: - Low-memory Macs stay stable instead of getting killed by the OS - DFlash bumped to v0.1.7 (thanks to @bstnxbt's dflash-mlx). Qwen thinking/GDN fix, Etc. - Chunked prefill. A long prompt no longer blocks decode for everyone else -

X (formerly Twitter)
sayzardApr 26

goniz (@gonizahavy)

oMLX를 직접 사용해 본 뒤 곧 oMLX 지원을 추가하겠다고 밝혀, 해당 도구에 대한 기능 통합 및 생태계 확장이 진행 중임을 시사한다.

https://x.com/gonizahavy/status/2048358309770518924

#omlx #ai #tooling #integration

goniz (@gonizahavy) on X

@ivanfioravanti Funny, I just played today with oMLX, and I’m about to add oMLX support! https://t.co/jGfxFhskwW

X (formerly Twitter)
sayzardApr 15

Alex Cheema (@alexocheema)

oMLX가 Mac에서 계층형 KV 캐싱을 지원하게 되었다. Apple Silicon에서 prefill 시간이 긴 문제를 줄이고, 세션 간에도 KV 캐시를 디스크에 저장해 중복 prefill을 피할 수 있어 온디바이스 AI 성능 최적화에 중요한 개선이다.

https://x.com/alexocheema/status/2044188027468025934

#omlx #kvcaching #applesilicon #ondeviceai #performance

Alex Cheema (@alexocheema) on X

oMLX brought tiered kv caching to Mac. Especially important with Apple Silicon where prefill time is very long - you avoid redundant prefills, even between sessions by persisting kv caches to disk.

X (formerly Twitter)
TevinApr 9

Never thought that I could do this on my Mac

#oMLX #LocalLLM

TevinApr 3

Hermes Agent + oMLX = Caching-aware agent harness on macOS

Claude Code’s source code leak revealed a huge gap in context management and cache-awareness comparing to its open-source alternatives like OpenCode.

Hermes Agent is doing a better job at these among the “claws” ATM.

https://hermes-agent.nousresearch.com

https://mastodon.tevinzhang.com/@tevin/116219530664180323

#HermesAgent #oMLX #ClaudeCode #OpenCode

Hermes Agent — AI Agent Framework

An open-source agent that grows with you. Install it, give it your messaging accounts, and it becomes a persistent personal agent — learning your projects, building its own skills, and reaching you wherever you are.

sayzardMar 24

This is super!
2 pi coding agents + oMLX with Nemotron-Cascade-2-30B-A3B-6bit running in parallel on M5 Max. Great and fast model!

https://x.com/ivanfioravanti/status/2034975752702025994

#nemotron #omlx #m5max #codingagents #6bit

Ivan Fioravanti ᯅ (@ivanfioravanti) on X

This is super! 🔥 2 pi coding agents + oMLX with Nemotron-Cascade-2-30B-A3B-6bit running in parallel on M5 Max. Great and fast model!

X (formerly Twitter)
TevinMar 13

Finally, an open-source alternative that's easy to use and performs better than #LMStudio on Mac with support for MLX!

A bit shady that it uploads the benchmark result without noticing or asking tho

https://omlx.ai

#oMLX

Neustradamus :xmpp: :linux:Apr 24, 2025
#OpenMandrivaLx 6.0 has been released (#OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://openmandriva.org/
OpenMandriva - Here comes OpenMandriva ROME

This is the official OpenMandriva website. There you can find documentation, all needed links for our services and getting the distribution, and the latest news.

OpenMandriva
Neustradamus :xmpp: :linux:Jul 21, 2024
#OpenMandrivaROME 24.07 has been released (#OpenMandrivaLxROME / #RollingReleaseDistribution / #RollingReleaseLinux / #OpenMandrivaLx / #OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://www.openmandriva.org/
OpenMandriva - Here comes OpenMandriva ROME

This is the official OpenMandriva website. There you can find documentation, all needed links for our services and getting the distribution, and the latest news.

OpenMandriva
Neustradamus :xmpp: :linux:Jul 7, 2024
#OpenMandrivaROME 24.07 RC has been released (#OpenMandrivaLxROME / #RollingReleaseDistribution / #RollingReleaseLinux / #OpenMandrivaLx / #OMLx / #OpenMandriva / #MandrivaLinux / #Mandriva / #MandrakeLinux / #Linux) https://www.openmandriva.org/
OpenMandriva - Here comes OpenMandriva ROME

This is the official OpenMandriva website. There you can find documentation, all needed links for our services and getting the distribution, and the latest news.

OpenMandriva