Heading to Brussels for #FOSDEM26 (Jan 31- Feb 1)? Want to learn about Docker Model Runner and other AI offerings at Docker? Dorin and I will be speaking in the AI Plumbers DevRoom on Saturday and hope to see you there
Eric Curtin
- 270 Followers
- 71 Following
- 507 Posts
Docker Engineer working in AI
Apple GPU support for vLLM? Monorepos vs microrepos?
Recently we did a webinar on Docker Model Runner. I prepared a slide on my take of when to use llama.cpp and when to use vLLM. Here is what I came up with (and I feel Edge kinda fits in the middle, there are use cases for both), but I am curious what do people think?
After many years of maintaining inotify-tools we finally have a logo:
On route to #redhatsummit, watch out for: "AI inferencing for developers and administrators", "Securing AI workloads with RamaLama", "RamaLama Making developing AI Boring". We may even see a vlm demo, very accurate models as we can see here #ramalama #llamacpp
Very happy to see the @fedora badge leaderboard having @marcan at the top recently as a weekly and monthly leader. The @AsahiLinux project has significantly enhanced the upstream open source ecosystem as well as downstream projects in Fedora Asahi SIG, Fedora ARM SIG and Fedora as a whole.
Delayed at the airport... It had it's ups and downs but genuinely had a great time... Thanks to all the organizers and volunteers @fosdem ... And it was great to meet all the people from various open source communities I'd worked with the last while... Hopefully I meet you guys again in the not so distant future
See that "appledrmfb" string at the bottom, that means we have accelerated graphics working on our Asahi Fedora distro. Which also means in-kernel Rust support 🙂 Check out the new Fedora Asahi SIG @Conan_Kudo created. Thanks to everyone in the @AsahiLinux community as usual