Show threadsquillaceMar 3, 2025

@frankel hey, this is great stuff with #wasmedge, but I note you mention "Despite some of the mainstream Cloud providers offering Wasm integration, none of them provide such a low-level one."

Tech point: in fact, the cloud providers you mention use the very same low level integration with Kubernetes. My team created the containerd/runwasi project that hosts several runtimes, including wasmedge. Have a look at the stress tests! https://runwasi.dev/dev/bench/bench.html.

Victor PaléologueDec 2, 2024

Running the #LLM #Llama 2 with #Rust + #Wasm to run on #edge: https://www.secondstate.io/articles/fast-llm-inference/

It’s using #WasmEdge, a super lightweight runtime that can on a wide range of hardware, and directly as a #Docker #container runtime.

It supports the #WASI NN API, so can run inference modules efficiently. It is compiled only once, in #WASM, and can run anywhere WasmEdge + GGML can.

Expect 25 token per seconds on a low-end M2 Macbook, 50 tokens per seconds on an Nvidia A10G. So pretty big "edge" devices.

Fast and Portable Llama2 Inference on the Heterogeneous Edge

Fast and Portable Llama2 Inference on the Heterogeneous Edge.

SecondState
Show threadGiulioApr 12, 2024

@giuseppe

#WasmEdge on #Alpine #Linux v3.19

#wasm #rust #cmake #llvm-dev

https://github.com/WasmEdge/WasmEdge/issues/3335?notification_referrer_id=NT_kwDOADHvc7MxMDIzNTAzNDUyODozMjcyNTYz#issuecomment-2052429819

🆙🔝🆒 I'm simply the best 💯🍾🎶

libstdc++.so.6: no version information available or libstdc++.so.6: cannot open shared object file · Issue #3335 · WasmEdge/WasmEdge

Summary I'not able to install WasmEdge on Alpine Linux v3.19 P.S. seen the #1015 Current State Install scripts fail Expected State I hope WasmEdge can be installed on Alpine Reproduction steps I'm ...

GitHub
KCD TexasMar 6, 2024

🚀 Miley Fu, Founding member at CNCF WasmEdge, presents at KCD Texas! 🌟

Discover the power of self-hosting open-source LLMs across various environments using WasmEdge, a CNCF sandbox project. This talk will navigate the advantages and how-tos, enriching your development practices.

🔗 https://texaskcd.com/

Unlock the potential of open-source LLMs with CNCF's WasmEdge.

#KCDAustin #WasmEdge #OpenSource #CNCF #KCDTexas

openSUSE LinuxJan 22, 2024
Dive into #WebAssembly! Use #crun & #Podman to deploy Wasm workloads. Explore #WasmEdge on @opensuse #Tumbleweed for cutting-edge apps! Read more about #Wasm https://news.opensuse.org/2024/01/19/podman-wasm-support/
Running WebAssembly workloads with Podman

WebAssembly (abbreviated Wasm) is a portable binary instruction format. It has gained popularity for its portability as a compilation target that enables dep...

openSUSE News
MikeMay 7, 2023

#Docker has recently introduced a beta feature to support #wasm containers. This feature allows you to run #WebAssembly applications alongside your Linux containers using the #WasmEdge runtime.

I am curious about your experience with this setup. Have you tried running #wasm containers on your desktop machine? What issues have you encountered?

https://docs.docker.com/desktop/wasm/

"Wasm workloads (Beta)"

"How to run Wasm workloads with Docker Desktop"

Docker Documentation
Christoph Mar 14, 2023

I'm excited to set up #Kubernetes to run #Spin and
#Wasmedge #webassembly containers at #Rawkode Live!

Together with @0xe282b0
and @Rawkode and we will talk about some nerdy #wasm things we recently worked on.

Tune in, Friday at 14:00 CET for a "Hands-on introduction to #KWasm"!

Nicolas Fränkel 🇪🇺🇺🇦🇬🇪Feb 5, 2023

#Rust #microservices in server-side #WebAssembly https://blog.logrocket.com/rust-microservices-server-side-webassembly/

I wonder if anybody has feedback about #WasmEdge

Rust microservices in server-side WebAssembly - LogRocket Blog

Learn about tools, libraries, APIs, frameworks, and techniques to build microservices in Rust. Deploy, run, and scale them in WasmEdge.

LogRocket Blog
squillaceJan 31, 2023

And this brings #wasmedge into containerd in the #runwasi shim. Great work across #docker, #secondstate, and #microsoft but especially the youki developers. @cpuguy keep on keeping on.
MOAR #webassembly inside #Kubernetes

https://github.com/containerd/runwasi/pull/26

Contribute wasmedge integration back to upstream by CaptainVincent · Pull Request #26 · containerd/runwasi

Todo CI not yet auto build and cp wasmtime shim binary into docker image together. 58a0c2a CI not yet auto build and cp wasmtime shim binary into release tar file together. (We use self-host arm...

GitHub
Show threadsquillaceDec 1, 2022
This shim forms the basis of #docker desktop wasm tech preview with #wasmedge as well as the AKS wasi nodepool preview, which uses runwasi as a crate to support #Fermyon's spin and #deislabs's slight app models.