What are you using for your base image? ππΌ
#docker https://youtu.be/8lcc6jU9zfI?si=yZs22A-kjqBlKk8E

Happy Friday and let's deploy vLLM on Kubernetes in production with John McBride
vLLM is a fast and easy-to-use library for LLM inference and serving. It uses PagedAttention for efficient management of attention key and value memory.
The video is hands on demo heavy so go try out vLLM yourself.
Also do not forget to share with your LLM friends ;) π
https://youtu.be/t0iJGEG0IXk
Hot off the press from KubeSimplify: WebAssembly on Kubernetes(Rancher Desktop), plus a demo on KillerCoda. Check out SpinKube, my thoughts, and some video edits we've made along the wayβlittle wins!
Watch the video, try the demos, and if you learn something new, please share it.
hashtag#kubernetes hashtag#webassembly hashtag#spinkube
https://www.youtube.com/watch?v=3aXFBtx4oVE
I am excited for todays livestream with Lee Calcote are you?
Do join us in about 90 minutes for Making the CNCF Landscape Interactive with Meshery
https://www.youtube.com/live/ujHe-4QP9og?si=w9jb0ojcBX_iPakv
Just in case you missed I dropped a video yesterday.
Run Llama 3 locally using Ollama and LlamaEdge
youtu.be/wPuoMaD_SnY?si=s0UFatoBj5dEkPtD