Снижаем стоимость инференса. Часть 1. Популярные подходы и что помогло нам повысить утилизацию GPU на 70%

Привет, Хабр! Меня зовут Данила Гудынин, я DevOps-инженер направления Evolution ML Inference в Узнать больше

https://habr.com/ru/companies/cloud_ru/articles/950162/

#vllm #vgpu

Снижаем стоимость инференса. Часть 1. Популярные подходы и что помогло нам повысить утилизацию GPU на 70%

Привет, Хабр! Меня зовут Данила Гудынин, я DevOps-инженер направления Evolution ML Inference в Cloud.ru . В мире машинного обучения GPU — главный актив, но что делать, когда ваши дорогостоящие...

Хабр

Эффективное использование GPU в Kubernetes: Настройка и использование Volcano Scheduler + Volcano vGPU Device Plugin

В этой статье я расскажу, как можно разделить GPU на vGPU в кластере Kubernetes с поддержкой жесткой изоляции, используя Volcano и Volcano vGPU Device Plugin.

https://habr.com/ru/articles/913374/

#kubernetes #nvidia_gpu #helm #vgpu #linux #видеокарты #gpu #nvidia

Эффективное использование GPU в Kubernetes: Настройка и использование Volcano Scheduler + Volcano vGPU Device Plugin

Об авторе Меня зовут Андросов Михаил — DevOps/MLOps-инженер. Последние два года сопровождаю ML-кластера Kubernetes с интенсивной нагрузкой на GPU. Аппаратные характеристики Наш типовой...

Хабр

Step-by-Step Installation of NVIDIA Virtual GPU Software on Proxmox VE

https://youtube.com/watch?v=Xp_TPHnCOWw&si=a6JuvwYj3HCY1UMU

#proxmox #vgpu

Step-by-Step Installation of NVIDIA Virtual GPU Software on Proxmox VE

YouTube
Thank god I own a custom domain address so getting #nVidia's free 90-day evaluation trial to obtain the driver for #vGPU was relatively painless. I dream of the day we can have subscription-free #VDI and #GPU acceleration in VMs

#homelab #linux
#NVIDIA Publishes #OpenSource #Linux Driver Code For #GPU Virtualization "#vGPU"
"This is intended to be a real product that customers would use, it is not a proof of concept. There is alot of demand for this kind of simplified virtualization infrastructure in the host side...From the VFIO side I would like to see something like this merged in nearish future as it would bring a previously out of tree approach to be fully intree using our modern infrastructure.
https://www.phoronix.com/news/NVIDIA-Open-GPU-Virtualization #QEMU #VM
NVIDIA Publishes Open-Source Linux Driver Code For GPU Virtualization "vGPU" Support

vGPUs are your best option for handling graphically intensive operations like 3D models, but first, what are vGPUs exactly? And how can they help you build and simulate your 3D projects?

https://ubuntu.com/blog/accelerate-automotive-3d-models-with-vgpu

#vgpu #automotive #linux #opensource

https://twitter.com/ubuntu/status/1618508810796077057#m

Accelerate automotive 3D models with vGPU | Ubuntu

3D models are a key component for building digital twins. […]

Ubuntu

I think I'm coming to the end of my virtual photography life.
I love doing it, but it's genuinely so demoralising that for more than 2 and a half years I've shown new images every single day and my images just don't spark any interest at all.
4 likes on this image is shocking. 😳
---
RT @OfficialCABBAC
The warrior.

Game: #Hellblade
Dev: @NinjaTheory
Console: #XboxSeriesX

#VirtualPhotography #PhotoMode #TheCapturedCollective #VGPU
https://twitter.com/OfficialCABBAC/status/1555501576260837376

CABBAC 🎮🎬🖥️ on Twitter

“The warrior. Game: #Hellblade Dev: @NinjaTheory Console: #XboxSeriesX #VirtualPhotography #PhotoMode #TheCapturedCollective #VGPUnite #ThePhotoMode #GamerGram #ArtisticofSociety #WorldofVP  #VPGamers #ZarnGaming #VPEclipse #VPCONTEXT #PhotoDenUC #VPRetweet #XboxShare #art”

Twitter
Nvidia Warns Windows Gamers of Serious Graphics Driver Bugs - Several high-severity flaws in Nvidia's GPU display drivers for Windows users could lead to code-... more: https://threatpost.com/nvidia-windows-gamers-graphics-driver-bugs/156911/ #securityvulnerabilities #gpudisplaydriver #highseverityflaw #vulnerabilities #nvidiaflaw #nvidiafix #security #windows #gamers #nvidia #patch #vgpu
Nvidia Warns Windows Gamers of Serious Graphics Driver Bugs

Several high-severity flaws in Nvidia's GPU display drivers for Windows users could lead to code-execution, DoS and more.

Threatpost - English - Global - threatpost.com