Dr. Moritz LehmannNov 1, 2023
I've always wondered how much VRAM bandwidth games and applications pull - other tools don't tell you that. So I've written a program that can query/measure it, and properly visualize in CMD! 🖖 🧐
So far it works on Windows with Intel (IGCL) and Nvidia (NVML) #GPU​s. Here is Intel i7-8700K and Arc A750 running the game Planetside 2. Cyberpunk is ~60GB/s without and ~100GB/s with #raytracing.
Show threadDr. Moritz LehmannJan 13, 2024
My hw-smi program now has partial #Linux support! Still a lot of work to do. 🖖🧐
____________ | Windows | Linux |
CPU / RAM | ✅ | ✅ |
Nvidia GPU | ✅ | ✅ |
Intel GPU | ✅ | 🚧 |
AMD GPU | 🚧 | 🚧 |
Show threadDr. Moritz LehmannMar 16
Finally getting back to this fun side project - a portable, universally compatible #CPU / #GPU telemetry monitor. Only #Linux support for #Intel remaining
#AMD's AMDSMI is an adventure - they have 3 API calls to get the PCIe throughput, and 2 to get the max VRAM bandwidth - none of which work 🖖🤯
____________ | Windows | Linux |
CPU / RAM | ✅️ | ✅️ |
Nvidia GPU | ✅️ | ✅️ |
Intel GPU | ✅️ | 🚧 |
AMD GPU | ✅️ | ✅️ |
Show threadDr. Moritz Lehmann5d ago

Finally Intel #GPU support on Linux too. Watch all the metrics go brrr in multi-GPU #FluidX3D #CFD workload! Will #opensource soon™️

Hardening against the myriads of broken counters in all those bugged APIs was a long shot. 🖖🫠

____________ | Windows | #Linux |
CPU / RAM | ✅️️WinAPI | ✅️️/proc |
#Nvidia GPU | ✅️️NVML | ✅️️NVML |
#Intel GPU | ✅IGCL | ✅SYSMAN |
#AMD GPU | ✅️️️️ADLX | ✅️️️️AMDSMI |

Show threadDr. Moritz Lehmann1d ago

It's done and #opensource​d on #GitHub! 🖖🥳
https://github.com/ProjectPhysX/hw-smi

A minimal, cross-compatible #CPU​/​#GPU telemetry monitor with accurate data directly from vendor APIs and beautiful ASCII visualization.

How much #VRAM bandwidth does an application or a game pull? Is the traffic over #PCIe a bottleneck? What's the CPU/GPU load, RAM/VRAM occupation, temps, power draw, clocks? hw-smi works with all CPUs and all #Nvidia​/​#AMD​/​#Intel GPUs, on both Windows and #Linux.

Have fun!

Show threadAlan Sill1d ago
@ProjectPhysX I was able to get it to build on one of our GPU nodes but had to add a soft-link for the x86_64-linux-gnu in /usr/lib as our path to the Nvidia driver library is just /usr/lib/libnvidia-ml.so
Show threadt0my11h ago

@AlanSill @ProjectPhysX Just had a very quick look into the project and was wondering about the large *.so binaries. Redistributing proprietary drivers has been always a pain. Curious about its origin I checked VirusTotal, usually they know common spread software. In this case it don't.

Might those files should not have made it into git?

Show threadAlan Sill
@t0my @ProjectPhysX In my case, I'm linking against the previously installed library we installed on our own. Not sure if the one in the GitHub source is needed at all for such cases.
7:14pmWeb
Show threadDr. Moritz Lehmann10h ago
@AlanSill @t0my I've decided to ship libs with the repo, as they might be missing on some systems.
Have updated the compile script to check more possible driver install paths - unforunately they are different depending on distro.