Mastodawn

GPU-Initiated Networking for NCCL

GPU-Initiated Networking for NCCL

Modern AI workloads, especially Mixture-of-Experts (MoE) architectures, increasingly demand low-latency, fine-grained GPU-to-GPU communication with device-side control. Traditional GPU communicatio…

hgpu.org

Show thread

screwlisp Oct 8

@mdhughes 0? @Cat @jns @ramin_hal9001 I chopped the choppy first four minutes off, archive up now: https://communitymedia.video/w/1iDniLCpYPSPjxFww6TzJ9
#lisp #lispyGopherClimate #scheme #emacsconf #art #baudpunk #NCCL #books

#climate, #gopher, catK, jns, hal9000 lots of guests live #lispyGopherClimate #lisp #gamedev #emacs #scheme, #books

PeerTube

cat K.Jan 29, 2025

for a while I've wanted to do an audio release for my poems and now I have; LOWWIRE is a collection of poems by me read into payphones, I hope you enjoy.

https://b4udw3rk5.bandcamp.com/album/lowwire

#poetry #sdf #lowwire #nccl #b4udw3rk5

LOWWIRE, by cat K.

13 track album

B4UDW3RK5

Tomáš Oct 19, 2024

origin

#unix_surrealims #nccl #newcyberiacoinlaundry

Tomáš Oct 3, 2024

`your revolution will not be paid for in dirty change'

@dokuja @jns cat

#nccl #newcyberiacoinlaundry

Tomáš Mar 10, 2024

'alone in the city cont'd.'

Girl follows directions and discovers a hidden hacker bar.

can you find your friends?

@drwho @maddiefuzz @thegibson @jns @dokuja #technomage #unix_surrealism #comic #hackers #uxn #varvara #linux #glenda #9front #bsd #xenia #nccl #gopher #lo0 #mastoart #fediart

Tomáš Jan 5, 2024

#permacomputing
"you do realize all of these machines were declared dead in 2006?"

#technomage and #penguin in #uxn's #oekaki

#unix_surrealism #monochrome #ratpoison #9front #nccl #thinkpad #x11 #linux

Andreas Herten Jul 18, 2023

Did you know you can enable #NCCL as a backend for #MPI, just by setting some environment variables? 𝒪(10)× speed-up is possible! Read about it in our most recent X-Dev blog post, which also shows the according graphs. – https://doi.org/10.34732/xdvblg-tvbjig #HPC