Waiting for llama.cpp support and quants, but I think the most impressive thing is they claim to have trained on AMD MI300X GPUs. My ROCm-hating ass is in shambles right now.
Computer programmer, matmul enthusiast, foss brother, all around trashy individual. We should go to all the moons.
RIP mastodon.technology
bsky: https://bsky.app/profile/dvshkn.com
| Website | https://dvshkn.com |
| Git | https://git.sr.ht/~dvshkn |
| Pronouns | he/him, they/them |


