Jeff Moss

New GPU ordered for #InfoCon and #DEFCON archive work, crazy how much they have evolved in the past few years.

For #HEVC / #AV1 encoding it is about how many NVENC chip-sets the GPU has, not how many #CUDA cores it has or whatever.

For voice to text it is about FP16 performance.

I haven't found a good voice to voice translation #LLM yet.

I'd love a GPU that is designed for these kinds of media operations and don't need ray tracing, video shaders, 4 video output, etc.

Apr 12, 2024 at 3:01amWeb
Show threadJeff MossApr 23, 2024

Turns out I ordered the wrong SKU for the GPU. Apparently I ordered the 500,000 pack, not the 1 pack. It’s actually about 5% cheaper per unit to buy one instead of half a million.

It’s crazy that a 500k SKU even exists!
#InfoCon #DEFCON #HEVC #AV1 #CUDA #LLM

Show threadGiorgio SidariApr 23, 2024
@thedarktangent so now your legacy will have debts for a few dozen generations? 🙂
Show threadFritz AdalisApr 23, 2024
@thedarktangent
Did they ship?
Show threadJeff MossApr 23, 2024
@FritzAdalis Still waiting on it to ship next month.
Show threadPadreSJApr 23, 2024

@thedarktangent @FritzAdalis

Well... I guess the badges are going to have SLIGHTLY more computing power available than in years past?

Show threadI̵E̶E̸E̵ ̷1̵1̸4̴9̴.̷1̷Apr 12, 2024
@thedarktangent intel is extremely good at av1, just FYI.
Show threadJeff MossApr 12, 2024

@Pibble That's what I have heard, but it is impossible to tell the differences and improvements between different chipsets and versions.

Nvidia is difficult too, but better.

For example I know the ASIC encoders get better with each generation, but learning what got better is a mystery.

Show threadzitterbewegungMay 3, 2024
@thedarktangent @thedarktangent do you want to preserve the lecturers voice on the voice to voice translation? Why not do voice to text and then translation and then back to text to speech. If you don’t want a GPU you can look at accelerator’s or workstation cards like an A8000 This is targeted torward deep learning cards but will recommend accelerators. https://nanx.me/gpu/ An A8000 still has encoding support also.
Deep Learning GPU Selector

Choose the best GPU for your deep learning workflow with this interactive selector.

Show threadJeff MossMay 3, 2024

@zitterbewegung The voice to text (English) and then translate that text to other language subtitles seems to be the way.

I’d love to find a way to allow voice translation in the original authors tone and inflection. I’ve read articles about it existing but haven’t found an open model or service to do it with.

Show threadzitterbewegungMay 3, 2024
@thedarktangent Facebook has an unreleased model https://voicebox.metademolab.com on Reddit https://elevenlabs.io is what is publicallt available.
VoiceBox

Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale

Show threadJeff MossMay 4, 2024
@zitterbewegung Thank you!