kajer :notverified:8h ago
Viss
i dont think ive gushed hard enough about btop lately. or at all.
here it is.
its beautiful
i wish it supported the stupid intel gpu on this thing better, but its still glorious
2:29amWeb
Show threadViss8h ago

its funny, this little doodad supposedly has an 'npu' in it, and it was marketed towards ai bro types to be some kinda at-home llm-biased thing.

its an asrock-industrial nuks box-255h. its basically an off-brand intel nuc, and its *BEEFY*. its physically smaller than the phobos nucs (we have a fleet of em we ship to customers to do onsite stuff if they prefer that over someone in person) and its easily 10x the power.

but .. how do you use the npu at all?
ollama doesnt support it

Show threadViss8h ago

its super weird, and i liken it to the copilot button on lots of laptops these days

nobody asked for it, nobody wanted it, and its there, and it takes up space (and power?) but you cant do anything with it because nothing supports it.

who knows. maybe hashcat can light it up, or maybe jellyfin gets another leg of code into its own ffmpeg fork and can use it. for now it sits idle.

Show threadViss8h ago

anyway if you saw my tirade back in november about a new house server and the absolute gobsmacking price of ram, it went into this thing. the ONE STICK of kingston 6400mhz ddr5 32 gig in it cost me ~238 dollars, flatly twice the price of the 5600mhz stuff. i had 64 gig of the slower stuff but the system had all sorts of problems, and i didnt wanna underclock it, so i had to return it and buy new stuff

no idea at the time, but it was the beginning of the tech drought. now that ram is ~1600

Show threadViss8h ago

i think 64gig of the 5600mhz stuff was like 150 bux maybe? and i was pissed i had to pay 238 for 32 gigs. the same ram on newegg now just flat out isnt even available.

but im still selling this things predecessor, the nvidia jetson orin nano! the 2tb t500 crucial m.2 disk i put in it is almost 4x in price what it was when i bought it. so thats chilling on ebay now, since it never sold on my garagesale site

Show threadClickyMcTicker7h ago
@Viss I’m just glad I picked up everything I needed, cold spares included, before prices lost their damn mind. I’m about ready to find god and start praying that no drives fail, because it won’t be possible to replace them.
Show threadJu  33m ago
@Viss I should definitely do a parts list of my server and check current prices!
I bet the 128GB of DDR5 must now cost more than what I paid for the whole thing with 100+TB of HDD a couple of years ago!
Show threadNonya Bidniss8h ago
@Viss 😲
Show threadChilly  🛡️ 8h ago
@Viss
I like to preconvert to WEBM with OPUS+AV1 so the jelly can relax
Show threadViss8h ago
@chillybot i need to do something about volume. i got metalocalypse episodes and flapjack episodes that are like 5x louder than everything else. now that i got the gpu sorted out it trivially handles all formats and transcoding no probs. it streams to a chromecast tv dongle plugged into a projector
Show threadChilly  🛡️ 8h ago
@Viss
Did you run the audio normalization task?
Show threadViss8h ago
@chillybot not only have i run it repeatedly, ive been told off on the forums that the thing is only supposed to work on audio, not video, so it ignores tv shows
Show threadTyler6h ago
@Viss @chillybot That’s an interesting issue. Audio transcodes will always be done with the CPU though unless Jellyfin is using a very modified ffmpeg. I got a GPU to transcode 100Mbps 4k to 20Mbps 4k for special cases. I use Usenet and don’t transcode on my AVR/TV but even on my desktop that transcodes I haven’t had an issue like that. Best guess is whomever procured those episodes didn’t follow best practices when making it..available. There’s a huge list of banned groups for this reason. I have a 150TB media server and a decade of pain, I mean experience, I am always too happy to discuss.
Show threadFritz Adalis8h ago
@Viss
ffmpeg would use the arc video, which should work if it's passed through to jellyfin.
Show threadViss8h ago
@FritzAdalis its 100% working just great
Show threadDave Wilburn 8h ago

@Viss

Maybe this?

https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/OPENVINO.md

Show threadViss8h ago

@DaveMWilburn cool so you hafta custom compile stuff with all those build args, then after that you get access to..

nine models

whee!

Show threadDave Wilburn 12m ago

@Viss

I wonder if you could also figure out Vulkan support. It would also likely require custom compiling, but the advantage there is that Vulkan is likely better supported across a broader range of hardware and software. I've occasionally thought about that for my old RX 580, which lost support under rocm a long time ago.

Show threadFritz Adalis8h ago
@Viss
Looks like there's something called openvino and like 5 Microsoft products, based on their spec sheet.
Show threadViss8h ago
@FritzAdalis yippee
Show threadLarry Sheradon8h ago
@Viss a) have to give btop a try! my journey so far being top → htop → btm;
b) frigate can make use of tpu/npu on some boards, could be possible if that’s at all interesting (https://docs.frigate.video/frigate/hardware), I run it on a jetson nano tho
Recommended hardware | Frigate

Cameras

Show threadWinterKnight 7h ago
@Viss I thought they were a thing for copilot. I’m not sure how npu’s work tho.
Show threadViss6h ago
@winterknight1337 same. i guess its basically an asic built for llms?
Show threadWinterKnight 5h ago
@Viss that’s more or less my understanding but idk what APIs it uses
Show threadDavid 🖋️4h ago
@Viss I'm so bothered by the chunk of silicon in my CPU that is built for "Ai" but is literally only used to apply goofy video filters in Teams meetings. I hear Microsoft intends to make NPUs mandatory in future OS releases though.
Show threadJernej Simončič �3h ago
@Viss Ton of stuff has NPUs nowadays, including my laptop (not that I wanted it).
Show threadviq8h ago
@Viss
Zenith is also cool, but yeah, btop is usually my go to
Show threaddave8h ago
@Viss damn, first time seeing that.  thanks for the tip!
Show threadViss8h ago
@dave oh man, youre gonna love it :D
Show threadjmjm8h ago
@Viss That is a damn sexy tui.
Show threadmr_daemon8h ago
@Viss My favorite part of btop is the Doom style esc menu that has the transparency effect. They did not need to go so hard, and it's clearly just a flex at this point.
Show threadViss8h ago
@mr_daemon absolutely. and if you try this from juicessh on android it absolutely loses its fucking mind because juicessh doesnt support truecolor :D
Show threadJernej Simončič �3h ago
@Viss @mr_daemon There's a command-line parameter --low-color to limit it to 256 colours only, which still looks pretty good, and works from inside screen.
Show threadCleo5h ago
@Viss the npu is handy for running immich ocr and facial recognition. Nextclouds is another one that can leverage it with local llms.
Show threadwakest likes your bugs ⁂28m ago
@Viss wow this is lovely! installed!