Viss13h ago
i dont think ive gushed hard enough about btop lately. or at all.
here it is.
its beautiful
i wish it supported the stupid intel gpu on this thing better, but its still glorious
Show threadViss13h ago

its funny, this little doodad supposedly has an 'npu' in it, and it was marketed towards ai bro types to be some kinda at-home llm-biased thing.

its an asrock-industrial nuks box-255h. its basically an off-brand intel nuc, and its *BEEFY*. its physically smaller than the phobos nucs (we have a fleet of em we ship to customers to do onsite stuff if they prefer that over someone in person) and its easily 10x the power.

but .. how do you use the npu at all?
ollama doesnt support it

Show threadWinterKnight 11h ago
@Viss I thought they were a thing for copilot. I’m not sure how npu’s work tho.
Show threadViss10h ago
@winterknight1337 same. i guess its basically an asic built for llms?
Show threadWinterKnight 
@Viss that’s more or less my understanding but idk what APIs it uses
6:14amWeb