empireOfLove2Intel's $249 Arc B580 is the GPU we've begged for since the pandemic | PCWorld
brucethemooseIf they double up the VRAM with a 24GB clamshell card, this would be a great “self hosted LLM” machine.
3060, 3090 prices have been rising like crazy because Nvidia is vram gouging and AMD inexplicably refuses to compete. 16GB on the A770 is kinda meager, but 24GB is the point where you can fit the Qwen 2.5 models that are starting to perform like the big corporate API ones.
I always wondered who they were making those mid- and low-end cards with a ridiculous amount of VRAM for… It was you.
All this time I thought they were scam cards to fool people who believe that bigger number always = better.
Like the 3060? And 4060 TI?
Its ostensibly because they’re “too powerful” for their vram to be cut in half (so 6GB on the 3060 and 8GB on the 4060 TI), but yes, more generally speaking these are sweetspot for vram heavy workstation/compute workloads. Local LLMs are just the most recent one.