BeepNew computer chip material inspired by the human brain could slash AI energy use
Zakcould dramatically cut the energy consumed by artificial intelligence hardware
Decreasing the cost of using a resource almost always results in more use of that resource.
Laboratory tests showed the devices could reliably endure tens of thousands of switching cycles
That’s not very many when GPUs perform trillions of operations per second.
ryannathansIt’d probably be far more appropriate for an analogue system where it isn’t being switched but it’s rather what the model is burned onto
very_well_lostThis seems like such a glaringly-obvious solution to lower inference cost that surely there must be some fundamental flaw in it… otherwise all of the big AI firms would be doing it, right?
Right…?
Takes a while for the technology to become available in ASICs, we still don’t have purpose designed silicon for AI. We’re using repurposed GPUs with tensor cores scaled up still for pretty much all AI workloads