Do we have any owners of one of those Ryzen AI Max+ 395 128GB UMA boxes here that operate them on the daily for at least a few months as a claude LLM coding server and are capable of giving a comparative run down on their performance vs the OG claude and its collection of formal prose generators?

Also: Especially curious to hear any numbers that came out of a watt meter in daily consumption and base/peak numbers. Same with the used models, their size, their respective achieved tok/s and response times.

And should you have had the opportunity of comparing this against non-UMA beefy dGPUs on the above parameters that'd also be quote interesting.

#claude #aicoding #AIAsssisted #ollama #onprem #selfhosing #StrixPoint #ryzenaimaxplus395 #ryzenAiMax #powerconsumption #costefficiency #uma

Silly question:

Is it safe to bet that watching or listening in 2x save power consumption?

If you watch a video "faster" and, consequently, turn off the screen faster, since the video ended in half the time (2x), then that would reduce the battery consumption of the device.

#sustainability #powerconsumption #energy

#DataCenter #AI #Scotland #Edinburgh #greenwashing #powerconsumption #diesel #water #climatechange

#Tristan #SimonClark

This is, how you do it!

https://www.youtube.com/shorts/-O3CQ8EQmEQ

Finally got the power envelope under 25 watts for the entire #homelab. This project took a few weeks in my spare time, but rising electricity costs finally pissed me off enough.

#selfhosted #virtualization #container #linux #opensource #utm #debian #macos #das #powerconsumption

A fascinating conversation about the environmental impacts of AI: “Data centers use a lot of power: According to the Times Picuayune, Meta’s new data center under construction in Louisiana will require nearly three times the power that New Orleans uses in a year. Residents across the country have taken note, and rising utility rates have become an issue in some recent elections.”

#AI #DataCenter #PowerConsumption #ClimateCrisis #EnergyEfficiency #ScienceFridayPodcast

https://podcasts.apple.com/us/podcast/science-friday/id73329284?i=1000739837226

So sánh tiêu thụ điện năng giữa các truy vấn ngắn và dài? Truy vấn "Thủ đô của Pháp" vs "Pháp Thủ đô" #TiêuThụĐiệnNăng #TruyVấn #Benchmarks #PowerConsumption #Queries

https://www.reddit.com/r/ollama/comments/1p6svcr/power_consumption_of_short_queries_vs_verbose_ones/