tech news ᳇ eicker.news14h ago
The surge in #semiconductor stocks, driven by #AI, is shifting towards a more heterogeneous #computelandscape beyond #GPUs. While GPUs excel in training and answer inference, #Cerebras’ #wholewaferchips offer superior speed for #answerinference but face limitations in #training and #agenticinference due to cost and memory constraints. https://stratechery.com/2026/the-inference-shift/?eicker.news #tech #media #news
The Inference Shift

Agentic inference is going to be different than the inference we use today, and it will change compute infrastructure because speed won’t matter when humans aren’t involved.

Stratechery by Ben Thompson