The biggest news for me at #GoogleIO today was TPU 8 with their specialised version for Training and Inference. Making custom silicon is a serious effort, so Google must see a future whey they are constantly training models on a massive scale. I wonder if all this is to develop their next Generation of Gemini Models, of if we soon a much larger model zoo of (personalised) models? 1/n

Does anyone know why Google went and built dedicated silicon for #AI model training? (Improving their Gemini models or an extended zoo of (personalised?) models?)

A bit of googling shows the original announcement is almost a month old now, but it does not go into detail what exactly the TPU 8t models will be doing 🤔

https://cloud.google.com/blog/products/compute/tpu-8t-and-tpu-8i-technical-deep-dive 2/2

#googleIO

TPU 8t and TPU 8i technical deep dive | Google Cloud Blog

The 8th generation TPUs are engineered with system-level co-design to accelerate the AI lifecycle. TPU 8t is built for frontier-model training and TPU 8i is built for large-scale inference and reinforcement learning.

Google Cloud Blog