Pretty neat transformer visualization project. Wonder if this could help with debugging 😜
https://poloclub.github.io/transformer-explainer/
An interactive visualization tool showing you how transformer models work in large language models (LLM) like GPT.
Mehrdad Yazdani