Hacker News3d ago

Intuitions for Tranformer Circuits

https://www.connorjdavis.com/p/intuitions-for-transformer-circuits

#HackerNews #Intuitions #for #Transformer #Circuits #AI #Research #MachineLearning #NeuralNetworks #TransformerCircuits

Intuitions for Transformer Circuits

A mental model for addressing the residual stream

Connor's Substack
Hacker NewsMar 28, 2025

The Biology of a Large Language Model

https://transformer-circuits.pub/2025/attribution-graphs/biology.html

#HackerNews #Biology #LargeLanguageModel #AI #Research #TransformerCircuits #NLP

On the Biology of a Large Language Model

We investigate the internal mechanisms used by Claude 3.5 Haiku — Anthropic's lightweight production model — in a variety of contexts, using our circuit tracing methodology.

Transformer Circuits