Writing an LLM from scratch, part 10 -- dropout

Adding dropout to the LLM's training is pretty simple, though it does raise one interesting question

Giles' Blog