@olafurw generative text networks don’t actually understand the words in any way. The models just see a unique number associated with the word.