After some further experimenting and digging into what others had done, I was able to dramatically increase my token counts.

The input is the first half of Neuromancer Chapter 1 (ending just before Case meets Julias Dean): ~4700 tokens. Output was 1280 tokens, so I managed roughly 6k total tokens on a 16 GB GPU.

It produced some interesting alternate universe Chapter 2's. 🤯 #ML #AI #MPT #MPT7b #Storywriter