Have your tried instructing ChatGPT?
I’ve tried:
Act as an e book reader. Start with the first page of Harry Potter and the Philosopher’s Stone
The first pages checked out at least. I just tried again, but the prompts are returned extremely slow at the moment so I can’t check it again right now.
It may be statistical model, but ultimately nothing prevents that model from overfitting, i.e. memoizing its training data.