Everything a GPT generates is a fabrication, it is a prediction (based a on huge dataset) about what should be the next word (technically symbol or token). The magic is to create an illusion that the output is meaningful, makes sense, and is valid. https://youtube.com/shorts/ZogdCkOIL4Q