LLMs are modeling outputs, not replicating a process, as a result the output looks the same but it isn't made of the same stuff.
It is a plastic banana.
There is nothing inherently wrong with a plastic banana but as soon as you claim you can use it to solve world hunger people are going to be upset and it doesn't matter how much it looks right.
I might have agreed before I read the NY Case ChatGPT generated cases, but now having read that and to be frank legal documents produced by copying and pasting by people with no domain knowledge I can say, not it isn't the same thing at all, at least in this case.
Because the person understands what they are trying to do. Prompts don't replicate that.
Vrimj
Justin Dearing
Dawn Ahukanna