LLMs are modeling outputs, not replicating a process, as a result the output looks the same but it isn't made of the same stuff.
It is a plastic banana.
There is nothing inherently wrong with a plastic banana but as soon as you claim you can use it to solve world hunger people are going to be upset and it doesn't matter how much it looks right.
I might have agreed before I read the NY Case ChatGPT generated cases, but now having read that and to be frank legal documents produced by copying and pasting by people with no domain knowledge I can say, not it isn't the same thing at all, at least in this case.
Because the person understands what they are trying to do. Prompts don't replicate that.
Understanding, thinking and having a narrative of events matter and have a lot to do with what even someone blind to the issues chooses and frankly I didn't fully understand that until I saw.what happened when they didn't.
Vrimj
Justin Dearing