Dan RiskinDec 18, 2022
I asked #chatgpt to write me an essay, with citations, about a scientific topic I know very well (bat crawling behaviour). It wrote a bad essay that didn’t really say much, but cited two papers with which I wasn’t familiar, in very good journals. I was freaked out! How did I not know those papers?
Turns out, chatgpt just made them up. The papers don’t exist. That’s a handy thing to know.
Show threadtolortslubor
@riskindan Screenshot, please. Was the ability to lie, and predilection to do so, deliberately programmed into #chatgpt #gpt3 #chatgpt3 #AI #chatbot
Dec 18, 2022 at 2:45pmWeb
Show threadJames BaillieDec 19, 2022
@tolortslubor @riskindan Large language model AI doesn't come with any sort of concept of truth: the only objects it handles are words and their connections. The problem isn't that it's built to intentionally lie, but that preventing this sort of machine producing untrue statements is immensely difficult: it produces a probabilistic response based on the prompt, without a check of external truth (and if you think "well that sounds dangerous"... yes, it very much is.)
Show threadMartino MosnaDec 19, 2022

@JubalBarca @tolortslubor @riskindan

My take on it is: GPT-3 doesn't have *structure*.

Wanna have structure? You've got to give it yourself to the AI in your prompt.

It's actually good for fluffing up raw, cold, structured data... and make it nicely human readable.

Show threadAnsel HalliburtonDec 19, 2022
@JubalBarca @tolortslubor @riskindan Been thinking about this. I wonder about filtering LLM output through semantic linked data.
Show threadWolf480plDec 19, 2022

@JubalBarca @tolortslubor @riskindan
An intuitive explanation I've heard is:

ChatGPT just wants to tell you a cool story.

Show threadSimon LucyDec 19, 2022

@tolortslubor @riskindan

If you can say it in the language then the model will generate sentences without any value attached as to truth or fact, it just has to be sayable and fit the style required.

Show thread猫好きな人Dec 19, 2022

@tolortslubor

Ask it: “Explain the research of [made up name] into [made up research area]”. Then ask it to provide citations.

Show threadMarverdeDec 19, 2022
@valoisdubins @tolortslubor
🤣🤣🤣🤣🤣🤣🤣
Show thread猫好きな人Dec 19, 2022

@Marverde @tolortslubor

I also did this.

Show threadMarverdeDec 19, 2022
@valoisdubins @tolortslubor
Could be so useful...
Show thread猫好きな人Dec 19, 2022
@tolortslubor @Marverde
Yet she struggles to be accepted at conferences to speak.
Show threadtolortsluborDec 19, 2022
@valoisdubins That an #ai can make up citations demonstrates creativity, but also a lack of understanding, research skills and ethics
Show thread⁂ Fish Id WardrobeDec 19, 2022

@tolortslubor @riskindan In order to lie, you have to understand what you are saying.

So-called AI does not. There's no "there" there.