Here's a first... I just got an email because ChatGPT suggested an article I wrote to somebody. Could I send them a copy? Except, I never wrote the article, it doesn't exist. PLEASE realize right now that this tool isn't pulling out cool references for you. It's making plausible titles and matching them to authors names.
@L_howes All you need to do now is write the article. That should fix everything up, I think.
@micefearboggis I googled the sentence that was quoted as coming from my article... it looks like a straight copy-paste from a press release from 2021, so I've sent that over instead.
@L_howes @micefearboggis
Can OpenAI/Microsoft be sued for libel if ChatGPT/Bing accuses you of saying/doing something you never said/did?
@micefearboggis @L_howes maybe just let chatgpt write the article itself. Otherwise the robot overlords will learn how to get those humans write articles for them. ;)
@L_howes it has been giving me URLs to non-existing github repos
@L_howes
A friend of mine at the university library spent quite a bit of time helping a customer trying to find some elusive references, before they said that the "references" came from ChatGPT.

@maswan @L_howes

Same here. I had to tell the person that the citations didn't exist. Librarians are used to chasing down references. I have had to tell people that a citation they were looking for didn't exist every once in a while. But the potential scale of made up references from tools like #ChatGPT and other #LLM is frightening.

#AIEthics #GenerativeAI

@bibliotecaria @maswan @L_howes I wonder if the theme of 2023's bingo card will turn out to revolve around AI breaking the internet by filling it with so much made-up stuff that human trolls can no longer compete?
@L_howes It really should be called ChatPBG - Plausible Bullshit Generator.

@nightwhistler @L_howes

I learned that stochastic parrots is the technical term.
Colleges should be using that phrase to help students understand the limitations of it.

#Ai #Academia #Ethics

@gabigueron @L_howes I recently read an article calling ChatGPT "A blurry JPEG of the Internet" and it made a ton of sense.
@L_howes Johnson will get it to write his book on Shakespeare or nick chuncks from my wife’s doctoral thesis
@L_howes @Andi yes it makes up citations and poems, but taking it seriously (as per bing and google) licenses other institutions to use it to e.g. make up accusations of benefits fraud
@L_howes @Andi example of algos making up accusations of benefits fraud https://www.lighthousereports.nl/investigation/the-algorithm-addiction/
The Algorithm Addiction

Mass profiling system SyRI resurfaces in the Netherlands despite ban and landmark court ruling

Lighthouse Reports
@L_howes @Andi an analysis of the political implications of chatgpt (& other llm's) https://www.danmcquillan.org/chatgpt.html
We come to bury ChatGPT, not to praise it.

@L_howes Someday someone will write something just to fullfill the IA's invention.
Write an essay answering the question: "What does it mean to cite your...

Citing your sources is an essential part of any academic or scholarly work. It refers to the practice of acknowledging the sources of information used in a research paper, essay, or other type of written work. The purpose of citing ...

Write.as
@L_howes Wow, ChatGPT truly shows how much of an unhinged nightmare AI can really be.
@L_howes Once it suggested I use plausible but non-existing functions in the JavaScript standard library...

@pygy

@L_howes Happened to me as well. Also GitHub Copilot did it, suggesting I use Math.randomseed() for seeding the RNG (which IIRC isn't possible in the JS stdlib)

@L_howes A CEO of a competing AI company recently told me that when people ask ChatGPT about good AI companies, his company's name is one it spits out, which has been driving inbound interest from potential job candidates.

Just an odd detail.

@L_howes
This is really quite scary. The potential for misinformation is clear, but this is stuff that can affect people's careers.
@L_howes saw this with another author whose work was cited incorrectly by ChatGPT. Pretty worrying
@L_howes I am instantly reminded of the sorcerer’s apprentice scene in Fantasia. Tools like this can generate so much nonsense that _looks_ plausible, but really is not. Yet another layer of confusion to cut through in search of facts and truth.
@L_howes Yes, I've noticed this trait of ChatGPT. I asked it to compile a bibliography for me thinking it might be a helpful short-cut and something it might be able to do. What a laugh, it creates plausible titles and attaches them to various authors in the subject area.
@L_howes Yep. Chat GPT will automatically engage in identity forgery or theft if the information exists in the training dataset and if it makes sense. Just another reason to not leave sensitive information lying around on the web. See https://toolsforthought.rocks/@absamma/109879390606671849
Abraham (@absamma@toolsforthought.rocks)

Attached: 1 image Note to self: Chat GPT will shamelessly spill someone else's details and claim it as its own/someone else's if it fits the context of the chat. Automatic identity theft. This is why grounding it is ESSENTIAL. It's a very good bullshitter. --- RT @DaveLeeFT Someone asked ChatGPT if it had a Signal... and it gave him *MY NUMBER*. https://twitter.com/DaveLeeFT/status/1626288109339176962

Tools For Thought Rocks!

@L_howes

That’s worrying, an AI that is lying basically…

@L_howes it’s not really artificial intelligence, it’s a man-made bullshit generator
@L_howes I've seen that as well. It just makes stuff up. Basically, ChatGPT is truth agnostic.
@L_howes holy shit, that’s terrifying.
@L_howes Wow! 😳 "AI" is really going in all the wrong directions, isn't it...
@L_howes omfg that explains a few emails I’ve received

@L_howes:
— "Omg! I finally get to meet you! ChatGPT has told me so many things about you!"

— 

@L_howes

Ha! It sounds like the a paper I once evaluated. It had lots of fake but plausible references and I the plagiarized texts it had lifted were on point. It was clearly work of a sophisticated “I’ll write your term paper for pay” service.

(In Venezuela I had no access to plagiarism detectors, except googling every piece of suspect text. The cheaters count on the underpaid professors to not do that).

@gabigueron In a reinforcing biases note, it turned out the sentence/data was lifted from a press release from the guy's own company.
Sean Murthy (@smurthys@hachyderm.io)

If you think people believing anything they find in web searches is a problem, wait until they start using ChatGPT as search engine. Redux: https://mastodon.social/@smurthys/109761591525723866

Hachyderm.io

@L_howes

Ehm write a wild article with the help of chatGPT and the send.this

De quoi ChatGPT est-il VRAIMENT capable ? | Ft. Science4All

YouTube
@L_howes that’s what inference is. It makes up worlds based on user prompt and training weights.

@L_howes

I was using it yesterday and it gave me information about a book that doesn't seem to have ever existed. It claimed to search the net for a domain I own sand said it was owned by Ron Paul! It took a fair amount of coaxing to get the model to admit these flaws.

@L_howes holy crap. That’s nuts.
@L_howes great! We've invented a disinformation bot and integrated it into a search engine.
@L_howes Prmopted by your post, I asked ChatGPT for references to anything I had published about the Gospel of John (about which I have (I think) published nothing):
@L_howes TBF, I did edit *Postmodern Interpretations of the Bible: A Reader*, but there is no essay in it on 'John and the Ethics of the Johannine Community,' and none of the other alleged articles have any connection to me whatsoever.
@L_howes Adjacent on my recent timeline - someone gets a Signal message because ChatGPT was asked if it's reachable via Signal, and it gave out that person's number: https://mastodon.social/@daveleeFT/109876410735127795
@L_howes And, who on earth is using ChatGPT to write articles in your discipline? What bill of goods is being sold here?!!!
@L_howes and, so, it begins. AI adds a layer of irritation for mankind that couldn’t exist without it. As it is early days, you may be the first. Revel in your anonymous notoriety. You are probably the first of millions of annoyed researchers and writers. We tip our hat to you o mighty one, first amongst us. It gives me something to look forward to.
@L_howes looking on the bright side people reaching out to you for articles that you didn't write may be a good source of validated ideas for articles that you should write