"Especially in this moment in history, it is vital that we provide our students with the critical thinking skills that will allow them to recognise misleading claims made by tech companies and understand the limits and risks of hyped and harmful technology that is made mainstream at a dazzling speed and on a frightening scale."

Excellent call to action by @Iris

https://irisvanrooijcogsci.com/2023/01/14/stop-feeding-the-hype-and-start-resisting/

#AIhype #MathyMath #AI #ML #ChatGPT

Stop feeding the hype and start resisting

Three weeks ago, I wrote a blogpost about how ChatGPT is a “stochastic parrot” (a term coined by Bender, Gebru, McMillan-Major, & Shmitchell, 2021; see also this video for an explan…

Iris van Rooij
@emilymbender @Iris Nice, though my client rendered the title as start &nbsp resisting and I was totally onboard because I hate &nbsp

@DonnaLanclos @emilymbender @Iris

Yep, I caught it and boosted it. Excellent work, as usual, from Iris 👏

Thanks for keeping me in the loop Donna

@emilymbender @Iris I just want to thank the both of you for making me better able to think critically about AI in the midst of all this frenetic hype. You have alerted me to so many aspects of this that need deep consideration, not just plagiarism, cheating and human-machine co-creation (which were the first concerns I heard about), but also the perpetuation of bias and discrimination, the risk of misinformation, and dehumanization. And energy costs, too!
@tanyakaroli @emilymbender Very happy to hear it has been informative and useful!

@Iris @emilymbender
It really has, I am going to use it in my teaching this semester where I was already planning on having a discussion with my students about whether fiction generated by AI can be called literature (I am building a new course on what I call “Close linguistic literary analysis” (sorry, it doesn’t translate well from Danish)).

But now I want to broaden that discussion substantially to encompass the issues you and Prof. Bender raise!

@tanyakaroli @Iris @emilymbender

Machine “generation” should be called “statistical algorithmic composition”. Yet to see AI that initiates conversation or asks a question from self motivated curiosity. All those models are created by scraping words expressed by human beings, not other machines.
AI tech does not express a perspective or “write” literature. It statistically grammatically composes a string of text into plausible sounding sentences. Basically, “autocorrect”.

@tanyakaroli

shared earlier - https://blacktwitter.io/@bibliotecaria/109650353375080864

“Been seeing a lot about #ChatGPT lately and got my first question at the library this week from someone who was looking for a book that the bot had recommended. They couldn't find it in our catalog. Turns out that ALL the books that ChatGPT had recommended for their topic were “non-existent”. Just real authors and fake titles cobbled together. And apparently this is known behavior. 😮”

Wanda Whitney (@[email protected])

Been seeing a lot about #ChatGPT lately and got my first question at the library this week from someone who was looking for a book that the bot had recommended. They couldn't find it in our catalog. Turns out that ALL the books that ChatGPT had recommended for their topic were non-existent. Just real authors and fake titles cobbled together. And apparently this is known behavior. 😮

Black Twitter

@dahukanna

@tanyakaroli

Yes - leading to the fun of
https://write.as/51hqf64w2o4us

Instead I've been testing getting it to list books first, then writing the essay after, for example
https://write.as/cvbpw5g5z6eat
Here, some of the books are actually by the author I specified, and some are not.

I also tried
https://write.as/b3ppt1wnynfvz
(inspired by https://mastodon.social/@fivebooks/109694237075515848 by @fivebooks )

It all goes to show, I think, that the technology is impressive but shouldn't be thought of as an authority on anything (yet).

Write an essay answering the question: "What does it mean to cite your...

Citing your sources is an essential part of any academic or scholarly work. It refers to the practice of acknowledging the sources of information used in a research paper, essay, or other type of written work. The purpose of citing ...

Write.as
@edaross @dahukanna @fivebooks
I only checked the first source of the Cite your sources prompt—are they all nonexistent? Christ!

@tanyakaroli
Yeah - I think if they changed they way it worked, so it could think about the whole essay before presenting it, it might have a better chance at giving real sources (if they wanted to do that, anyway).
At least it could serve as an easy way to spot the students who didn't even check their work before submitting!

@dahukanna @fivebooks

@dahukanna @Iris @emilymbender Yes, exactly! This is the point I want to make to my students (or rather, hopefully, help them reach themselves).