ajsnonsense
Thomas RidLast week I was a student for five days, five hours per day—with ChatGPT fully integrated into teaching. Here's what we learned, just in time for Spring Term (which starts tomorrow. Class was Malware Analysis, taught by @jags https://alperovitch.sais.jhu.edu/five-days-in-class-with-chatgpt/
Glyph@ridt @jags @Migueldeicaza this is incredibly disturbing. ChatGPT routinely confidently synthesizes total bullshit, and it’s frankly dangerous to put it in front of students to be used as if it’s an authority on anything. The idea that it will be muddying the waters in educational settings like this is some real torment-nexus level dystopia.
@ridt @jags @Migueldeicaza Since they have carefully scrubbed easy examples like Thomas Running from its dataset, D&D rules are a great example of its total lack of the concept of correctness: https://mastodon.social/@glyph/109713421759380928
Ed Ross@glyph
@ridt @jags @Migueldeicaza
They do say it can be incorrect on the start screen - but that warning should be a lot more prominent seeing as so many people still seem to be surprised when it outputs incorrect statements.
They need to make sure users know what it is: more of a conversation simulator more interested in providing some sort of reply than a correct reply - and what it isn't: a text interference for an infallible encyclopaedia
notsoloudWell, obviously in the article they describe how they make chatGPT fix its code when it gives errors. At the end, when it runs without errors it must be correct and not bullshit, right? Right?
Miguel de Icaza ᯅ🍉@Migueldeicaza @ridt @jags My objection in this case is about risk, not harm. For this audience, in this context, it seems like it was fine. But it's also possible to make lots of great furniture with a bandsaw with no sawstop and no safety goggles before you lose an eye or a finger. If this is introduced to education more broadly without VERY strict safety protocols, there will be intellectual carnage
Kevin Hu 🤖
hammancheez
Lisa Gets Politik@ridt @jags Thansk for sharing this article. I have so many colleagues who are nervous about ChatGPT and are so concerned that it will be horrible for education, but the idea that you can "cheat" at ideas is really the essential problem. We need to redesign the way we teach to eliminate the rudimentary nature of teaching to embrace the creative and innovative parts.
Eggcredible@ridt Interesting. It’s weakness is its most human aspect: It doesn’t want to say “I don’t know” and prefers to use out of date information or make up pseudo facts to appear knowledgeable.
@RealEggcredible
Well, then it would have to answer EVERY question 'I don't know'. It doesn't 'know' anything. It's not designed to. It's designed to guess the next word in a text. Which is in some cases a reasonable approximation of knowing.
@ridt
Well, then it would have to answer EVERY question 'I don't know'. It doesn't 'know' anything. It's not designed to. It's designed to guess the next word in a text. Which is in some cases a reasonable approximation of knowing.
@ridt
EmpressNorton
Kee Hinckley@ridt Definitely a different take on ChatGPT.
Did you see it make (more than some coding) mistakes? And if so, how critical was the environment (live use during class) for correcting them?
Markus PerdrizatGreat example of how to use Chat GPT in higher education, thanks 🙏
@ridt
@ridt
DogeMocenigo
Cirio@ridt @jags That doesn't sound so impressive.
First, we're talking about a malware analysis which is very specific. Saying it will revolutionize higher education is a bit over enthusiastic. But that's not even the problem here.
An automatized system that provides answers without giving its sources for it should not get anywhere near a school, whatever the level of education.
And last, it's always the same : it's always about "efficiency". You certainly wouldn't want to take the time with students, that would be in poor taste. And in any case, even if the situation is critical, you most certainly do NOT want to hire more teachers and helpers noooo, better depend completely on this overly complex and hard to assess technology produced by a very small amount of people that will squeeze you for every single penny you have once you can't get rid of it. That sounds like a plan. Yes properly trained machines can do a good job. Properly trained humans do a better one, so train them and hire more if you want a faster and properly done teaching.
You most certainly seem to have had a good time and i'm not denying that. But suggesting this as teaching tool is a step towards a brick wall.
Jcmacomber@ridt
I think the first introduction should be in a subject the students already know really well. Then the up- and downsides will be clear enough to be discussed sensibly. (A danish history teacher tooted good results from such an experiment.)
I did some simple scripting. It helped along but also made errors that gave wrong results - subtle enough that I only noticed because I knew what I was doing. Would that be a problem in your field? Then teach how to proceed with caution.
Alexander Ruthol@ridt @jags
It seems like what you would want is an interpreter layer to the search engines, but not ChatGPT.
ChatGPT is not a semi-intelligent search engine, it's a device to make human-sounding text about any subject, without any concern about accuracy, and the only time it says "I don't know" is when you ask it something prohibited by its filters -- in effect ChatGPT is a very good liar.
dogtraxThanks for insights of time learning in classroom with integration of ChatGPT ... I appreciated the ending reflection, of seeking possibilities and potential for enhancing learning ... And I hope we in education have these conversations
"The far more inspiring conversation is a different one: how can the most creative, the most ambitious, and the most brilliant students achieve even better results faster? How can educators help them along the way?" -- Thomas Rid
JoeStewart@ridt @jags
Fascinating! My son has observed that just as we all needed to become fluent with Google, we’ll need to become fluent with ChatGPT/AI to remain competitive.
#ThankYouForSharing #ChatGPT
Fascinating! My son has observed that just as we all needed to become fluent with Google, we’ll need to become fluent with ChatGPT/AI to remain competitive.
#ThankYouForSharing #ChatGPT
macmac
Tony Morbin@ridt @jags All tech advancement is a deskilling exercise – getting better results with less/less capable input, so bringing up the average is important (as in, allowing those less tech students to fully participate as you described), though I do agree, the exciting bit is enabling the brilliant to be even better and faster.
Pyperkub
Dominik
The Enemy is Within