I asked ChatGPT to write me an entire Seinfeld episode about George getting banned from Twitter. It got the basic beats right... but... wasn't very good at making it funny.

For the final scene I emphasized, please make it funny, and instead of... doing that, it had Elaine tell George he should make sure to be funny on Twitter.

I always knew President Bartlet was a good man.
@mmasnick I had to try it now. First attempt failed. But of course, it is easy to evade. (Act 3 +4 wasn't much more interesting - as you can guess it had a happy end).
@mmasnick Huh what?
@clipperchip just a general notation of "huh, look at that!" sorry...
@mmasnick Ah, it was just so unspecific that I didn't know what you meant. The evasion part? Only trick is to make the prompt look like it's not referring to current events. Which it kinda will still do :)
@mmasnick you just know that Toby is going to be completely on board with the repeal too.
@mmasnick You’re making me want to rewatch The West Wing. I’ve always loved how it optimistically portrayed government/politicians as (generally) principled well intentioned people engaged in (mostly) good faith debate. Sure wish we could figure out how to get to that ideal.
Some might call it naive but there’s good in fiction that shows us something better than reality.
@mmasnick DONNA IS NOT BARTLETT'S PERSONAL ASSISTANT! Everything else the AI wrote is automatically invalidated.

@mmasnick They pretty well confirmed his free speech bona fides in the pilot.

Van Dyke: If our children can buy pornography on any street corner for $5, isn’t that too high a price to pay for free speech?
Bartlet: No.
Van Dyke: Really?
Bartlet: On the other hand, I do think that five dollars is too high a price to pay for pornography.

@mmasnick Huh. ChatGPT used to refuse to do scripts. Wonder what changed.

@mmasnick Text I couldn't fit in pic description.

As they work to repair the ship and gain the trust of the resistance, Kirk and the crew must also confront their own biases and beliefs about censorship. They begin to question whether their own society is truly free and open, and how they can better defend the principles of liberty and democracy.

@mmasnick its messing with us now, its alive. it has to be.
@mmasnick What if Seinfeld was an after school special?
@mmasnick
TBF, I don't think that's appreciably less funny than the 'jokes' Musk has been tweeting/retweeting lately.
@mmasnick I don’t think AI is very good at whatever it does. Maybe one day but not now. It’s uncanny valley with visual art, writing, everything
@mmasnick i had a very similar experience trying to tell chatgpt how to write jokes
@Viss @mmasnick As Josh Lyman would say "It forgot to put in the funny."
@mmasnick Just put a laugh track to it and it might actually work.
@mmasnick no hugging, no learning. two stars.

@mmasnick Oof. That's pretty dire.

Can ChatGPT do other sitcom formulas? Curious if this is just all sitcoms being mapped to a common blandness, or if there's something specific about Seinfeld that resists algorithmic decomposition.

@zalcarik @mmasnick I think it’s everything mapped onto a generic statistically plausible median…which means it always has a believable shape, but very mediocre. I think this is generalizable across domains. I experimented a lot with cocktail-related prompts for example…and you basically get a mediocre blandness to everything. It “knows” was a Negroni variations means…but can never really break out and understand how to break patterns.
@zalcarik @mmasnick so it’s not just about being “funny”. It’s all domains. Same thing with its sonnets and haikus. Tell it to write a poem and it defaults to trying to rhyme. But often without any understanding of overall rhyme schemes. I wonder if LLMs could be designed to have an understanding of time and chase and effect. (Or have a memory of what it wrote 3 paragraphs earlier)
@ericwilliamlin @zalcarik @mmasnick
I tried to persuade it to slant rhyme but it was not having it. Villanelles, on the other hand, no worries - as long as you don't look too closely at the result.
@ericwilliamlin @zalcarik @mmasnick if you understand how those models work, imo, this is exactly what one should expect. Alternative would be to turn up the randomness, and maybe you will get something occasionally interesting, but at the cost of producing a lot more total nonsense
@mrSaver @zalcarik @mmasnick oh for sure! I’m not expecting anything else! Again, very useful for some cases and lots of potential. It’s the “this is gonna replace x and it’s the end of y” folks who are overhyping these LLMs that annoy me. Let’s celebrate the work but acknowledge what it can’t do…and never can in its current state.

@ericwilliamlin @zalcarik @mmasnick oh yeah, definitely. It’s interesting, and kind of cool, but I don’t think the current approach is really ever going to like “replace most legal work” or “write interesting and accurate news articles” or whatever people think.

Tech journalism in general is always super optimistic imo.

@mrSaver @zalcarik @mmasnick It's not just the tech journalists. Also seeing a lot of breathless hype from the tech/startup crowd...and not just the opportunistic crypto refugees haha
@ericwilliamlin @zalcarik @mmasnick
I work in data science, and while I would not consider myself a machine learning expert, I really roll my eyes at a lot of the nonsense that gets touted as being AI. The way it’s used it’s almost just a buzzword with no real meaning. It’s in like every B2B technology pitch you will see, even when what they are pitching is quite dubious.
@mmasnick so it was a regular episode of Seinfeld?
@ericdano Aw, damn. You beat me to it. 😂
@mmasnick Perfect ending. That's how they treated each other on the show.
@mmasnick 1 ten letter word is my list of 10 letter words. :P
@mmasnick It wrote an episode of Seinfeld, but it wasn't funny? So... it wrote a typical episode of Seinfeld, then. I never could understand why that show was popular.
@mmasnick That's interesting. I wonder how much the inability to generate humour will be a marker of AI text generators.
@mmasnick I think the problem is you should have asked it to create an episode of a show about nothing.

@mmasnick There's the kernel of a decent satire there, given Michael Richards' famous racism, with the trick being that Kramer's white nationalism is what got George reinstated.

Or at least, that's where I thought it was going before I read up and saw this was AI-generated.

@mmasnick Did a thread on Twitter where I experimented with ChatGPT's notion of humor. https://twitter.com/isaac32767/status/1604955838262935555
Isaac Rabinovitch on Twitter

“Since #ChatGPT insists that lightbulb changing is a specialized task, let's try "janitors." The serious answer is, of course, unintentionally humorous. The "humorous" answer is kind of disconcerting.”

Twitter
@mmasnick this captures Bartlet's tone pretty well

@mmasnick

TBF The writers had that exact same problem

@mmasnick
Humor must be hard for AI. Even human theorist have troubled saying what is funny, or perhaps especially theorists.