Thought of this today - sh.itjust.works

OK, it would still be immensely stupid, a waste of resources and land, and probably not even work properly at all - but for a moment, imagine if devs/companies used ai to optimize their games/software/websites. That seems like something it should be used for, if we were in a Star Trek universe. Anyway back to reality, here’s your ad for SlopCoke!

Not that I know a thing about programming or game dev. But, from my ignorant position, I wonder if it would be possible to use LLMs to improve character dialogues in games. Imagine being able to type what your avatar wants to say, instead of picking a pre written dialogue option. And then the NPCs will reply accordingly.

Of course that poses some unsavory questions regarding voice acting, but I wonder if that would be a good application for it. I wouldn’t want any VA to get screwed with something like this

Anyway this is the part where you can reply and let me know how ridiculous this idea sounds and why

Some studios have already tried this. See Where Winds Meet for one of the most high-profile recent examples. I haven’t played the game myself, but my understanding is that the results are… weird. Not surprisingly, users pretty much immediately figured out how to coax unintended, game-breaking behaviors out of the AI NPCs.

But silly bugs aside, I think the main issue here is cost. So far we’re only seeing features like this in games with aggressive monetization, and that makes sense. LLMs are expensive to run. Getting good voice actors isn’t cheap either, but that is usually a fixed cost; you pay them once and that’s it. With AI, you’re paying for every single line of dialog uttered for as long as your game exists.

There are also no-zero setup and maintenance costs where you have to design specific guardrails to keep the AI from acting out of bounds. “Don’t give the player free loot, don’t use profanity or slurs, don’t discuss politics or sensitive topics with the player” et cetera. Of course players will always find ways around that, so now you’re playing a constant game of whack-a-mole trying to get this thing to behave the way you want. You’ve created a situation where you’re constantly paying for costly AI compute and you have to keep an “AI whisperer” on payroll. Suddenly paying a VA doesn’t seem so bad.

I see. Heh I’m not surprised people trying to push the boundaries of what it’s supposed to do… Time will tell, ideally you would want to keep voice acting as much as possible. Maybe in a future there is a way to properly blend both, also running the ai locally. But yeah I can see your point.