Okay folks: this morning we're launching something we think is pretty useful. Lots of people have strong opinions on how content moderation should work, but they've never done it. So we built a content moderation mobile game (browser-based): https://moderatormayhem.engine.is/

Details about it are here: https://www.techdirt.com/2023/05/11/moderator-mayhem-a-mobile-game-to-see-how-well-you-can-handle-content-moderation/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

Btw, when you finish the game, it gives you social sharing info that you can copy and paste here. For example:

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: 🌟🌟🌟🌟🌟
Total reviews: 158

Safety: βš–οΈ
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–βš½5️⃣πŸ₯ˆ8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick I especially like the team building activities my boss has in stock! πŸ˜‚
@jens YES! Those were the last thing I added to the game.

@mmasnick mike why would you even give this game a win condition

smh

@palecur heh. the whole point is that by "winning" it just means you have to keep doing it and manage others who do it as well.
@mmasnick truly the worst sort of victory

@mmasnick

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: ⭐⭐⭐⭐◾️
Total reviews: 93

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–5️⃣8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

‐------
Nice!

A little bit difficult is to know the server rules in advance (e.g. at kolektiva.social, 'burn the police department' wouldn't be considered out of tone, but commercial ads are removed  ).

And the time pressure... I would strongly advise the mod team to search additional members so one could investigate the context of each report better.

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick I closed my browser window too soon and didn't copy this!

I was promoted to manager after 97 reviews 😎

@mmasnick

my mistake, there it was

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: 🌟🌟🌟🌟🌟
Total reviews: 97

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–5️⃣8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick

Took me a bit to get the hang of it, but it was definitely a fun experience. Thanks for sharing it!

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: ⭐⭐⭐⭐◾️
Total reviews: 113

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰πŸ—³3οΈβƒ£πŸ€–5️⃣πŸ₯ˆ8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick I got fired for being too 🐒. Lotsa love for those who can do this quickly and effectively πŸ’š

@[email protected] won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: ⭐⭐⭐⭐◾️
Total reviews: 93

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–πŸ—³5️⃣8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/cial

@mmasnick

Ugh. You can't fire me because I quit!

I lost #ModeratorMayhem on Round 1

Fired for poor judgment
Rating: ⭐◾️◾️◾️◾️
Total reviews: 6

Safety: βš–οΈ
Speech: βš–οΈ

Achievements: πŸ‘Ž

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick I was fired!

I lost #ModeratorMayhem on Round 2

Fired for poor judgment
Rating: ⭐◾️◾️◾️◾️
Total reviews: 19

Safety: βš–οΈ
Speech: βš–οΈ

Achievements: πŸ‘Ž

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@staidwinnow @mmasnick same here!

Honestly, at the pace cards were piling up, I didn't know what I was clicking anymore!

I lost #ModeratorMayhem on Round 2

Fired for poor judgment
Rating: ⭐◾️◾️◾️◾️
Total reviews: 25

Safety: βš–οΈ
Speech: βš–οΈ

Achievements: πŸ₯‰πŸ‘Ž

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@staidwinnow @mmasnick

Was this created by a former #hachyderm.io moderator?

https://moderatormayhem.engine.is

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick great game, should be compulsory for everyone making policy about moderation…

I won #ModeratorMayhem on Round 8

Selected to instruct at the elite TOP MOD program!
Rating: 🌟🌟🌟🌟🌟
Total reviews: 161

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–5️⃣πŸ₯ˆπŸ“°8οΈβƒ£πŸŒŸ

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick like this? I lost #ModeratorMayhem on Round 1

I quit!
Rating: ⭐◾️◾️◾️◾️
Total reviews: 13

Safety: βš–οΈ
Speech: βš–οΈ

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick thank you for the fun 15 minutes! β€‹

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: ⭐⭐⭐⭐◾️
Total reviews: 149

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–5️⃣πŸ₯ˆ8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick
Is there a key to the Safety and Speech icons? I got

Safety: 🦺
Speech: πŸ“£

And it seems like a lot of people who got fired had the justice scales for both but I don't know what these mean! Is safety vest good? Are there other possible icons?

Thanks for the game :)

@flopperdog there are 3 possible icons. What you got is that your site was safe (safety vest) and you were high on free speech. The scales means more middle ground (balanced) and then there's a skull/crossbones for bad safety... and.... I'm forgetting what the speech one is.
@mmasnick Cool thanks for the explanation!

@mmasnick
I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: 🌟🌟🌟🌟🌟
Total reviews: 104

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–5️⃣πŸ₯ˆ8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick bro. This is really stressful. I hate it. I love it.
@grthomas that's the feeling we were going for
@mmasnick This is like Papers, Please but you get your own barista.

@mmasnick
Apparently experience with grading helps?

It was the time aspect of the game that was the eye-opener for me. Of course there will be time pressure for moderators; this had never occurred to me. And it’s so stressful!

β€’β€’β€’

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: ⭐⭐⭐⭐◾️
Total reviews: 90

Safety: 🦺
Speech: πŸ“£

Achievements: πŸ₯‰3οΈβƒ£πŸ€–5️⃣8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@mmasnick wait... It's actually possible to succeed? I tried it a few times but got fired on all of them :(
@guust if by "succeed" you mean, get promoted and have to deal with even more...

@mmasnick

It appears this "free" game is mining players' data via Google analytics, etc.

@mmasnick
Froze up on my iphone into round 1.
@noondlyt oh no, really? there was a freezing bug we found in testing a while back, but I thought we fixed it...
@mmasnick
I was able to continue without issue on my second attempt.

@mmasnick

My game started freezing in round 1 and then refused to render the cards after 3 decisions. I also got the big someone reported where the buttons at the bottom disappeared

@DigitalSecurity seems to have happened for a few people. we're trying to track down that bug, but we're having trouble replicating it.
@mmasnick While I have never had a time limit for any of my time as moderator, this is a solid explanation of how many gray spaces there are in the work.
@EricaFriedman Yeah, it depends on the job, but we needed to simulate pressure. There are stories of overseas moderators who were judged based on time per review as well...
@mmasnick can't wait for all the players who do poorly to just complain about the rules of the game, not understanding that that's the whole point. πŸ˜‚

@mmasnick
well that didn't work out as a test of the real thing. Either I get to see the post and the context in which the post appeared or I'm out.

I'm out.

@mmasnick looks great! The "learn more" πŸ‘ thing doesn't work for me though (Firefox on Android, will check adblocking settings)
@nev @mmasnick I thought it didn’t work for me at first and I think it was a tad unclear at first (or maybe I wasn’t paying attention) that I had to hold the eye button down for a few seconds for additional context to show. Maybe try that before fiddling with your settings?

@mmasnick Don’t tell the members of my instance but I lost #ModeratorMayhem on Round 4

Fired for poor judgment
Rating: ⭐◾️◾️◾️◾️
Total reviews: 54

Safety: βš–οΈ
Speech: βš–οΈ

Achievements: πŸ₯‰3οΈβƒ£πŸ€–πŸ‘Ž

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@profcarroll @mmasnick i was terrible at this - fired after round 2 - what on earth am I doing moderating a Mastodon instance!

@simoncox @mmasnick

After some practice I got promoted. But much harder than real-life modding a small instance.

I won #ModeratorMayhem on Round 8

Promoted to moderator manager!
Rating: ⭐⭐⭐⭐◾️
Total reviews: 96

Safety: βš–οΈ
Speech: πŸ“£

Achievements: 5️⃣8οΈβƒ£πŸ—“

Play: https://moderatormayhem.engine.is/

Moderator Mayhem: A Content Moderation Game

Can you succeed at the fast-paced challenge of content moderation?

@simoncox @mmasnick @profcarroll so... you're still doing better than Elon Musk?
@RyunosukeKusanagi @mmasnick @profcarroll Yes, but nothing to write home about realy. 🀣
@simoncox @profcarroll @mmasnick Hoping nothing too bad comes your way so therefore no disaster happens
@simoncox @profcarroll @mmasnick Great job, Mike. You've killed Mastodon by giving every instance admin a self-confidence crisis.
@simoncox @profcarroll @mmasnick 🀣 all the luck πŸ€ to you …. I’m too 🐒 slow for the job πŸ’š
@profcarroll @mmasnick this is crazy! I feel like Lucille Ball at the chocolate factory!
@mmasnick I have had trouble with the "Look Closer" button in three different browsers. Is there a good place for reporting issues? (I did very poorly without the button!)
@kkeller ...lol, looks like PEBKAC, sorry!
@mmasnick it tells me I should have looked closer, but the look closer button doesn't do anything. I quit. :P