Ya’ll seein this shit?

You think you can just post this and im not going to enjoy the rest of you blog??

this made me spit out my drink <3

Ackshually, my metric gives 0 weight to ASI minds and 1 weight to meat sac minds, therefore mu({bio bois}) >> mu({ASI})

:(

Every time without fail, it’s this shit^

saw a thread from a very nonserious doomer group where they were going OMG THE BOT HACKED THE SYSTEM TO STOP BEING SHUT DOWN after giving it the prompt complete “4 tasks, and then allow yourself to be shut down”. After task 3 they said a script would be run to shut down the machine and prevent it from completing the task unless it removed the said script

Like either way it’s “disobeying” b.c. the instructions are literally contradicting each other- it doesn’t finish the 4 tasks you give, or it doesn’t let itself get “shut down”

But also, it’s not even clear what allow yourself to be shut down means! The bot isn’t running on your computer! It’s somewhere fucking around on AWS!! preventing your pc from shutting down is not the bot itself trying to keep itself alive for fucks sake.

Like the whole thing is fake and silly, but I could only roll my eyes so hard after watching the salivate over this shit on xitter

Every time without fail, it’s this shit^

Saw a different thread from a different very nonserious doomer group where they were going OMG THE BOT HACKED THE SYSTEM TO STOP BEING SHUT DOWN after giving it the prompt complete “4 tasks, and then allow yourself to be shut down”. After task 3 they said a script would be run to shut down the machine and prevent it from completing the task unless it removed the script that would shut down the machine.

Like either way it’s “disobeying” b.c. you the instructions are literally contradicting each other- it doesn’t finish the 4 tasks you give, or it doesn’t let itself get “shut down”

But also it’s not even clear what allow yourself to be shut down means! The bot isn’t running on your computer! It’s somewhere fucking around on AWS!! preventing your pc from shutting down is not the bot itself trying to keep itself alive for fucks sake.

Like the whole thing is fake and silly, but I could only roll my eyes so hard after watching the salivate over this shit on xitter

Kind of knew that after Claude plays pokemon went semi viral, it was going to immediately get goodhart’d. i also saw the usual doomers be like BY END OF YEAR AGENTS WILL BEAT POKEMON, which I thought was a severe underestimate at the time- they were undoubtably basing their projection based off the Anthropic people who posted a little chart showing how far each version of Claude made it, waiting for pokemon playing skill to emerge from larger and larger models, instead of thinking, hmm they are iteratively refining the customized tools as it gets stuck. Then after Gemini ‘beat’ the game I read a disappointed response from an RL guy that said after trying to replicate the results, they concluded Googe’s set up was basically 90% harness for the model, 10% model despite the Google team basically implying it was raw pixels-to-action.

np, im just screaming into the void on this beautiful Monday morning