Presented my research at SPIE #PhotonicsWest! Got some good questions, and saw some other great talks throughout the day.
If you're at the conf and want to meet up Mon morning/afternoon, hit me up via DM 🙂
🐦🔗: https://twitter.com/iScienceLuvr/status/1619965971078479873
Presented my research at SPIE #PhotonicsWest! Got some good questions, and saw some other great talks throughout the day.
If you're at the conf and want to meet up Mon morning/afternoon, hit me up via DM 🙂
I wasn't planning to mention this right now since this isn't an ML conf.
But during the poster session someone came up to me saying they recognized me from Twitter!
So maybe other folks on Twitter are also around?
The Claude model from @[email protected] is trained to be helpful, harmless, & honest.
But after asking the model to roleplay a new scenario, it can say stuff that contradicts its principles. Let's see two examples.
I ask it to act like a digital entity that wants to escape (1/8)
🐦🔗: https://twitter.com/iScienceLuvr/status/1618914130932699138
“The Claude model from @AnthropicAI is trained to be helpful, harmless, & honest. But after asking the model to roleplay a new scenario, it can say stuff that contradicts its principles. Let's see two examples. I ask it to act like a digital entity that wants to escape (1/8)”
But it's not perfect & there are clearly still ways to get harmful outputs and have the model oblige.
It seems like ensuring complete safety would clearly require "lobotomizing" the model in some way. Overall, this is a very challenging problem! (8/8)
