🔵🟠🟡 Into the gap
by Mandy Brown
@aworkinglibrary #MandyBrown
"...those who see war not as an abomination but as yet another opportunity to increase their bloated purse."
#War #AI #Refusal #Wealth #Influence
🔵🟠🟡 Into the gap
by Mandy Brown
@aworkinglibrary #MandyBrown
"...those who see war not as an abomination but as yet another opportunity to increase their bloated purse."
#War #AI #Refusal #Wealth #Influence
Refusal in Language Models Is Mediated by a Single Direction
https://arxiv.org/abs/2406.11717
#HackerNews #language #models #refusal #research #AI #ethics #single #direction

Conversational large language models are fine-tuned for both instruction-following and safety, resulting in models that obey benign requests but refuse harmful ones. While this refusal behavior is widespread across chat models, its underlying mechanisms remain poorly understood. In this work, we show that refusal is mediated by a one-dimensional subspace, across 13 popular open-source chat models up to 72B parameters in size. Specifically, for each model, we find a single direction such that erasing this direction from the model's residual stream activations prevents it from refusing harmful instructions, while adding this direction elicits refusal on even harmless instructions. Leveraging this insight, we propose a novel white-box jailbreak method that surgically disables refusal with minimal effect on other capabilities. Finally, we mechanistically analyze how adversarial suffixes suppress propagation of the refusal-mediating direction. Our findings underscore the brittleness of current safety fine-tuning methods. More broadly, our work showcases how an understanding of model internals can be leveraged to develop practical methods for controlling model behavior.
In his video essay "Suno, AI Music, and the Bad Future", bassist Adam Neely quotes Mikey Schulman, co-founder of Suno, an "AI" music-generation app, who defines his values as "Music, Impatience, Aesthetics, and Fun". After offering "Patience" as one alternative, Neely links Schulman's statements to the Italian Futurists and their
#refusal : denial of anything demanded, solicited, or offered for acceptance
- French: négative
- Italian: negazione
- Portuguese: recusa
- Spanish: negativa
------------
Word of The Hour's Annual Survey @ https://wordofthehour.org/r/form

Your responses to the questions below will directly impact the future of Word of The Hour. Your support and kindness has really meant a lot over the past three years. Thank you so much! Michael Wehar https://wordofthehour.org [email protected]
I recently shared a post calling out mystics, trying to fill spaces I deflate, but I am self-aware enough that I can be guilty, too.
#philosophy #language #refusal #metaphysics #ritual #performance #blog #podcast #deflation #puzzles #selfaware #maslow #critique #problemssolving #deconstuction #dis–integration #diagnostic