BeepAnthropic says it ‘cannot in good conscience’ allow Pentagon to remove AI checks
lumpenproletariatWtf, I never would have expected this level of resistance. What’s the catch, fear of intentional reprisals?
IlovethebombI imagine partly liability concerns, partly protecting their reputation.
Basically they don’t want their technology being used for something it’s not ready for, something going badly wrong, and them getting the blame.
They’re getting far more press than they ever would have had the capitulated like the other companies. Now they get to frame themselves as the “good guys”. They’ll end up doing (more of) the evil shit soon enough, but they just had a huge marketing coup. Smart play by one of the biggest grifters, bravo.
How is a private company the voice of reason in this?
…because every now and again, for the briefest of moments, one them shows themselves not to be run by entirely evil, lecherous humps?
Blink and you (or the shareholders) might miss it.
Don’t buy the hype. They’re not acting in good conscience, they’ve just weighed the pros and cons and decided that the PR hit isn’t worth it.
Having said that…let’s see how it shakes out. Sometimes, good things happen for good reasons.
asdfmovie4
Anthropic was founded by former OpenAI employees who left largely due to ethical and safety concerns about how OpenAI was being run. This is just them sticking to their principles.
This is just them sticking to their principles.
Can’t say the evidence really backs you up on that one.
Anthropic, the AI company with a safety-first reputation, is changing a core guardrail | CBC News
Anthropic, the AI company behind the Claude chatbot that was founded with a focus on safe technology, appears to be scaling back its safety commitments in order to keep the company competitive, after it amended a set of self-imposed guidelines aimed at preventing the development of AI that could potentially be dangerous.
I still think they deserve some credit for at least trying to do the right thing. I don’t envy the position they’re in.
Everyone’s rushing toward AGI. Trying to do it safely is meaningless if your competition - the ones who don’t care about safety - gets there first. You can slow things down if you’re in the lead, but if you’re second best, it’s just posturing. There is no second place in this race.
“Right thing": compromising with authoritarian regimes to secure AI funding
No AI bro company is on the path to AGI. Transformer technology will not lead to AGI.
I never claimed it will.
Anthropic’s “ethical” concerns were performative. They only fearmonger about fictional things that will make their product sound powerful (read: worth throwing money into).
They try to scare people with fictional stories of AGI, a thing that isn’t happening, while ignoring widespread CSAM and sexual harassment generation, a thing that is happening.
Are we not moving toward AGI? Because from where I stand, I only see three scenarios: either AI research is going backwards, no progress is being made whatsoever, or we’re continuing to improve our systems incrementally - inevitably moving toward AGI. Unless, ofcourse, you think we’ll never going to reach it which I view as a quite insane claim in itself.
If we’re not moving toward it, then I’d love to hear your explanation for why we’re moving backwards or not making any progress at all.
Whether we’re 5 or 500 years away from AGI is completely irrelevant to the people who worry about it. It’s not the speed of the progress - it’s the trajectory of it.
We are not “moving towards AGI” in any way with any modern technology, in the same way that we are not “moving towards FTL travel” because a car company added cylinders to an engine.
The real “AI” dangers are people like Eli Yudkowski, a man who scares vulnerable people, sexually abuses them, and has spawned at least one murderous cult.
We are not “moving towards AGI” in any way with any modern technology
So that means you believe AI research is completely frozen still or moving backwards. Please explain.
Comparisons to faster-than-light travel are completely disingenuous and bad faith - that would break the laws of physics and you know it.
According to Dario Amodei, this is the year we are getting New Science. And apparently he believes in Dyson Spheres too. How do we feel about that?
Anthropic is not special. They’re doing the LLM thing like everybody else. The Godfather of AI, Yann LeCun himself, said LLMs were a dead end on this front. But even if he didn’t chime in, it’s your job to show they’ll lead to AGI, it’s your job to show us how, not my job to show you it won’t.
If you’re just gonna keep ignoring every single point I make and keep rambling about unrelated shit, then there’s nothing left to discuss here. If you actually had an argument, you would’ve made it by now.
Your claim: AI seems to be getting better, therefore AGI will happen
My rebuttal: they aren’t linked
Does that clear matters up?
My argument is that we’ll incrementally keep improving our technology like we have done throughout human history. Assuming that general intelligence is not substrate dependent - meaning that what our brains are doing cannot be replicated in silicon - or that we destroy ourselves before we get there, then it’s just a matter of time before we create a system that’s as intelligent as we are: AGI.
I already said that the timescale doesn’t matter here. It could take a hundred years or two thousand - doesn’t matter. We’re still moving toward it. It does not matter how slow you move. As long as you keep moving, you’ll eventually reach your destination.
So, how I see it is that if we never end up creating AGI ever, it’s either because we destroyed ourselves before we got there or there’s something borderline supernatural about the human brain that makes it impossible to copy in silicon.
So do you think Dyson Spheres are inevitable too? Because things advance?
You’re also shifting your goalposts tremendously. First you were implying that today’s AI would bring about AGI and now you’re saying that something, somewhere, might happen in some sci-fi future.
I’m not sure if you’re actually worried about present day destruction, though, because you seemed to not like it when I brought up with the AGI true believers are doing to the vulnerable people that flock to them. Dario is on board with Trump’s fossil fuel, anti-green buildout too.
If you believe so much in AI, but allegedly believe in the things you’ve talked about, perhaps it’s time to start criticizing the people you hold so dear.
So do you think Dyson Spheres are inevitable too?
I’m less certain about that than I am about AGI - there may be other ways to produce that same amount of energy with less effort - but generally speaking, yeah, it seems highly probable to me.
First you were implying that today’s AI would bring about AGI
I’ve never made such a claim. I’ve been saying the exact same thing since around 2016 or so - long before LLMs were even a thing. It’s in no way obvious to me that LLMs are the path to AGI. They could be, but they don’t have to be. Either way, it doesn’t change my core argument.
people you hold so dear
C’moon now.
I’ve been saying the exact same thing since around 2016 or so - long before LLMs were even a thing
You really aren’t beating the Yudkowsky/LessWrong allegations with this one, you know.
If you really think LLMs might mean nothing at all when it comes to actually achieving AGI, then maybe you should speak out against the environmental destruction they’re doing today with full endorsement from Anthropic and all the other corporate AI perverts.
That doesn’t have anything to do with my claim about the inevitability of AGI.
wizardbeardWhile I’m glad they’re drawing a line, they’re only splitting hairs. Anthropic is already deeply working with the US gov.
What a company says and what a company actually does are not the same thing.
I guess it’s good that they draw the line somewhere, but it is absolutely horrifying to me as a non-American that the moral stance is limited to:
- taking issue with fully autonomous AI weapons (purely for technical reasons according to this letter, they are working hard on making them possible)
- refusing to conduct mass surveillance of US citizens specifically (foreign nationals are fair game and the intelligence apparatus will surely only be used for good and to preserve democracy).
This is not Anthropic refusing to cooperate with the Trump administration as the title may suggest, they are in fact explicitly eager to serve the US Department of War. They are just vying for slightly better contract terms.
You’re spot-on. As some additional context, Anthropic is already working tightly with the US government. Until the recent announcement regarding Grok, Anthropic was the only approved AI for US government work, as it is/was the only one certified for safely woeking with classified data.
vying for slightly better contract terms
Do you mean that all this about principles is a smoke screen and Anthropic are just using it as a front to squeeze for more money?
No, if you want my opinion it seems too risky of a move to make all of this so public if all they want is more money. It’s possible, but I’d be surprised.
I believe them when they say that what they want is to have those two particular things, fully autonomous weapons and mass surveillance of US citizens, removed from the contract terms (for now). This could be out of genuine moral principles, or out of fear of bad PR when this would be found out. Most likely a combination of both.
My point was that from my perspective it is a very minor difference. The conclusion I kept after reading this isn’t “good guy Anthropic bravely stands against pressure from Hegseth” as some of the Hackernews comments try to paint it. It is “Anthropic mostly bends over backwards and grovels for Pentagon money, willing to massively spy on all foreign nationals and working on creating autonomous weapons - other US AI companies likely to be even worse”.
As I said, horrifying.
Crossing off mass surveillance and automated killing isn’t everything they could have taken a moral stand on. Personally I don’t think any list will be long enough for the Pentagon, and if it were, there wouldn’t be anything left that could be worked on.
But I keep hearing you say that no mass surveillance and no automated killings is so very little - almost nothing. That doesn’t seem right to me. I think those are both pretty big things. I’m not horrified that their moral stance would include only that.
That’s a fair stance to take and I definitely do not mean to try to have you change your opinion. I also do not know if you are an American, and I don’t want to assume either way.
But, to better explain my own position, I need to point out:
Anthropic is not saying “no mass surveillance”, they are saying “no mass surveillance of Americans”. If you judge this stance based on effect, it literally makes no difference at all if you are not a US citizen, you are targeted either way. If you judge it based on principles, it can be argued it is even less moral than accepting mass surveillance of everyone - not only are they claiming that billions of innocent people deserve to lose their right to privacy, but they are specifically carving out an exception for themselves based on nationality.
They are also not saying “no automated killings”, but “no automated killings at this time because we haven’t ironed out the kinks yet”. This can be framed as a moral stance relating to safety concerns, so I will assume in good faith that this is their reasoning rather than fear of bad publicity. However, I would argue that it is still an insignificant difference, as the threat posed to humanity by a powerful warmongering state commanding an army of fully autonomous killing machines is already too great. Making sure the technology is ready could mean working on avoiding a Terminator scenario, but without a doubt it will also mean ensuring that the murderbots WILL obey an order to bomb striking workers or displaced refugees so long as the right Executive Order was signed first, something that a human being in the loop might have prevented.
These two red lines seem to make a world of moral difference for someone who already takes it for granted that the USA and its military are overall institutions deserving of trust and support, perhaps with the small exception of the current Secretary of War who may have jumped the gun a bit during negotiations over a new technology. At the very least, that seems to be the position of the author of this letter. But no state should ever be given that amount of trust and support. And particularly given the USA’s belligerence over the years and its current slide towards outright fascism, I am horrified that the bar is this low.
Better to be skeptical about everyone here, and there are certainly no heroes.
However it should be obvious that a country’s department of war surveilling its own citizens is a completely inappropriate overreach. They exist to protect the country from outside threats. You’re casting it as some kind of discrimination, and claiming it would be more moral to treat everyone the same, but that seems willfully obtuse to me. Calling it a “special carve out” for a country to protect its own citizens… come on. Obviously since you are not an American it does nothing for you but you are working way too hard to spin that up into a sin.
Obviously a country spying on its citizens is unacceptable overreach, I never claimed otherwise. And if my own government was conducting mass surveillance on me I would be particularly furious at the betrayal. But I would also not support it conducting surveillance on foreigners either. That is the “sin” Anthropic is guilty of, in my eyes.
Mass surveillance is simply immoral. It is targeting innocent people who have not even been accused of any crime and robbing them of their right to privacy. It is also giving states absolute leverage to harm, blackmail or manipulate anyone they want at will.
The argument that it is all done in the name of protecting its own citizens also falls flat in this case, as that is exactly the same excuse used for mass domestic surveillance - everyone loses their privacy, but the good, law-abiding citizens are protected from the criminal elements who would threaten them. “If you have nothing to hide, you have nothing to fear”.
Let’s not kid ourselves, this is not about protecting anyone. They plan to spy not only on their “enemies” but also on their closest allies, as they have in the past. This is about gaining power. And states in general already have far too much power over individuals.
Kowtowing to the Department of War and offering to sell them an AI for mass surveillance is not OK, even if it truly were to limit itself to the common, genteel use case of spying on foreign people.
I’m hardly going to defend the Pentagon, but to say a country should not even have an intelligence operation whatsoever, that this isn’t elementary to protecting its citizenry, is beyond naive and unrealistic.
Well yeah, that’s true, but I didn’t say that, did I? Not even remotely.
We are specifically talking about mass surveillance. I will let you reflect on the implications of an intelligence apparatus with the ability to have a Claude-level AI scanning every piece of information on the internet by yourself.
if my own government was conducting mass surveillance on me I would be particularly furious at the betrayal. But I would also not support it conducting surveillance on foreigners either.
I’m not trying to pin you here, just explain why it did indeed sound an awful lot like you were saying that. Conducting no surveillance is pretty much not having any intelligence operations. Are they supposed to wait by the phone for tips? This is where I was coming from. You didn’t use the word “mass” then. If you tell me you meant something different, I believe you, but this is how I got you wrong.
That’s fair, that should have been MASS surveillance, I skipped a word.
Amodei “we cannot in good conscience allow this”.
Hegseth looks confused, turns towards his team and mouths “…in good what?”"
“Anthropic publicly praised President Trump’s AI Action Plan,” said CEO Dario Amodei.
“We have been supportive of the President’s efforts to expand energy provision in the US in order to win the AI race,” he continued, apparently talking about Trump’s new anti green energy, pro fossil fuel program.
yes… mine was just a play on the title of this post.
Look, I’m not saying that Amodei is a saint and I do find him full of shit as Altman with their AGI promises, but would you expect Anthropic to take a stand against increasing AI investment, because it’s coming from Trump? And I don’t like that he went looking for funding in the Middle East either.
I just think there is an ethical line between “I do business with people who do bad things” and “I’m actively helping people who do bad things to do them in a more efficient way”. It might be a fine line and it might also be that they are just posturing, but it’s still more than other companies did (companies that are a lot richer than Anthropic and that don’t need to find a lot of funding just to stay afloat).
My reply was a continuation of your joke, just using Dario’s actual words. My point is that he too lacks a conscience (see also, the other links I’ve posted)
Gotcha! Shit, I barely understand my own jokes… 😅
katy ✨Anthropic is now playing Good Cop in a charade. They don’t care about ethics.
Anthropic’s CEO admits compromising with authoritarian regimes to secure AI funding
Anthropic CEO Dario Amodei backs President Trump on AI policy, pushes back on criticism
_wizard
KissakiOr they are just doing this for optics, with an understanding that the feds will end up forcing their hand in the future.
It’s probably more they don’t wanna get blamed if AI launches missiles because the idiots in charge pressed shift+tab and yolo’d.
Claude: “You’re right. I completely committed a war crime. I’m so very sorry! How would you like to proceed?”
I can’t see the name “anthropic” without thinking about furries.
Anthro pic.
Now you can’t either. You’re welcome.
One is fun and happy the other is saddening and seemingly inescapable.