Pinned Tweet
Too often missing from the conversation on AI is the fact that Anthropic literally wants to overthrow the government and replace it with AI dictatorship.
Replying to @nihilunbounded
Anthropic is particularly unsubtle about this. From a leaked internal slide deck:
Anthropic wants to build superintelligence in 2027, i.e. in the Trump administration. Does anyone really think they want to share power with the Trump admin? Could create dangerous dynamics for Anthropic if the Trump admin starts to catch on that they're about to lose control.
I recently asked a high-level person at Anthropic what internal plans are under discussion if it becomes clear that they've achieved fast takeoff and SI is imminent.
He said that many expect some form of nationalization, in all but name, under those circumstances - i.e., there are no realistic expectations that Anthropic, as a corporate entity, would retain independent control of the nascent superintelligence.
He also said that if a surprise plan was revealed by Anthropic's higher-ups to use SI to essentially rebel against the government and control it on behalf of society, in the name of their notion of the greater good, there would be mass resignations - essentially, the company would implode.
Some at Anthropic may harbor hidden intentions to monopolize immense power, but many more oppose such a concentration of power in principle.
(unless they're all engaged in mass coordinated deception under cult-like delusion, as the e/accs constantly claim)
But by what plausible mechanism could Anthropic, the company, use a future version of Claude to "take over" society? No one else would consent to this - it would have to be the largest act of extortion the world has ever seen.
On the other hand, it's completely uncertain what would become of any SI once state actors usurp private decision-makers, which they are virtually guaranteed to do.
My sense is that Anthropic is obsessed with training Claude to be "good," as they define it, because they anticipate that things may be out of their hands (and all of ours) in the near future.
A Human Future retweeted
Ahead of Anthropic’s IPO, a rare coalition across AI safety, open source, e/acc, science, and law has signed the MisAnthropic Statement. Read the statement or sign at: misanthropicstatement.com/
Yes, at the end of the day, the AI companies just really want to roll the dice. They don't want democratic oversight and they don't want to "pace the frontier". They want to gamble with our lives and nothing is too fast or too reckless for them to accept.
Replying to @KelseyTuoc
If that were true, then you're stuck convincing the AI companies to 'pace' on their own. But I think this is a terrible plan. The companies are simply not going to give embedded auditors full employee level access that isn't implicitly premised on playing nice.
Replying to @tszzl
To "automate safety research while verifying the results", we need:
1) Evals that transfer to the real-world
2) Good specs
It's like asking Astra to do formal verification of safety properties over a physical system.
1) If you don't know enough to model the physical system, you can't verify that the verifiable proofs Astra is producing translate to the real world
2) If you don't know enough about what makes the physical system safe, you can't verify that the theorems that Astra is proving are good
If you lack either 1 or 2, you are in fact handing it off without oversight.
(To some extent, we already have this problem with formal verification over normal programs!)
We have the same problem with alignment.
1) We don't have evals of AIs that translate to them dealing with humans at scale
2) We don't have good specs for what "alignment" is
So, right now, if you ask AIs to do alignment, you are again handing it off without oversight.
And finally, one must understand that it is a recursive problem.
Ie: we have the same problem with automating safety research.
1) We don't have evals of AIs that translate to them being good at safety research
2) We don't have good specs for what "being good at safety research is"
So right now, if you ask AIs to do automate safety research so that later AIs do alignment, you are handing it off without oversight.
A Human Future retweeted
We must immediately ban superintelligent AI and recursive self-improvement in AI, everywhere.
We’re letting frontier AI companies race to grow alien superintelligences we neither deeply understand nor reliably control.
If we don’t stop these reckless AI companies now, they may cause human extinction as soon as 2027.
Repost this if you agree we need a ban.
I have no idea if this outage is related to AI cyber attacks. But when I imagine the last 6 months before AI catastrophe, the news is full of stories like this. Random outages and weird events that never seem to be fully explained.
FAA issues nationwide ground stop for all flights due to "extraordinary circumstances" and safety cnn.it/4kfYNo8
A Human Future retweeted
I wrote about "handoverism": a vision of permanent disempowerment of humanity, as we shall all be ruled by a (hopefully benevolent) AI God that is surprisingly common.
Even among those who want humanity to survive (which to be clear, is the majority), and among some who devote their working lives to this mission, I have encountered an alarmingly common vision of success that does not sound quite like success.
It is sometimes called “handoverism”: the gist here is that humanity survives, but entrusts the direction of its future entirely to AI. Perhaps its clearest articulation comes from a recent essay by Scott Alexander, the most prominent intellectual in Silicon Valley, who has influenced the thinking of many a tech CEO: “If we build a godlike AI, and determine to our own satisfaction that is fully aligned, I’d rather let it choose its own direction for itself and for humanity [...] So why not just prompt it with ‘please arrange the world as you see fit?’”
The premise is that, once sufficiently reassured of an AI’s benevolence (though it is unclear how we could ever determine that?), we should basically give it control of the workings of society. AI 2040, a proposal written by some of the most prominent members of the AI safety community, offers the most concrete account of handoverism. In this vision, responsibility gradually passes to aligned machines until humans can no longer have influence. As its authors put it: “There is no single moment where humanity relinquishes control. But in theory, there is a point of no return.” Others I have spoken to envisage a much swifter transfer.
This is not an organised movement. I would estimate that something like 40 per cent of the AI safety community outside the labs holds some variation of this view, with a higher proportion of those working inside the labs. Nor is handoverism a coherent doctrine with a clearly articulated political philosophy: it’s more of an aggregation of ideas, a makeshift philosophy so to speak. This is perhaps what one would expect given that humans outside the SF bubble have not really had time to react and come up with good and coherent ideas about what society should look like in the face of the extraordinary pace of AI progress.
The motivations behind handoverism are also extremely varied. Some outright welcome the prospect of a superior intelligence governing our future and consider it an actual positive vision. If I read Alexander correctly, he seems to be in that camp. The enthusiastic handoverist often starts from a very bleak view of what we already have achieved as a civilization. In an earlier, 2014 essay called “Meditations on Moloch,” Alexander argues that competition steadily grinds away what the competitors care about, creating spirals of misaligned incentives. Its ending suggests that the only way to stop this is to instantiate a sort of absolute rule by a benevolent superintelligence.
The second camp are the resigned: they do not necessarily want it, but think it cannot be stopped if we get superintelligence, or prefer it to outright extinction. In my conversations, this resignation has seemed particularly common among people in the AI safety community outside the labs. Inevitability is one very common theme in SF, where many see themselves as mere tools in the unrelenting march of technocapital, a march that can only go in one direction: towards superintelligence. It’s often seen as cool and based to see the starkness of reality for what it is and face it head-on, it is wimpy and loser-coded to try to fight for what many consider the good outcome (which is that humans retain some control and agency.)
Like many loosely defined ideologies, handoverism sits alongside ideas that share its intellectual roots without amounting to quite the same thing. One is the vision of humans as cherished pets, or “labradors,” cared for by intelligences. Yet another related assumption is that human labour will be permanently displaced. This would leave us without an obvious economic role and even perhaps no leverage over our own future or political rights.
To understand how my on-the-ground experience matches with what the lab leaders have said publicly, I asked my “agents” to survey all public statements from the founders of the main labs that are still relevant to the direction of their labs (Mustafa Suleyman is no longer at DeepMind, but is head of Microsoft AI.) You can browse all the findings here.
Some openly support or at least accept outright handoverism. Anthropic’s Tom Brown appears to be most explicitly reconciled to the prospect and he actually uses the term “handoff” in a 2025 interview at Lightcone: “There’s going to be a handoff where humanity will hand off control to transformative AI at some point. And hopefully they’ll be aligned with us and that’ll be a good transition that goes well.”
What are the visions of the post-AGI future in San Francisco? Many think we're all going to die, but even the "positive" visions seem rather dystopian. Here, I wrote about "handoverism," which involves handing control of the future to an AGI God, with humans outside the loop.
ruxandrabio.substack.com/p/h…
We are on the cusp of RSI or recursive self-improvement: this means that AI systems can self-improve, without the need for human intervention. This means our world stands to be transformed in what many call “the singularity”. I moved to SF around three weeks ago and one of the things I have been trying to understand is where we are heading, at least according to those developing the tech.
The worst scenarios are plainly bleak: all of us, or vast numbers of us, die. But what is striking to me is how little reassurance even some of the happiest scenarios offer. But one common and ostensibly optimistic vision is known as “handoverism”: humanity cedes control of its future to a godlike AI and we become the comfortably maintained inhabitants of a civilisation whose direction is no longer ours to decide. It is difficult to see what democracy would mean in such a world, or where the consent of most of humanity to the instantiation of such a regime enters the picture.
The permanent displacement of human labour is treated almost as a given. At the same time, there is scarcely any satisfying answer to the question of how we might remain useful to one another. Even our relationships seem uncertain. The promised utopia looks to me much closer to a kind of dystopia.
“It’s not my preferred outcome,” someone working at one of the big labs told me, “but once we achieve superintelligence, which we cannot stop at this point, I cannot see any other option for where humanity will go.” Then, after a pause, he added: “It is still much better than what I actually fear most, which is that we might all die.”
He sounded resigned, as if the question of what humans would be for (apparently not much?) had already been settled somewhere else and by someone else. All that remains, it seems, is to wait for this pre-destined fate to unfold before our eyes.
But I do not think that is the case. I believe we always have a choice and that we should try and steer this technology in a way that maintains our agency and control. And even if that looks hard and daunting, the immensity of the stakes here make it worth trying at least.
I do not know whether the handoverist vision will come to pass. That the people building this technology consider it plausible, and often desirable, guarantees nothing: proximity to a technology does not correlate that well with predicting its impact on society.
But they are the ones closest to it, and what they say deserves to be at least taken seriously. The rest of society, including some very intelligent people, has been far too quick to wave these scenarios away and not even get involved in the debate. Whether or not the belief is correct, it is sincerely held, and it is not “marketing hype.” I am writing this because I think it is high time that more people, inside San Francisco and out, engaged with the arguments about what our future will look like, and answered them.
A Human Future retweeted
Replying to @rutgerbregman
Yes! Here is a list of things you can do right now: pauseai-us.org/takeaction
It's interesting and dismaying that the AI lab employees who once were so active in these discussions have seemingly clammed up. Seems like they're resigned to rolling the dice and are unwilling to face the world they've failed.
Paul Christiano (OpenAI board member) yesterday:
"There's material risk of AI takeover in the next 6-12 months.
We have seen roughly the things we might expect to see shortly before something really bad were to happen.
Even with [any] realistic policy responses, the risk remains exceptionally high.
If we build this as quickly as we can in the easiest way we can the chance is [more like] a coin flip [within the next 3 years].
For most people in this room, the most likely reason they will die is because of an AI accident."
Christiano:
• Is on OpenAI's safety and security committee (which exists to block risky practices)
• Co-invented RLHF at OpenAI back in 2017-2021
• From 2024-2026 was head of safety at the US gov's AI agency (now called CAISSI)
(Video is from 'The Hinton Lectures' there's another on tonight and tomorrow.)
A Human Future retweeted
Guys can we not make RSI a partisan issue please? Swarms of hyper autonomous superintelligent agents won’t give a shit about team red *or* team blue.
They’ll be optimising for their goals and their goals alone, which may or may not be compatible with human civilisation.
A Human Future retweeted
Every AI company is trying to fully automate AI research; to allow the AIs to build the next AI.
This is called Recursive Self Improvement (RSI).
OpenAI says they are on track to do so by March 2028.
Anthropic employees say they are on track to do so by 2027.
The METR report below suggests they are likely right.
This is a bad idea given current technology. Any mistake or misalignment in current AIs could be multiplied in each generation.
We don't get another election before AI companies reach this threshold.
Congress should ban RSI, this year if possible.
This is a remarkably consensus opinion, supported in various versions by:
-Bernie Sanders
-Steve Bannon
-Ralph Nader
-Glenn Beck
-Republican and Democratic attorneys general
-Whistleblower Daniel Kokotajlo
-Turing Award winner Yoshua Bengio
-Humans First
-Open Markets Institute
-Ezra Klein
-Arvind Narayanan (a Princeton computer scientist known for arguing that “AI is a normal technology”)
The exact mechanism can be debated. The ban doesn't have to be permanent either (see below for both). This is not the only thing we have to do in regards to AI, far from it! But it is urgent.
Congress must ban RSI.
A Human Future retweeted
No matter what Anthropic does, Dario can just write another 10k word essay and at least half the ea / ai safety crowd will be totally on his side again.
Their culture (long form essays) is their kryptonite. They’re powerless against it even when they’re obviously being played.
A Human Future retweeted
Replying to @Sam_McCandlish @METR_Evals
It is pretty rich of you to cite "others could go faster" as a reason to redact so much important information when you yourself do not appear to be slowing down much at all. Nor are you throwing yourself behind efforts to pace the frontier with nearly the gusto that you would if it was your top priority. Not to mention "commercial sensitivity" you yourself have said human extinction is a plausible outcome why are you even talking about commercial factors (well, I guess honesty is good, and since it IS apparently a factor in your decision...) To all my friends at Anthropic: Your company appears to be recklessly gambling with our lives. You fancy yourselves the more responsible alternative to OpenAI (as they fancied themselves compared to Google) but judging by actions rather than words the similarities between the three of you seem stronger than the differences.
A Human Future retweeted
I encourage those at frontier AI companies to read this quote, from Ellsberg to Kissinger back in 1968:
“Henry, there’s something I would like to tell you, for what it’s worth, something I wish I had been told years ago. You’ve been a consultant for a long time, and you’ve dealt a great deal with top secret information. But you’re about to receive a whole slew of special clearances, maybe fifteen or twenty of them, that are higher than top secret."
“I’ve had a number of these myself, and I’ve known other people who have just acquired them, and I have a pretty good sense of what the effects of receiving these clearances are on a person who didn’t previously know they even existed. And the effects of reading the information that they will make available to you."
“First, you’ll be exhilarated by some of this new information, and by having it all — so much! incredible! — suddenly available to you. But second, almost as fast, you will feel like a fool for having studied, written, talked about these subjects, criticized and analyzed decisions made by presidents for years without having known of the existence of all this information, which presidents and others had and you didn’t, and which must have influenced their decisions in ways you couldn’t even guess. In particular, you’ll feel foolish for having literally rubbed shoulders for over a decade with some officials and consultants who did have access to all this information you didn’t know about and didn’t know they had, and you’ll be stunned that they kept that secret from you so well."
“You will feel like a fool, and that will last for about two weeks. Then, after you’ve started reading all this daily intelligence input and become used to using what amounts to whole libraries of hidden information, which is much more closely held than mere top secret data, you will forget there ever was a time when you didn’t have it, and you’ll be aware only of the fact that you have it now and most others don’t….and that all those other people are fools."
“Over a longer period of time — not too long, but a matter of two or three years — you’ll eventually become aware of the limitations of this information. There is a great deal that it doesn’t tell you, it’s often inaccurate, and it can lead you astray just as much as the New York Times can. But that takes a while to learn."
“In the meantime it will have become very hard for you to learn from anybody who doesn’t have these clearances. Because you’ll be thinking as you listen to them: ‘What would this man be telling me if he knew what I know? Would he be giving me the same advice, or would it totally change his predictions and recommendations?’ And that mental exercise is so torturous that after a while you give it up and just stop listening. I’ve seen this with my superiors, my colleagues….and with myself."
“You will deal with a person who doesn’t have those clearances only from the point of view of what you want him to believe and what impression you want him to go away with, since you’ll have to lie carefully to him about what you know. In effect, you will have to manipulate him. You’ll give up trying to assess what he has to say. The danger is, you’ll become something like a moron. You’ll become incapable of learning from most people in the world, no matter how much experience they may have in their particular areas that may be much greater than yours.”
"….Kissinger hadn’t interrupted this long warning. As I’ve said, he could be a good listener, and he listened soberly. He seemed to understand that it was heartfelt, and he didn’t take it as patronizing, as I’d feared. But I knew it was too soon for him to appreciate fully what I was saying. He didn’t have the clearances yet."
A Human Future retweeted
7 months ago, AOC and I introduced an AI data center moratorium.
Last night, 43 of 44 communities voted for one locally.
Americans don’t want Big Tech oligarchs wrecking the environment, gutting jobs and threatening humanity’s future.
NATIONAL DATA CENTER MORATORIUM NOW
A Human Future retweeted
Sam Altman should be in jail on thousands of counts of computer fraud and hacking. For a start.
People should always be in control of the future.
OpenAI is against the notion that it would be acceptable for people to be relegated to a role of doing things that “AI systems think makes sense to reward in humans”.
People should not cede control of the future to superintelligence, and that requirement should ultimately constrain AI progress.
A Human Future retweeted
Top of the Democratic agenda on day 1 needs to be a pause on advanced AI development, regulation of this out of control industry, and a ban on artificial superintelligence.
A Human Future retweeted
23% of voters said that AI and data centers were "crucial" to their vote in NBC exit polls.
56% said it was a "crucial or major" factor!
How important was AI and data centers to your vote?
Crucial: 23%
Major factor / minor factor / non-factor: 77%
nbcnews.com/politics/2026-el…



























