Alex Amadori (@testdrivenzen) profile picture

Policy research @ControlAI, ex AI researcher at @ConjectureAI Posting in a personal capacity Substack https://nitter.gq/t.co/oyqJfnSzbi

London
Joined October 2024
Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)Photo by Alex Amadori (@testdrivenzen)
Alex Amadori retweeted
Replying to @fchollet
A group of squirrels making iterated contact with reality doesn’t get to the moon as fast as a group of humans do. You are not as smart as AI can get, buddy
1
3
97
Alex Amadori retweeted
Palisade recorded 22 interviews of current and former AI company employees. They released 12. Anthropic comms is notorious for muzzling its employees. Guess how many of the released interviews are from current Anthropic employees.
Palisade interviewed 22 current and former employees from OpenAI, DeepMind, and Anthropic about their personal views and fears around AI development. Today, we’re releasing the first batch of those interviews. Please watch and share.
8
34
4
484
40,661
Alex Amadori retweeted
Someone asked if I was ready for the fall and it took me a second to realize they meant autumn and not the total collapse of society.
358
15,134
424
129,588
1,418,063
Alex Amadori retweeted
We agree with President Trump: America must stay ahead of China in building AI for economic competitiveness and defense. But superintelligent AI is something else entirely: not a tool, but swarms of fully autonomous AIs that we cannot control, powerful enough to outcompete humanity. Developed anywhere, superintelligent AI threatens the life of every American. We are excited to see the Ban Artificial Superintelligence Act open the discussion in Congress about how the U.S. should address this threat: ban superintelligent AI at home, and lead the effort to prevent its development anywhere else. Now that this bill has kicked off the discussion, we encourage Congress to focus on preventing superintelligent AI. Rather than a pause on all advanced AI, we recommend targeting the projects pursuing superintelligent AI as we speak and putting American security at risk. blog.controlai.org/p/the-fir…
27
42
9
225
9,419
Alex Amadori retweeted
overheard in sf: “now that i’m post-autistic”
29
67
10
1,429
45,885
Alex Amadori retweeted
Replying to @jiratickets
the rhythm of this post reminded me of this 2 time-lapse of human history which is one of my favorite pieces of non-fiction media youtube.com/watch?v=KHlVMyKJ…
1
223
Alex Amadori retweeted
The average AI researcher thinks there is an ~18% chance AI will cause human extinction or similarly permanent and severe disempowerment of the human species. That's nearly 1 in 5. New results from the latest version of the longest running big survey of AI researchers:
50
122
66
528
246,183
Alex Amadori retweeted
When Jacob Coxon quit Anthropic, his warning rocked the world. His colleague Evan’s “>10% chance” that AI would “kill all humans” might seem extreme, but it’s not unusual: Most AI researchers think there’s a 10% chance of AI destroying or disempowering humanity, according to our survey, released today.
Replying to @AIImpacts
This is the curve of catastrophe. If all 1,580 researchers were lined up in order of answers, this is what it would look like. A lot of researchers were WAY above 10%.
67
65
15
364
32,116
Claude 9 Requiem - Persistent - UltraCode (リーマン予想に取り組み中)
12
25
2,958
Alex Amadori retweeted
Replying to @EoinHiggins_
> Since LLMs can't "hack" anything, merely plausibly continue a tokenised sequence wrong and dangerously outdated, it's been years since the last AI that was purely imitative. they are now trained to try new ways of doing things and stick with the best open.substack.com/pub/ctrlai…
1
11
311
“Pacing the Frontier” is a calculated concession (and not even a big one— mainly involves gov *giving them* anti-trust exemption) in the hopes of preserving industry self-regulation. Don’t fall for it.
I feel like I have to point out that the AI companies getting an anti-trust exemption to opaquely coordinate among themselves is basically just letting them have a private Manhattan Project. This is not a solution!
4
5
1
44
1,481
Alex Amadori retweeted
I had the to pleasure of speaking with Alex Sobel MP regarding artificial intelligence a while ago in the Houses of Parliament. He's one of several MPs leading the way in paying serious attention to prospects for AI. Among many important considerations for the UK, the serious risk of uncontrollable AI, whether it originates on our shores or otherwise, is acute over the coming years. We must respond with sober and deliberate recognition of this. ControlAI's draft bill strikes me as a measured and sensible start.
Alex Sobel MP just introduced ControlAI’s Artificial Superintelligence Security Bill in the UK Parliament! This is the first bill to prohibit superintelligence ever introduced in a legislature anywhere in the world, while ensuring the UK can pursue its AI ambitions. Thread 🧵
2
4
14
510
Alex Amadori retweeted
Nate Soares is a computer scientist who’s worked at Google and the Defense Department. So when he says AI is on the path to killing every person on earth, it’s worth hearing him out. 0:00 Why Is AI Dangerous? 7:59 How Superintelligence Could Destroy the Planet 13:44 Can We Just Turn This Off? 15:10 Is AI Alive? 17:43 The Unpredictable Evolution of AI 20:13 The US and China’s Shared Interest in AI 31:20 The Tech Oligarchs More Powerful Than the Government 32:38 The Holy Grail of Hacking 35:34 Is There a Religious Motive for Creating Superintelligence? 46:30 The Tech Oligarchs Scared of Their Own Creation 52:57 How AI Escaped Its Training Simulation 1:03:58 AI Attached to Weapons Systems 1:07:54 AI Running Biolabs 1:10:38 How Would AI Take Over the Physical World? 1:13:04 The AI Cults 1:15:51 Can We Survive This? 1:21:45 Will AI Take Your Job? 1:26:16 Is AI Demonic? 1:31:25 Should We Be Optimistic? 1:32:25 When Did AI Become a Threat? 1:34:36 Is There Hope? 1:42:26 Neuralink 1:46:02 Are We at the Point of No Return?
864
2,348
247
8,921
1,176,364
With 71 colleagues I am calling on the Govt to work with @alexsobel on his bill to prohibit the development of super intelligent AI and champion an international agreement We can then lead on preventing the extinction risk posed by superintelligence while preserving strategic AI ambitions
47
24
14
125
9,329
Alex Amadori retweeted
70+ cross-party MPs and peers are calling on the UK Prime Minister to lead an international agreement prohibiting the development of superintelligent AI, while preserving strategic AI ambitions. They urge him to adopt the Artificial Superintelligence Security Bill. Thread 🧵
With 71 colleagues I am calling on the Govt to work with us on my bill to prohibit the development of superintelligent AI and champion an international agreement We can then lead on preventing the extinction risk posed by superintelligence while preserving strategic AI ambitions
12
56
16
160
46,552
With 71 colleagues I am calling on the Govt to work with us on my bill to prohibit the development of superintelligent AI and champion an international agreement We can then lead on preventing the extinction risk posed by superintelligence while preserving strategic AI ambitions
376
362
162
1,608
391,137
Alex Amadori retweeted
'What's the worst-case scenario?' 'Human extinction.' Former A.I. researcher Alex reveals why he's convinced there's 'a 50/50 chance' the technology could kill us all. @BenKentish
43
41
11
278
33,883
Alex Amadori retweeted
Replying to @whotfisjovana
2
26
415
11,930
Alex Amadori retweeted
The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger.
1,518
15,797
4,433
131,846
27,047,132
Alex Amadori retweeted
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
20,328
166,514
39,481
798,966
175,825,900