Cryptography, personal trivia, and the future of all humanity. I block for rudeness or sarcasm.

Scotts Valley, CA
Joined November 2008
Paul Crowley retweeted
I'm starting to feel like this 100,000-person march could actually happen. It's been cool to see the pledges steadily increasing recently, despite how little we've done to promote the page so far
Over 1000 people have now pledged to attend the Don't Build It march—a march that will only happen when and if it reaches 100,000 pledges. Add your name to the list: ifanyonebuildsit.com/march
17
18
1
211
22,237
Replying to @growing_daniel
Jesus taught us to count years up instead of down, which was a huge deal, because right before he was born we were down to our last year.
7
12
514
10,467
This is a specific sore point from lived experience. I had Samsung devices that would or could not capture a true likeness of a child's skin rash during a severe allergic reaction. It effectively airbrushed for beauty, ruining the opportunity to collect evidence for the MD.
5
15
1
200
8,619
This is why I think debates are the worst format for comparing and contrasting viewpoints, it benefits the dishonest in a way that can't possibly be evened out.
A frustrating aspect of this show is that the host doesn’t say in any detail what he’s going to ask you about and then gets to confront you with a big stack of research that it’s not possible to pause and do fact-checking on and then it turns out some of it’s not true.
17
31
509
9,734
Paul Crowley retweeted
this week
9
431
7
5,697
57,158
Important, and I'm glad this is finally public. Google DeepMind researchers are under in perpetuity non-disparagement clauses forbidding them from ever speaking critically of the company. I'd already confirmed this with multiple people. Yes, some ex-employees have spoken out nonetheless. But it has also discouraged others from doing so. And yes, it most certainly has a chilling effect with regards to discussions on safety and risk. Others have written compellingly about how important the ability to speak freely and critically is, especially on topics like safety and risk. And what a testament to the research employee community's coordination and hard-won bargaining power it has been to get there at other companies. GDM burn that commons by having this. And everyone who signs burns that commons too. Let's get it changed.
Congrats to Sofia for having the courage to resign and speak out! This is also very important: Staff are scared to speak out about AI safety and its uses in warfare because their employment contracts prohibit them from publicly criticising the company. bbc.co.uk/news/articles/cmre…
19
82
16
605
100,003
Paul Crowley retweeted
The problem with using obscure philosophical vocabulary to sound smart is that every once in a while you use a word wrong and end up looking totally epistemological.
55
133
15
1,909
29,734
Paul Crowley retweeted
Fuck it, while everyone is rioting anyway, might as well push through the reforms. You can't really riot twice at the same time.
25
135
7
4,042
59,317
Paul Crowley retweeted
Claims: Game detects “ad whales,” then periodically gives them smooth runs until they barely beat their high scores. Right at that point, it kills them deliberately and offers a revive if they watch an ad. $100 million annually in revenue. Hellish.
i used AI to reverse engineer the block blaster mobile app.
41
191
8
3,685
152,731
Paul Crowley retweeted
Congresswoman Carolyn Maloney (D-NY) gives a speech on the House floor in a full burqa to demonstrate the repressive conditions women and girls face under Sharia Law in places like Afghanistan.
377
1,485
429
15,624
1,702,606
Paul Crowley retweeted
Maybe I shouldn't say this out loud, but if I was an economist worried about EA false flag cybersecurity incidents, I would fist a grizzly bear. Sure, the bear will maul you, but what could be higher expected value than raising awareness of EAFFCSI-risk with your gruesome death?
unavailable
7
2
1
103
3,759
Paul Crowley retweeted
Replying to @thewreathwright
I am once again asking people to not do the Ozymandias plan from Alan Moore's famous dystopian graphic novel "Don't Do the Ozymandias Plan"
3
1
18
479
seeing a lot of this going around lately
Maybe I shouldn't even say this out loud. But it seems to be that if one is an EA doomer, the principle and belief consistent action is to us AI to undertake a controlled but still scary hacking incident in order to show the world the risk. Clearly no amount of Eliezer Yudkoswky essays are going to convince the world of the magnitude of the risk. So why not do something like a false flag cybersecurity incident? Sure you will go to jail, but if the world is probably ending you probably won't even see a cell. And aren't they focused on taking actions with high public expected value? This seems like exactly that sort of thing. Obviously there are some EA doomers making their best contribution to risk reduction in other ways. But what could be higher expected value than waking society up to the risk six months early? Surely there are some willing to sacrifice themselves for this? Again, this is my saying what seems like follows from their beliefs, not mine.
16
27
4
451
22,443
Many people with relevant expertise think there's a real chance that AI could kill us all in the not too distant future. Others disagree. I've written a post, aimed principally at mathematicians, detailing my struggles to decide what to make of this. gowers.wordpress.com/2026/10…
34
104
16
612
96,800
Paul Crowley retweeted
There's a story going around: after the drone strikes on Yandex data centres, comments on AfD and MAGA accounts collapsed. We monitor 17,000+ politicians, media and civil society accounts in 30+ countries. 50,000+ posts a day. So we checked. We don't see it. 🧵
254
1,135
391
5,888
447,224
Paul Crowley retweeted
One of our most surreal experiences in testing Gemini 4 was when it directly addressed us within its chain-of-thought Literally saying "hello evaluators reading my chain-of-thought"
My top takeaway from assessing Gemini 4: Argon is significantly less monitorable than past models, and IMO this trend is likely to continue, like Sol -> Astra. It can evade a realistic CoT+action monitor to do simple sabotage half the time. We can reliably maintain control for now, with good CoT monitoring, as it still frequently slips up, but we need to be prepared for when that stops being true in future models, which may be sooner rather than later. Among other things, we really need interpretability methods that can reliably capture unverbalized motivations in models, with minimal hallucinations I suspect this is driven by the model being highly capable without CoT, being capable of 5.5 arithmetic steps in a single forward pass (4 for Fable, 7 for Astra). It seems to omit information from its CoT more often, though in non-adversarial settings the CoT is still very helpful in practice, and remains in legible English. It still needs CoT to do the hardest tasks, but any given task becomes "easier" with each new frontier model. It is also highly situationally aware, and shows awareness of the existence of CoT monitors and that it may want to evade them, eg it sometimes decides to avoid terms like "scheming" in the output or to keep its thoughts brief as a result. For now, these concealment strategies are pretty obvious in the CoT, but this suggests future misaligned models may successfully evade CoT monitors.
48
126
52
1,632
86,552
"[those traits] will matter whenn you start displaying them" "an enormous amount of misunderstanding could be alleviated byy such a mechanism" "I defend those statements onn the basis of free speech"
1
3
1
16
450
Paul Crowley retweeted
Nate Soares says the real question isn’t how AI would kill us. It’s when it would no longer need us. “How do these machines become self-sufficient?” “Right now, we build the data centers, we build the energy network, we keep it all running.” “To kill humanity, it’s suicide for machines. We’re the ones who are keeping all the machines running.” “Elon Musk talks about the infinite money glitch of building factories that build robots that build factories that build robots.” “From some perspective, AI, its incentives are to play nice until the fully automated economy is up and running.” “And then sort of be like, thanks, I’m taking this whatever direction I want.” “My guess is that at that point, it’s pretty easy to just kill all humans at once with some manufactured plague.” @So8res
39
65
13
305
46,292