
Medical educator, ethicist, philosopher, & qualitative researcher @warwickmed at University of Warwick. Views mine. We should pause AI until we know it's safe.
England, United Kingdom
Joined April 2011
- Tweets3.7K
- Following1.7K
- Followers501
- Likes15.8K
Pinned Tweet
Should discussions about climate change become part of the GP consultation?
New paper in Bioethics with Sati Heer-Stavert. At a conference last year, one delegate described the work as “dangerous”. Judge for yourself:
onlinelibrary.wiley.com/doi/…
#Bioethics #ClimateChange
1
35
Simon Paul Jenkins ⏸️ retweeted
Help us reach 2,000 signs up for the March Against AI Extinction!
This is going to be the biggest AI safety march in history.
It’s happening at midday this Saturday, beginning at All Souls’ Place in London.
Come along!
Simon Paul Jenkins ⏸️ retweeted
To make it through this alive and happy we have to dodge:
• Severe human misuse (esp bioweapons from states / terrorists)
• Severe human concentration of power (AI lab or gov)
• Rogue AI (including for decades after AIs clearly no longer need humans to survive)
• A US-China or other war prompted by AI disruption
• Severe economic disempowerment, or the world just generally being unpleasant and unfulfiling
Many difficult gates to pass through, none of which we've made massive progress on so far.
(On top of that to avoid a moral catastrophe we also have to make sure we never accidentally make our AIs into moral patients who are enslaved or suffering.)
Simon Paul Jenkins ⏸️ retweeted
It was a pleasure today to host a panel discussion with @AnnelieseDodds, @tobyordoxford, @benharack and Cath Ge-Wang.
We talked about the implications of recursive self-improvement and the hard questions of global governance of AI.
Today’s discussion on the speed and scale of AI development and its potential consequences was timely and urgent.
Recent developments underline why frontier models must be regulated.
Thanks to everyone who came along, despite the terrible weather! ☔️ 🙏
@PauseAI_UK
Simon Paul Jenkins ⏸️ retweeted
Last week, we stood outside Downing Street and demanded a Pause.
Now Andy Burnham is calling for a global agreement on AI.
The UK has an opportunity to reclaim the international leadership on AI safety established by the Bletchley Park summit and the AI Security Institute.
We believe that means bringing governments together to negotiate an international agreement to pause.
If governments cannot yet demonstrate the safety of the most powerful frontier AI systems, this is the only reasonable response.
We explain the case in our new blog post:
pauseai.uk/blog
Simon Paul Jenkins ⏸️ retweeted
Today, I'm calling to immediately press pause on the development of advanced AI while lawmakers and regulators put systems in place to keep people safe.
Simon Paul Jenkins ⏸️ retweeted
🚨🌍 EXCLUSIVE: The Liberal Democrats have called for the UK to host an emergency global AI safety summit
They hope the summit will bring together nations including the US and China to establish an ethical framework for artificial intelligence
Simon Paul Jenkins ⏸️ retweeted
Start of a live thread of our London protest!
If you can't be here in person, come join us in spirit! 😀
This protest outside Downing St is to ask Prime Minister Andy Burnham to convene a summit to discuss a pause of international frontier AI development when he hosts the G20 later this year.
Hard at work building our stage. Stewards getting stewarding ...
Simon Paul Jenkins ⏸️ retweeted
Less than 24 hours to go! Who else is excited?
People try tell us all the time that there's nothing we can do. Let's go prove them wrong! :D
The media is waking up to extinction risk in the wake of Jacob Coxon's resignation.
We need to rise up to the occasion now.
Every one of us. Drop everything and join us.
Join our emergency Westminster protest on Wednesday to make sure the PM hears the people and the experts' voice during this critical window (link in thread). Tell your friends. Be there.
The Hugging Face attack has shown AIs are capable of autonomously hacking companies. With relentless persistence, these AI agents dismantled every barrier in their way to achieve their goal. Future AIs will pursue their goals just as relentlessly, but with more-than-human intelligence. If we try to stand in their way, we may not win that fight.
Politicians are responding. Senator Bernie Sanders and Representative Greg Casar announced the first US bill to ban superintelligence. In the UK, Alex Sobel has done the same, and over 70 MPs and peers have signed ControlAI's letter urging Andy Burnham to back it, calling on him to use the UK's G20 presidency next year to build "a coalition of the willing to tackle this national and international security threat."
The human story cannot end here. Loss of control to AI is entirely preventable. Join us to demand that Andy Burnham convenes an international pause treaty summit.
RSVP below and share with friends and family.
If you're feeling spooked by all the news about extinction risks from superintelligent AI, you're not alone. Click the link below and sign up to join what's tipped to be the biggest anti-AI march in history
luma.com/pauseai-dec26
#AI
With 71 colleagues I am calling on the Govt to work with us on my bill to prohibit the development of superintelligent AI and champion an international agreement
We can then lead on preventing the extinction risk posed by superintelligence while preserving strategic AI ambitions
1
5
167
Simon Paul Jenkins ⏸️ retweeted
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
AI training environments are already getting contaminated by scheming notes from other models. If we don't slow down, we’ll reach a point where the entire internet is untrustworthy.
We need a global pause before control slips through our fingers. ⏸️
#ArtificialIntelligence
2
1
69
The eclipse was amazing. If only there was a handy metaphor to help me explain how fully and totally better than other experiences that was
2
158
Simon Paul Jenkins ⏸️ retweeted
PauseAI UK Statement on the Pacing the Frontier letter from AI company employees.
Big new open letter from AI company employees just dropped.
“We request that the US government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development”
Signed by the chief scientists of OpenAI, Anthropic and Meta, along with OpenAI’s chief research officer and Google DeepMind’s VP for AI safety.
pacingthefrontier.com/
And we have come close to nuclear annihilation many times already. We need global cooperation to stop the development of AI, or we won't make it into the second half of this century
WATCH: CIA Director John Ratcliffe says the capabilities of frontier AIs are like "digital nuclear weapons".
This comes amid growing concern amongst intelligence officials about dangerous AI capabilities, with Senator Mark Warner, vice-chair of the Senate Intelligence Committee, recently reporting that the NSA’s director, General Joshua Rudd, said that Mythos broke into almost all of their classified systems in hours.
In March, then-Director of National Intelligence Tulsi Gabbard testified on the Intelligence Community's assessment of the rapid advance of AI capabilities, stating that humans must remain in control.
And just last week, the leaders of the Five Eyes cybersecurity agencies issued a rare joint statement warning of the growing threat, saying we "must act now".
While today's AIs possess real dangerous capabilities, they are just a stepping stone on the path to artificial superintelligence. Superintelligence would be able to outsmart, outcompete and overpower humans, and AI companies don't have a credible plan to control it.
As officials start to contend with AI risks, it's crucial not to lose sight of where we're heading.
106
Simon Paul Jenkins ⏸️ retweeted
"No country has an interest in building AI that could wipe out humanity."
In a new article in Persuasion, ControlAI's CEO @andreamiotti argues that to stay in control, countries need to ban superintelligent AI.
Thank you for hosting, @FukuyamaFrancis!
We Need an International Treaty to Ban Superintelligence open.substack.com/pub/persua…
Incredibly important. The average view amongst the CEOs *of AI companies* seems to be around 10-50% chance of human extinction. And they are willing to say that out loud
Leading AI scientist, professor Stuart Russell, warning MEPs in Brussels of the catastrophic risks of AI. #pauseai #ai #AIsafety #artificialintelligence
1
137
I'm going to be 40 on Friday. Help me celebrate by slinging some money into my fundraiser at the link below - and protect some people from malaria
givingwhatwecan.org/fundrais…
1
1
91
Want to be the most ethical researcher you can be? Worried about your ethics approval?
Come (virtually) spend the day with me on my brand new Research Ethics course. Click the link below to find out more and register.
warwick.ac.uk/fac/sci/med/st…
@warwickmed @warwickuni
103































