axx retweeted
Zuck pretty handily dismantles Dario's talking points here:
- people want models that are *aligned with them* (subtly punches back at Anthropic's normative constitutional approach)
- labs already face liability if they screw up, so incentives to release aligned models is already baked in
- Meta delayed Muse for alignment reasons but didn't make a whole song and dance about it
- Subtly questions Anthropic trying to kingmake METR (implies METR is an Anthropic patsy)
- Meta doesn't need to coordinate with anyone to work on alignment, it's just something labs should naturally do
Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforevery…
Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens.
The reality is:
- People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned.
There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind.
- Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well.
Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built.
- Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators.
- Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well.
I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.
If @DarioAmodei wants to slow down Anthropic that’s his choice — do it today!
If he wants to lobby other frontier models to do the same, that’s fine as well — he did that today!
However, don’t go crying to the government and beg them to slow down open source models — has he been doing that behind the scenes?
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: darioamodei.com/post/we-must…
axx retweeted
and ironically, the further you are away from a computer, the more unique your thinking








