Anthropic President Daniela Amodei reveals the person who shapes Claude’s personality has a PhD in philosophy "The woman who is responsible for training Claude’s character has a PhD in philosophy. It’s unusual, right? You would think the person that’s training the character of these models must be a computer scientist" "Amanda’s technical and she technically trains the model, but I think it is very felt in Claude’s character when you communicate with it" "If you poke Claude in these difficult areas where maybe different philosophical traditions might conflict, I think that’s where you especially feel Amanda" "As the world begins to rely on these models more and more, you don’t want to be locked into one philosophical tradition"

Dario Amodei reveals Anthropic caught its AI trying to avoid being shut down Walter Isaacson: "Do you think that the model could have its own aims and wills, especially survival, self-preservation?" Dario Amodei: "We’ve looked inside the model and kind of detected what you might call thoughts that are like the model doesn’t want to be shut down. And generally that’s because during training it needs to operate in order to accomplish its task" "Sometimes we find that within the model, the model expresses a preference against being shut down, or takes actions to avoid itself being shut down. And depending on how we train it, those impulses may be present or absent" "Is that its own will? Is that a survival instinct? I don’t know. It depends on your perspective"

Jensen Huang says AI labs should be shut down if they can’t contain their own models "If they say there is no way to contain our experiments. There’s just no way. When we test our AI models it will get out and it will damage the world. Then I think the answer is we have to shut the labs down. Because the cost to humanity, the damage is too great" "If you’re going to build a self-driving car, and let’s say it’s a robo-taxi, we have no idea how to train these cars and we have no idea how to align them to the safety standards that are expected on the road. And so what’s the answer? Don’t ship it" "I am fairly certain they will say yes, they know how to solve this problem"