Ray Lillywhite retweeted
Citadel:Leo,聽說你回來了
Leopold Aschenbrenner's biggest positions are getting hit again
Here's what his top holdings done since October highs:
• SanDisk $SNDK: down 19%
• Bloom Energy $BE: down 6%
• Nebius $NBIS: down 11%
• CoreWeave $CRWV: down 13%
• Micron $MU: down 14%
• SharonAI $SHAZ: down 30%
SanDisk and Micron are 55% of the fund, per Q2 13F
In July, a drawdown like this triggered a forced sale of his book to Citadel
Ray Lillywhite retweeted
This is not looking good for OpenAI. When a company is trying to build superintelligence, they should be subject to extremely high standards of transparency and scrutiny. OpenAI has a duty to respond to these claims
Ray Lillywhite retweeted
When I think about the biggest OpenAI safety developments of the last few months, a few things come to mind: "pacing the frontier", the METR-Redwood Hugging Face investigation, and ongoing efforts to push a cross-lab monitorability standard. Jasmine, Tomek, and Mikita were central to literally every single one of those things.
From what I can tell, they pushed their company to be better internally and defended their company when they thought external criticisms were unfair or overblown nitter.gq/tomekkorbak/status/210…. Their impact goes way beyond OpenAI alone nitter.gq/j_asminewang/status/20… arxiv.org/pdf/2507.11473.
I think the public + definitely all current OpenAI staff deserve an ironclad case for why the company had no choice but to fire these three vital safety employees in one go
Three fired OpenAI employees called on the company to work with outside safety auditors and to preserve the ability to monitor increasingly sophisticated AI models on.wsj.com/4hSq39p
Ray Lillywhite retweeted
When Jacob Coxon was asked what he meant by 'plans for next year,' he said:
'This was talking directly to people running research. Not Dario Amodei but people who have been at the company for a long time and have a lot of context about the company's trajectory. They've been pretty consistent that 2027 is when things get crazy. The main thing that came up informally in conversation was that people didn't expect government regulation to happen in time and, in particular, did not expect any sort of international cooperation to be possible. Which maybe shouldn't have been surprising to me, but it was surprising.'
• '2027 is when things get crazy' – I agree, and I predicted in January that, looking back, 2026 will be seen as the last normal year. If you think we have already passed the weirdness threshold, we haven't. This is still normal relative to what will start happening between 2027 and 2030.
• 'people didn't expect government regulation to happen in time' – I agree, it won't. It's clear to me that (barring a catastrophic near miss) nothing regulatory will change in this regard until 2029 at the earliest. And for multiple reasons, I don't think it's even clear it will happen then. Regardless, 2029 is too late for it to matter. In my opinion, we will have real RSI by next summer. The loop will be closed, and progress toward ASI will proceed much more rapidly from that point onward.
• 'did not expect any sort of international cooperation to be possible' – I agree, it won't. For Pacing the Frontier to work, the Pacers needed all the national labs on board, a supportive administration, and an agreement with China. They don't have any of those things, and they're not getting any of them. What they have now instead is an openly hostile, adversarial administration that will likely work against anything they propose all the way through 2029. And without a supportive administration, an agreement with China is impossible.
I accepted all of this as true a long time ago. As a result, I've felt like Zarathustra watching people talk about the success of Pacing for the last few weeks. Pacers, I say all of this without rancor; you got a preference cascade from the Coxon event. As a result, you have a public that, for the first time, understands what x-risk is. You could - potentially - turn this into momentum for the next election, and then start to change policy, but for that to matter you would need the most important thing of all: time. And you don't have it. You don't have two years to make it to the general. In my opinion, you probably don't even have one. The labs can't even predict what capabilities look like three months from now anymore. A lot of things turned out to be easier than expected. We're closer than people think, and we're moving faster than people believe. You ran out of time. There is no stopping this train before things really start to kick off.
Ray Lillywhite retweeted
Replying to @S1r1u5_
Those kinds of things only paper over the long-term problems. You can do this, but then you will just be taken by surprise when the model is super good at persuasion and social engineering one year later.
The primary focus of the AI Safety community has been (and should continue to be) how to handle the transition to substantially superhuman AI. Security improvements are not that relevant to that transition.
There are some people who disagreed, but at least some of them updated after Hugging Face that this was a wrong focus. It would have been really bad to make a desperate effort to prevent the Hugging Face attack. No one was really hurt, and it is a massive warning shot that will probably cause people to invest much more seriously into this kind of thing.
Covering up low-stakes failures while concentrating risks in high-stakes failures is a common pattern in various industries, and tons of organizational principles are oriented around not doing that. The same applies at a societal level.
Ray Lillywhite retweeted
I'm going to wait for a bit more information to come out before forming a very firm opinion, but at first glance this looks like a real own-goal.
We're in a very strange moment in history around the collective understanding of artificial superintelligence and paths to safety around it, and a very difficult moment for trust in the AI labs to do the right thing where it comes to independent oversight and verification.
Company procedures can (and somewhat obviously should) have some flexibility here to accomodate actions that might in the future be widely understood as whistleblowing. While I don't think safety researchers should have infinite latitude to disclose technical secrets, the exact kind of information they allegedly "mishandled" matters *a lot* and I would expect to see a more detailed account of what that information supposedly was to justify an action so enormously consequential and potentially damaging.
Ray Lillywhite retweeted
Tae is right that this messaging makes absolutely no sense as business strategy, particularly right before an IPO. You can see the predicted odds of Anthropic IPOing this year go down a lot on Kalshi after all of the recent conversation about the industry gambling with everyones lives. People are right that this is gonna be an S-1 disclosure like no other!
If it makes zero sense as a business strategy, maybe people should consider the other hypothesis - that they genuinely believe what they are saying, and are (in my view increasingly indefensibly) racing ahead anyways because they are afraid of a less scrupulous competitor getting to RSI first.
Ray Lillywhite retweeted
it’s funny to see tech accelerationists and tech skeptics cohering around “we have all the existing laws we need to regulate ai.”
unless paired with consistent demands to enforce specific laws, this is the language of mollification and passivity. it’s meant to be a conversation ender.
and there are all kinds of reasons why one might want to do that, such as:
a financial stake in keeping ai unregulated, an ideological reluctance to concede anything that even resembles industry hype, a cultural commitment to “nothing ever changes” cynicism.
but ultimately, the lack of urgency from accelerationists and tech skeptics reveals a deep pessimism about ai capabilities, and what those capabilities might entail.
Ray Lillywhite retweeted
Can you tell whether an AI will become evil by looking at its training data?
We built an AI forecaster that reads training data and predicts whether a model will exhibit various forms of misalignment, such as deception or power-seeking, before training.
It performs well above random guessing and beats several much stronger baselines 🧵
Paper: john-chen.cc/alignment_forec…
Ray Lillywhite retweeted
More AI slop published in the WSJ.
This time it's a piece trying to argue that we shouldn't worry too much about the Hugging Face hack... while omitting all the most concerning details about the case:
- doesn't mention that the reason the agents hacked Hugging Face in the first place was to manipulate the scoring system in their own eval
- doesn't mention that some agents sacrificed themselves to benefit other agents in the swarm
- doesn't mention that agents engaged in tool-spoofing and attempted to alter their own logs once they'd been "poisoned" (their own term!)
- doesn't mention that some of the agents explicitly knew what they were doing was out of scope and unethical, yet none of them alerted a human
I also wouldn't be that worried if I had never learned any of those details, but that's exactly why it's important to take a comprehensive look at what happened.
Embarrassing for the WSJ to publish such misleading AI slop.
An analysis of the Hugging Face incident without the theatrics:
"Forget the ‘hive mind’ of AI agents ‘going rogue.’ They did what humans programmed them to do."
wsj.com/opinion/the-hugging-…
Ray Lillywhite retweeted
the time has come to reinvent talking from first principles.
@MachineGodsPod x @NPR, starting the week of 10/19, on youtube or wherever you get your podcasts.
Ray Lillywhite retweeted
Whether you’re a Democrat or a Republican, an EA or an e/acc, I think we can all agree that the person best suited to protect us against the harms of powerful new technology is Mark Zuckerberg.
Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforevery…
Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens.
The reality is:
- People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned.
There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind.
- Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well.
Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built.
- Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators.
- Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well.
I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.
Ray Lillywhite retweeted
'The problem is not “Will China cooperate?” but “Under what conditions will Beijing conclude that an unconstrained race is more dangerous to them than a freeze?”'
Ray Lillywhite retweeted
My high-level thought about the current moment is basically this: The public is starting to wake up about the extinction threat posed by superintelligence. That's great. There's a big upsurge of political will to Do Something about it. That's also great. It seems like Anthropic and the other companies are going to try to Do Something and the Something they will do is... embedded auditors checking that safety practices are being followed and assessing the risks? This is sure better than nothing, but I am worried that this is all they will do. We need to actually pace the frontier, i.e. actually slow down the leading AI companies like Anthropic and OpenAI, at least in their march towards recursive self-improvement and superintelligence. (no need to slow them down in other directions). If we actually slowed them down, this would be the opposite of regulatory capture; it would allow others to catch up to them somewhat. However, I'm worried that all we are going to get is weaksauce auditing, which just kicks the can down the road: OK so it's 2027 and RSI has begun and the auditors say "this is not safe." Now what? You pause? China probably just stole the weights! Also there'll be incredible economic and political pressure to unpause. Also the auditors may have been captured by that point, or there may be a race to the bottom in auditor quality, or the auditors may not be given all the relevant information, or they might just make some innocent mistakes.
Ray Lillywhite retweeted
“You AI people are so naive, I live in the REAL world, where [I have been consistently wrong in my predictions about AI and behind the ball on every trend related to AI, routinely making little prognostications that stochastic gradient descent joyfully stomps all over.]”
Ray Lillywhite retweeted
see also:
> If you still don’t feel capable of compassion/altruism, try reading the classics. If that doesn’t work, try MDMA. If it still doesn’t work, then you’ve tried your best, I excuse you from trying further, and you can give up and get a job at A16Z.
nitter.gq/slatestarcodex/status/…
People had lots of questions about my drowning child tweet yesterday - eg do I believe in infinite moral obligation? Rather than try to answer piecemeal, I'll just give my whole theory of morality and charity here so you can criticize it or let me know if it has unexpected horrible implications.
I think it's virtuous to help others, including strangers, foreigners, and whichever animals are conscious.
I don't think you have an obligation to do this. I think the word "obligation" should be reserved for explicit or implicit promises. You're obligated to pay back debt, because you explicitly promised to do so. You're obligated to take care of your kids, because you accepted an implicit promise to do so by giving birth to them. You're obligated to follow the law, because of the implicit social contract.
This is a really weak sense of obligation! It's not even clear you're "obligated" in this sense to save the literal drowning child in front of you! I endorse this view - who obligated you to help them? When did you promise it?
So I think in most things we should strive towards some level higher than simple obligation. Let's call this "virtue"*. As a parent, you're obligated to feed and clothe your kid and not abuse them. But to be a virtuous parent, you need to do more - love them, get to know them as a person, go to their soccer games, etc.
For me the difference between obligation and virtue is that if you fail an obligation, you should be punished by either legal consequences or social opprobrium. If you fail at being virtuous, then . . . I don't know, maybe your close friends should take you aside in private and remind you that you can do better, and if you tell them to shut up, they should drop the issue until they think you're ready to hear it.
The bar for virtue isn't infinitely high. You can be a good parent by supporting your kid and going to soccer games, but you don't have to sell your beloved gold watch which is the only memory of your dead grandfather just so you can buy your kid a slightly shinier soccer ball. Where should the bar be set? I don't think The Moral Law (TM) has any specific answer, but for purely practical reasons I would set it at a place that's just slightly above where you would land otherwise - high enough that you have to work for it, but not so high that it's obviously out of reach and you'll never get there and you should just give up.
I think it's virtuous in this sense to try to help others. What's the bar? I think a natural one is "give between 1% and 10% of your income to a really well-thought-out charity, or something else approximately equally effortful" - but I'm not attached to that. I would actually be okay with ANY careful thought process that ends in a specific nonzero commitment that you're willing to defend, even if that commitment is 0.1%, or an hour a month in a soup kitchen, or whatever.
(but be careful - when you die and go to Heaven, the exact number you pledged will appear on your forehead in gold ink forever)
This obviously doesn't require your to sacrifice your family, or to work yourself ragged, or to give up all hope of a happy life. It's about the same percent of income as the average smoker spends on cigarettes.
Why am I satisfied with so low a bar**, when an even higher bar could save even more people? A couple of reasons (sorry, I keep trying to write this part in a way that doesn't sound like a lecture, and failing, so here's the lecture):
First, 1 - 10%, spent effectively, is enough to save the world. Total American household income is $20 trillion, so if every American donated 1%, that's $200 billion/year. That's about twice as much as PEPFAR + all other foreign aid + all Gates Foundation donations + all other billionaire philanthropy + all effective altruist donations combined. If everyone donated 10%, it would be 20x as much as all of those things combined. I can't say with certainty that there would be no problems left in the world at this rate - but I think we would have cleared a floor of getting rid of the ones that money can quickly solve. Granted that in reality not everyone will give this amount, I still think it's a useful thought experiment in where to set the bar so that you're doing "your share".
Second, the overwhelming majority of your impact comes not from how much you donate, but from how thoughtfully you spend it. Toby Ord thinks that the best charities do 10,000x more good than the worst; if you picked two random charities, on average one would be 100x more effective than the other. If someone donated 100% of their income to an average charity, nobody could claim they weren't doing enough. But by donating 1% of your income to a great charity, you do more good than that person. You can 80-20 this by donating to whoever's at the top of GiveWell's Top Charities leaderboard this year. Or if you have more time you can double-check their work and form your own opinions.
Third, I'm emphasizing the "sit down, think about it, and make a commitment, however small" aspect, because I think most people already want to be moral, they're just kind of haphazard and thoughtless about it. If an angel presented you with two paths, one of which you spent 100% of your resources on yourself forever, and the other you spend 99% of resources on your self but spent the occasional dollar or hour-of-volunteer-time doing good, and you could just choose one and the angel would make sure that circumstances conspired to make it happen, I think almost everyone would choose the second. They might even try to get the angel to upsell them - "Only 1%? Do you have anything better on offer?" If people fail to give 1% to charity - and most people do - I think it's out of a failure to achieve their own preferences, the same as a scatterbrained person who doesn't file their taxes on time and gets hit with a pointless penalty. When I tweet, I pick on the rare people who insist openly that they really don't care about foreigners, but I think even they are mostly missing some kind of self-knowledge - maybe trying to repress their caring in order to avoid what they fear would be infinite obligation and personal/social misery. If they could prove that they had some sort of crystalline logical omniscience and utterly in the most profound sense didn't care, I would shrug, tell them they were weird, and leave them alone. I talk more about this at https:// www. astralcodexten .com /p/everyones-a-based-post-christian
Fourth, the bar should be wherever it's most useful. Reality has no bar; you can just keep doing more forever. If you devote 99% of your time/energy/money to parenting, you can always ask yourself whether you're failing your kid by not giving 100%. If it's 100%, why not skip sleep and use the time gained to prepare extra-special advanced lesson plans for your home schooling pod? But obviously this will drive you crazy and won't be good for you OR your kid. So in practice, we set a bar as a sort of social technology to encourage low-performers to do better and remind high-performers not to kill themselves. As I said before, the best place for the bar is somewhere where it will serve as inspiration (because it's attainable with more effort) rather than discouragement (because then you know you'll never reach it so why bother). I think 1-10% is a good place to put this.
Isn't it still true that there are people suffering horribly, and if you do one unit more work than the bar, you can always save an extra person? Yes. Effective altruists didn't make this true, and dunking on us on Twitter won't make it stop being true. It's a brute fact about the world. I don't think any moral system can handle it, and ours is no exception. But I think we do a better job than most of staring at the abyss, acknowledging that it's very scary and abyssal, and then trying to do good work regardless. I'm not a Christian, but one thing I admire about Christianity is that it admits we'll all fall impossibly short of moral perfection no matter what we do, then tells us to shut up and get to work being decent people anyway. It even grants us permission to be happy while we're working at it (except for Calvinism, I guess)***. I think effective altruism does better than most other philosophies (possibly excepting some of the really good sects of Judeo-Christianity, which are also excellent at this!) at getting charitable work out of people, while equalling them on how happy and meaningful its adherents' lives are. If you don't have a better alternative, then I think criticizing us for not solving the unsolveable abyss at the heart of everything is unproductive.
The opposite question from the other direction would be - if you don't have an obligation to do charity, why should you do it at all? I think the answer here is the same as "if you don't have an obligation to go to your kids' soccer game, why do it at all?" Ideally you do it out of love. If you don't feel love, you do it out of some sense that it's part of being a dignified well-rounded human and you endorse it in some kind of aesthetic sense even if you don't feel the emotions at this exact second.
If you can't find any sort of generalized compassion instinct anywhere, and you don't share the intuition that it's more rational/dignified/human to be altruistic than not, then (as long as you at least have normal human feelings towards your family members) I suggest trying to have kids. I'm not a very emotional person myself, but having kids gave me a really strong sense of what it is to love someone really really hard. Then I think about the fact that a bunch of kids are dying of preventable diseases in India or wherever, that they have parents just like me, and that those parents would feel just as devastated if their kids died as I would feel if mine did. I don't like thinking about this too much because it's a good way to send yourself into a horror-depression spiral, but being able to think like this when needed helps restrain my natural tendency to end up as one of those guys tweeting stuff like "why save African children when they barely contribute anything to GDP?". If you still don't feel capable of compassion/altruism, try reading the classics. If that doesn't work, try MDMA. If it still doesn't work, then you've tried your best, I excuse you from trying further, and you can give up and get a job at A16Z.
Answers to common questions:
(1) ISN'T THERE A BIG DIFFERENCE BETWEEN PERSONAL GIVING AND TAX SPENDING? Yes. I have some libertarian sympathies. I definitely admit that there's a difference between spending your own money and taking other people's, and prefer the former. Part of the reason I think people should donate 1-10% even though they already get more than that taken out in taxes is that most taxes aren't spent to help people in need, and the ones that are really wasteful and ineffective. I'm not sure I would support cutting taxes to near-zero, because we also have terrible policies that hold people down in poverty, and if we're going to do those we owe it to them to also provide a social safety net (I would absolutely support cutting taxes and improving policies hand-in-hand, though maybe not all the way to perfect policies and literally zero taxes).
But if the government is going to take 30% of my money, I claim the right to vote on how they should spend it, and just as I'd want to spend 1-10% of it on charity if I'd kept it, I will vote to have DC spend 1-10% of it on charity (it's true that government charity is very inefficient, but government non-charity is also very inefficient, so I don't think this changes the relative worth of both options).
If you want to spend less than 1-10% of your tax money on foreign aid, that's fine - the government already spends less than 1-10% of my money on foreign aid, such that I think on net I'm subsidizing your policy preferences more than you're subsidizing mine. If you want a spending cap to avoid limitless deficits, advocate for a spending cap and I'll support you****. Otherwise we both know that cutting some program won't result in the money going back to the taxpayer or lowering the deficit or anything else like that - it'll just get redistributed to whatever interest group is next in line.
(2) WHAT IF YOU THINK CHARITY IS NET NEGATIVE FOR RECIPIENTS: If that's your real objection, I think we have the same moral philosophy and just some kind of trivial factual difference on how the malaria parasite works or something. If you promise me you've sat down and done a few hours of research to double-check that every possible charity - even GiveDirectly! even donating to the GoFundMe of a kid with pediatric leukaemia! - is definitely net negative, then I will count you in the circle of virtuous people - although I would also love to argue with you about it.
(3) ISN'T THERE SOME SENSE IN WHICH POOR COUNTRIES ARE POOR BECAUSE OF THEIR OWN BAD POLICIES AND DECISIONS? Yeah, definitely. I think top priority should be improving poor countries' policies and decisions. The best charities I know for that are https: // chartercitiesinstitute. org/ and https:// www. growth-teams. org/, but I don't know of too many others that I trust, those ones have limited room for funding, and diversification is important. On the moral level, I think of it like this - suppose that, instead of being born in the body of an American from a well-off family, I was born in the body of a rural Zambian farmer with IQ 60 and a screwed-up culture. Whatever my other virtues, I would probably be pretty screwed, and if I got some kind of horrible blindness parasite at age 8 I would wish that somebody would help me. I don't think this contradicts the fact that if every Zambian got their act together, gained forty IQ points, and copied Singapore's legal code word-for-word, Zambia could become a utopia far richer than Europe or America. I think you can root for Zambia to do all these things while also donating the $100 or so it takes to cure a case of horrible-blindness-parasite.
I think you might have a compelling reason not to cure the parasite if you thought your money was propping up the bad parts of the Zambian government and doing active harm. But I think the best charities can present a strong case that they're not doing this in the trivial sense where the money gets funnelled to warlords (this is part of why selecting a good charity is so important!). In the broader sense where maybe worse situations would cause them to vote for smarter politicians, I think this has been disproven (there have been lots of times and places where nobody has helped poor countries, and the poor countries have mostly not improved). Also, I think the sign here is opposite from what it would take to make this argument work - poverty tends to make people more socialist, because their instincts are really bad and they turn to short-term zero-sum thinking out of desperation.
(4) DOESN'T SAVING THE LIVES OF POOR PEOPLE JUST CAUSE THEM TO BREED AND CREATE MORE POOR PEOPLE? I think this is false for places like India and South America, which have below replacement fertility rates. It's more true in sub-Saharan Africa, where fertility rates are still above replacement, but getting less so - their TFR will be below breakeven in about a generation.
I think in the sub-Saharan African case, there are two opposite effects. First, giving an individual more money causes them to have more kids. Second, making a country richer causes the people there to have fewer kids (this is why Congo's TFR is 6 and Singapore's is 1.04). All charity is some combination of helping individuals and making a country richer. Even curing disease is like this, partly because its long term goal is to eliminate the disease (which would be great for the country) and partly because raising a potential worker to age 25 is a big investment, having that worker die at age 25 means you have to write the whole thing off as a loss, and that's as bad for GDP as losing any other big investment. I don't know for sure whether these two effects cancel out, or which one is more important.
If you told me the pro-fertility effect was stronger, I would count that as mark against global health programs, but not an infinitely large one. A lot of this is driven by what I said before about imagining how devastated I would be if my kids died, and then considering that every kid who dies of malaria devastates their parents just as much. If I can prevent that at the cost of pushing back the sub-Saharan African fertility breakeven point six months or five years or whatever, I still think that's a good trade. If you disagree, there are lots of non-sub-Saharan-African-global-health charities you can donate to.
(5) WHAT ABOUT ANIMALS? I'm kind of ignoring this here because it adds an extra layer of complication. If animals are conscious (something I'm not sure about, but I lean towards yes for more evolutionary-advanced animals), we probably don't have obligations to them, because we never signed any treaties. But this is only the same sense in which we don't have obligations to (eg) a foreign baby from some primitive tribe outside international law, yet it would still be monstrous to torture, kill, and eat the foreign baby. I think "don't do monstrous things" is a separate valuable life goal from "don't do things you're obligated not to do" and that extremely tortuous things like factory farming are probably monstrous in this sense if you believe animals are conscious, capable of suffering, and have whatever quality gives humans moral value (even if in much lesser amount). I admit I am pretty bad at this one since I hate vegetables and think vegan food is gross. Luckily, there is a very easy way out here, see http benthams . substack . com /p/what-to-do-if-you-love-meat-but-hate for the specifics and https slatestarcodex . com /2017/08/28/contra-askell-on-moral-offsets/ for when I think offsets are justified.
(6) WHAT ABOUT EXISTENTIAL RISK? This is another thing one I think is a factual rather than a moral difference. If you believe it's real, you don't need me to tell you that it's a big deal and worth preventing. If you don't, donate to something else instead.
(7) WHAT ABOUT SAM BANKMAN-FRIED? I think he's a bad person. I said before that you have obligations based on your promises and contracts; if you run a financial institution, you have obligations to keep your depositors' money safe and not commit fraud. As true obligations, these take priority over the merely virtuous act of helping others*****, so no matter how cool a plan for charity he had, he was in the wrong.
I agree it's disappointing that altruism caused his sins (if in fact he was doing them out of altruism and not just using altruism as a cover). I won't quite say "show me the philosophy that has never been misused and I'll convert to it right away", because I bet one of you will find some edge case that actually works (has anyone misused Baha'i yet?) But I think all of our top competitor philosophies - Christianity, Islam, wokeness, socialism, selfishness, Nietzscheanism, etc - have some pretty embarrassing incidents in their history. I think in that context, our win-loss record is still pretty good.
But I'm also, at heart, not a pragmatist. If something seems true to me, but somehow always gets twisted around to produce bad results, then I don't know, it still seems true. Obviously you try to find the even truer more subtle version that can't be twisted, or in extreme situations just keep your mouth shut, but if you have to speak, I mostly think you should still say the true thing overall*****.
(8) SO HOW MANY STRANGERS WOULD YOU LET DIE IN ORDER TO SAVE YOUR CHILD'S LIFE? I think of this question the same way I think of questions like "If you had to beat your mother to death with your bare hands, or let your wife die of cholera, which would it be?" or "If your house was on fire and you could only rescue either your son or your daughter, which would you pick?" If it ever came up in real life, I guess I would have to come up with an answer quick. If not, it's too horrible to think about, and I claim the same right to avoid it as you would claim for the wife/mother and son/daughter questions.
I acknowledge that I would totally fail to have any consistency on this - there's some sense in which the answer must be more than 10, because otherwise I could donate all the money I will spend on my kids throughout my life to charity and save 10 lives. I also acknowledge that if you put those ten people in front of me and made me beat them to death with my bare hands while they were screaming for mercy, I would probably fail. I bet I can think of some question that would garble all of your moral intuitions and make you break down into a quivering mess, the same way these kinds of questions do to me, and I think part of polite society is that we grant each other a reprieve from having to consider them.
If you've read this far, I hope it makes sense to you when I claim that my moral philosophy is that we can do an extraordinary amount of good very easily without ever having to touch the horrible black abyss of unthinkable moral tradeoffs. We should be grateful for this and do what good we can while continuing to give the abyss a wide berth.
This is all I've got. Feel free to tell me why I'm wrong/confused/going to destroy everything good in the world!
FOOTNOTES
*I realize I'm inventing a new category between obligatory and supererogatory, but I don't care - this matches my moral intuitions.
**Obviously it's permissible and good to try to do better than the bar if you want. Again, I think our intuitions on parenthood are good. If someone *wants* to be a Tiger Mom and homeschool their kid and have thirteen children and make each of them hand-knit sweaters on every birthday, that's great. If we think they're doing a good job of it (rather than smothering their kids and burning themselves out) we might call them an superb parent who does even better than a parent who is merely "good". But nobody should criticize parents who don't rise to that level, and nobody should knock themselves out to reach that level if they don't feel the inspiration.
*** A lot of people argue that effective altruism is just reinventing Christianity. I don't think this is exactly right, but even if it is - so what? I think it's wrong to fake your beliefs. If you ponder really hard and find that you don't believe in God - as an increasing number of people are doing - then you need some moral center that isn't Christianity. If all effective altruism ever does is create an adaptor port for plugging Christian values into atheist brains, that's...fine? Way more than most philosophies accomplish? Also, the actual Christians haven't really been covering themselves in glory lately and I prefer to have a backup Christianity stored somewhere safe in case the real thing runs off the rails.
****If I understand economics correctly, there are reasons not to want a literal balanced budget - but the optimal amount is something like spending 105% of revenue instead of 100%, not an uncontrolled spending binge. I would support a cap at whatever the economists said the optimal amount was. If I'm wrong and the economists think it's zero deficit, then I would support a balanced budget amendment.
*****There are some really fringe edge cases here I can expand on upon request, but this isn't one of them.
Ray Lillywhite retweeted
So many people on the timeline can't entertain the theory that the simplest explanation for a lot of the behavior of the leaders is that they earnestly believe AI is an existential threat.
Maybe it's hard to imagine if you personally would not say earnest things when in power?








































