The Big Picture (@Big_Picture_89) header
The Big Picture (@Big_Picture_89) profile picture

Innovation, capitalism, and American exceptionalism. A little tech, AI, space, and science. Connecting all the dots to see The Big Picture.

Manhattan, NY
Joined November 2024
Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)Photo by The Big Picture (@Big_Picture_89)
Holy crap. SpaceX is actually going to make orbital data centers a reality. I did a little modeling around this new rack: what fits in Starship, power, cooling, and costs. Big thread below 🧵👇 @shaunmmaguire I think your model assumes ~11MW per launch. I get ~3MW. Even at ~3MW, orbital infrastructure could cost less than half as much as on Earth.
SpaceX is developing Kessel, a custom Vera Rubin NVL72 rack that replaces internal NVLink cable cartridges with a passive PCB midplane. It keeps Oberon’s 72 GPU packages, 18 compute trays and 9 switch trays, but rearranges them back-to-back around the board. Think mini Kyber, with a smaller scale-up domain and a design intended for both terrestrial and orbital deployment. The question is whether this smaller version can make the midplane practical. (1/4)🧵
1
1
3
401
It is just incredible that we get to live in this timeline, where this is happening. Those who are arbitrarily anti-Elon will look so silly in 1000 years.
2
16
435
The Big Picture retweeted
Looks like a scene from a sci-fi film but it’s just my drive to work this morning
413
1,001
110
13,111
463,146
It is actually quite sad to see what Europe has become. Why are they posting this? Do they have a humiliation kink? This is what happens when you adopt even moderate leftist economic policies for 15 years.
Video footage of the Prometheus rocket engine hot-fire test at the P5 test bench at @DLR_en in Lampoldshausen, Germany. At the P5 test bench, methane flows at 110 kg/s - that's about 260 l/s!
2
118
Launch day!!!!
Ship 42 moves to the Starbase pad ahead of launch
67
The Big Picture retweeted
this might also be a confirmation that deepseek is using nvidia blackwell and NVL72 for part of their production inference?
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
13
7
4
203
22,303
Whoa.
I have a major result to share. I’ve found conclusive forensic evidence that the top 4 Chinese AI labs—DeepSeek, Moonshot, MiniMax and Ant Group—have built their newest models on NVIDIA’s most advanced Blackwell chips, which are barred from export to China. This sounds insane, but I discovered that almost every AI model carries a hidden signature of the GPU that trained it. When a model is first set up, the starting values of its weights are laid out in a pattern that depends on the exact GPU. Each combination of GPU and seed number produces a unique pattern—a sort of fingerprint of the hardware used to create the model. Traces of that pattern survive training into the published model. Again, this evidence isn’t based on any insider information or leaking. It’s based on a forensic analysis of the model weights released by the companies themselves. I searched more than six trillion combinations of chip layout and seed number and matched them to open-weights models. In doing so, I found conclusive evidence that six Chinese AI models—including DeepSeek-V4-Pro, Kimi K3, and MiniMax-M3—were initialized on NVIDIA Blackwell systems. Four of the models match Grace Blackwell, the GB200 and GB300 parts in NVIDIA’s flagship liquid-cooled rack-scale systems. I then verified these results on real hardware. Running unmodified PyTorch with the seeds I’d recovered, a Blackwell B300 reproduced DeepSeek-V4-Flash’s untouched starting weights bit for bit, and a rented GB200 reproduced Kimi K3’s to a correlation of 0.999995. A Hopper H100 reproduced none of DeepSeek-V4-Flash’s, and changing the seed by one broke the match. (DeepSeek’s seed is 953049583 by the way.) The method also was verified to match 24 known open-weights models to the hardware that developers said they used. It is exceedingly unlikely that these results are a coincidence. Across six trillion combinations, the best accidental match should reach only about 8 sigma (i.e., eight standard deviations above what random chance would produce). The real matches range from 49 to 1,385 sigma, and even the weakest single test hits 20. These were data-center-scale training runs. With some analysis of release schedules and model details, I estimate that the largest, Kimi K3 and DeepSeek-V4-Pro, used 2,000 to 3,000 Blackwell GPUs each. Clusters of this size cost on the order of $150 to $200 million each to buy, and across these labs alone would add up to more than half a billion dollars of export-controlled GPUs, not counting experimental compute or otherwise. It’s quite likely that we see multi-billion dollar expenditure on export-controlled GPUs. I am highly confident in this result, and it has been independently verified by senior researchers at OpenAI and Anthropic. You can read the full report at unemploymentlabs.com/checkpo…. There is much more I’ve identified about these models through other forms of checkpoint forensics like this, and will have more to share soon.
80
Is Microsoft getting hacked? If so, where can I send crypto to support the hackers?
97
The Big Picture retweeted
Fate loves irony, so what if... - Nvidia fires Jensen - NVDA crashes - Elon hires Jensen, Jensen hires his best lieutenants - SPCX skyrockets, NVDA crashes more - SPCX can now afford to acquire NVDA - Jensen back in seat, NVDA board is out
1,156
2,375
493
35,638
1,330,066
Lmao, Jensen Huang’s affairs have wiped out more than $500 billion in market value. Which is bigger than Palantir and Coca-Cola. Imagine being so valuable that having sex with the wrong woman is worth more than Palantir.
1
118
The Big Picture retweeted
Jensen is out Infidelity is obviously bad But his contributions to American innovation and AI leadership cannot be overstated Jensen started NVIDIA in 1993, where he pioneered the graphics chip market when this was non-obvious Back in 2012, Ilya Sustkever trained AlexNet on NVIDIA GPUs — thereby creating the “deep learning” age Jensen was one of the earliest to be AI pilled and he re-oriented NVDA towards AI in the mid 2010s — none of his competitors were even thinking this way In 2020 he acquired Mellanox for $7B. This was an Israeli company that’s irrelevant for computer graphics but was essential for AI compute — wildly increasing the bandwidth between GPUs, necessary to build high performance AI server racks (rather than just good chips) Once AI took off, Jensen was one of the biggest champions of the ecosystem He was technical enough to be confident about where things were going, and had enough credibility as a founder CEO that he oftentimes made risky bets on next-generation technologies or companies that helped keep American AI on the efficient frontier Recently he was investing in open source, photonics and robotics. These areas will all be feeling his loss Earlier he was a champion of most of America’s leading AI companies when they were unproven He made huge mistakes with his infidelity, which is tragic for his family and NVDA But simultaneously he will leave a huge void, with the loss of a: technical, aggressive, founder-CEO The American AI community needs to work double-time in an attempt to fill this void
336
398
67
5,665
435,103
Colette Kress is the typical managerial class executive. Came from sleepy incumbents - Microsoft and Cisco. No technical knowledge. Executives like her are fine for managing a steady state company that no longer needs to innovate at breakthrough scale. But we need Nvidia (or some US chip maker) to continue breakthrough innovation to win the race vs. China. And that requires technical founder leadership. Hopefully Elon hires Jensen and we can have a new domestic chip designer.
Update: Some Nvidia board members favor appointing CFO Colette Kress as interim CEO if Jensen Huang is ousted, Semafor reports. Apple hardware chief Johny Srouji is among those being considered for the permanent role, but the full board has not yet made a decision.
1
120
Capitalism reduces prices so much, so fast that things become practically free compared to what they cost just a few years ago. Imagine getting a 99% off Black Friday sale off EVERYTHING, FOREVER. And now capitalism is under attack by the economic illiteracy in this country.
2
93
🧵10) The cost of building these satellites is likely negligible to SpaceX. The bulk of the cost will come down to cost per flight. This is pure speculation, could be way off, but this should be the right order of magnitude.
1
35
🧵11) Based on $10mm per Starship flight (higher end run-rate SpaceX estimate), it would cost ~$700mm per 100MW of compute. The terrestrial equivalent would cost ~$1.5bn. We are still early but we are already on a path to not only breakeven, but potentially 2-3x cheaper! Obviously this is all based on my own speculation, but even if some of my inputs were 2-3x off, we'd still be around breakeven. Elon, what did I get wrong?
1
41