ashley (@AsherT) profile picture
Joined May 2008
Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)Photo by ashley (@AsherT)
RL roll-outs on Macs! Imagine the compute this unlocks with idle Macs around the world. Excellent work Erfan!
RL post-training on Macs 14 Macs across 4 countries generate every rollout for the run. Everything's running over the internet. No wire between any of them. As far as we can tell, this is the first RL post-training run with its whole rollout fleet on consumer Macs.
1
3
10
1,196
Today we're releasing Agora: the first ever pretraining stack that allows non-collocated consumer GPUs to be competitive with centralized clusters Agora is 15x faster than Megatron-LM in this setting and is only 1.5x less efficient in terms of tokens per unit compute than TorchTitan on H100s, despite running on devices that have no NVLink or InfiniBand support.
29
45
23
315
95,565
The first Protocol Learning workshop in Rio today! A new field is emerging: decentralized training of foundation models. Because the world’s intelligence belongs in open, collectively owned systems. Thanks for joining @oguzer90 @niclane7 @m_ryabinin @namhoonlee09 @itsmaddox_j
3
15
2
47
5,322
'13. Labs will not be allowed to “escape” to neutral jurisdictions. We are about to see a 10x in state power simply due to the fact that AI requires centralised, physical datacenters and these can be controlled in a way diffuse human knowledge work cannot.
Important variables to consider when reading the Citrini post: 1. UBI all but guaranteed - debate will be on demand side with compute stipend vs universal basic services 2. US govt would aggressively move to ensure compute is US-centric and allows them to shift pain to ROW 3. Very likely robotics will be ramping by then which will soak-up recently fired knowledge workers to help build ramp 4. Credit markets are the bigger risk vs equities because potential for persistent deflation fuck debt calcs 5. Trump admin would deport 25m illegals before allowing knowledge worker migration to lower-end services turning into a deflationary wage spiral 6. Biotech and material science boom almost guaranteed by then driving spec capital and hiring 7. Out of every country on earth the American consumer is the richest, most resilient and most degenerate. If U.S. consumer is hurting the ROW is dead. 8. Datacenters will be bombed and molotov cocktailed long before things get that dire 9. Govt will be the lender of last resort to high FICO knowledge workers who got laid off 10. Cursor for Trades will be a thing and knowledge workers with AR glasses will be able to career shift far more easily than you would think 11. Disruption of incumbent knowledge workers will destroy demand for many of the denser urban pop centers and “fix” housing affordability crises as distributed work becomes a lot more acceptable …. Will also be a major wealth-effect issue into silver tsunami 12. Supply side taxation will become a thing. Tax on compute. Tax on electricity usage. Tax on racks. 13. Labs will not be allowed to “escape” to neutral jurisdictions. Go to Bahamas the U.S. will annex the Bahamas. This is too big to abide by international law. - just off the rip on first read 🫡
4
1
14
2,522
the interesting thing about being off twitter for 4 years and then getting back online is coming across all the smart friends i made IRL and realizing that i thought they had important jobs but actually all they do is shitpost. but they are all really funny so thats a bonus
8
22
2,507
Personally I love that trad tech boys hate Web3 and I advise all of you to stop trying to convince them otherwise and let them sail away with each other into irrelevancy and obscurity while we do cute new shit unburdened by their allbirds and sweet green aesthetic.
18
34
20
464
My plumber just hit me with a gm over text and I wonder if he knows we are blood brothers now.
20
While you all were raving in Portugal I was farming IRL & plotting privacy with @fabioberger123 I’ve now acquired a very rare allocation of freshly minted olive oil straight from the farm (comes with shadowy, but wholesome! coder vibes). Find me at solanacon for alpha 🫒
1
18
Sorry if I don’t respond to your messages this weekend I’m really busy
26
Had a friend come over and visit this eve. He brought a gift: “I heard you’re poor”
2
22
It’s a 6 pack in case anyone would like me to share the wealth. ❤️❤️
3
7
asking someone to send a wire is basically the financial equivalent of assault
3
10
Is this.... top?
3
1
65
Hear me out: a stable coin but pegged to the price of a Taco Bell Crunchwrap Supreme.
11
5
3
297
I have blocked the canal that was in Egypt and which you were probably using for the global economy Forgive me It went sideways so fast and out of control
50
2,163
137
9,391
From a friend in response to a group potluck dinner so we can share our rations: “I’m down for dinner but running out of food. Can bring money. Have 1 frozen pizza and 2 cans of Campbell’s soup. Gonna get liquidated soon.” Someone send an airdrop pls. But for food.
2
1
18
Austin is a frozen dystopian hellscape. 40 hours of no power or heat, below freezing temperatures and the city has run out of food. No gas, no escape. It will continue snowing for the next 48 hours(!?!). No power in sight for most. We are now bartering and trading for supplies.
138
142
82
993
They can only control us because we use their currency.
3,273
12,965
2,158
106,682
My political views below.
I have anarchist sympathies, but sometimes I do feel like you need a strong centralized State to prevent people from starting so many podcasts.
7