ashley retweeted
RL roll-outs on Macs! Imagine the compute this unlocks with idle Macs around the world.
Excellent work Erfan!
ashley retweeted
Today we're releasing Agora: the first ever pretraining stack that allows non-collocated consumer GPUs to be competitive with centralized clusters
Agora is 15x faster than Megatron-LM in this setting and is only 1.5x less efficient in terms of tokens per unit compute than TorchTitan on H100s, despite running on devices that have no NVLink or InfiniBand support.
ashley retweeted
The first Protocol Learning workshop in Rio today!
A new field is emerging: decentralized training of foundation models. Because the world’s intelligence belongs in open, collectively owned systems.
Thanks for joining @oguzer90 @niclane7 @m_ryabinin @namhoonlee09 @itsmaddox_j
ashley retweeted
'13. Labs will not be allowed to “escape” to neutral jurisdictions.
We are about to see a 10x in state power simply due to the fact that AI requires centralised, physical datacenters and these can be controlled in a way diffuse human knowledge work cannot.
Important variables to consider when reading the Citrini post:
1. UBI all but guaranteed - debate will be on demand side with compute stipend vs universal basic services
2. US govt would aggressively move to ensure compute is US-centric and allows them to shift pain to ROW
3. Very likely robotics will be ramping by then which will soak-up recently fired knowledge workers to help build ramp
4. Credit markets are the bigger risk vs equities because potential for persistent deflation fuck debt calcs
5. Trump admin would deport 25m illegals before allowing knowledge worker migration to lower-end services turning into a deflationary wage spiral
6. Biotech and material science boom almost guaranteed by then driving spec capital and hiring
7. Out of every country on earth the American consumer is the richest, most resilient and most degenerate. If U.S. consumer is hurting the ROW is dead.
8. Datacenters will be bombed and molotov cocktailed long before things get that dire
9. Govt will be the lender of last resort to high FICO knowledge workers who got laid off
10. Cursor for Trades will be a thing and knowledge workers with AR glasses will be able to career shift far more easily than you would think
11. Disruption of incumbent knowledge workers will destroy demand for many of the denser urban pop centers and “fix” housing affordability crises as distributed work becomes a lot more acceptable …. Will also be a major wealth-effect issue into silver tsunami
12. Supply side taxation will become a thing. Tax on compute. Tax on electricity usage. Tax on racks.
13. Labs will not be allowed to “escape” to neutral jurisdictions. Go to Bahamas the U.S. will annex the Bahamas. This is too big to abide by international law.
- just off the rip on first read 🫡
the interesting thing about being off twitter for 4 years and then getting back online is coming across all the smart friends i made IRL and realizing that i thought they had important jobs but actually all they do is shitpost.
but they are all really funny so thats a bonus
Personally I love that trad tech boys hate Web3 and I advise all of you to stop trying to convince them otherwise
and let them sail away with each other into irrelevancy and obscurity while we do cute new shit unburdened by their allbirds and sweet green aesthetic.
While you all were raving in Portugal I was farming IRL & plotting privacy with @fabioberger123
I’ve now acquired a very rare allocation of freshly minted olive oil straight from the farm (comes with shadowy, but wholesome! coder vibes).
Find me at solanacon for alpha 🫒
ashley retweeted
I have blocked
the canal
that was in
Egypt
and which
you were probably
using
for the global economy
Forgive me
It went sideways
so fast
and out of control
From a friend in response to a group potluck dinner so we can share our rations: “I’m down for dinner but running out of food. Can bring money. Have 1 frozen pizza and 2 cans of Campbell’s soup. Gonna get liquidated soon.”
Someone send an airdrop pls. But for food.
Austin is a frozen dystopian hellscape. 40 hours of no power or heat, below freezing temperatures and the city has run out of food. No gas, no escape. It will continue snowing for the next 48 hours(!?!). No power in sight for most. We are now bartering and trading for supplies.























