Luke in action.Sonic 💥 (@LukeInAction1) header
Luke in action.Sonic 💥 (@LukeInAction1) profile picture

Fun things, thoughts, crypto, AI, ML, travel, $M + life. (Not investment advice - do your own research.) $S believer.

New York
Joined January 2021
Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)Photo by Luke in action.Sonic 💥 (@LukeInAction1)
Luke in action.Sonic 💥 retweeted
Excited to release new repo: nanochat! (it's among the most unhinged I've written). Unlike my earlier similar repo nanoGPT which only covered pretraining, nanochat is a minimal, from scratch, full-stack training/inference pipeline of a simple ChatGPT clone in a single, dependency-minimal codebase. You boot up a cloud GPU box, run a single script and in as little as 4 hours later you can talk to your own LLM in a ChatGPT-like web UI. It weighs ~8,000 lines of imo quite clean code to: - Train the tokenizer using a new Rust implementation - Pretrain a Transformer LLM on FineWeb, evaluate CORE score across a number of metrics - Midtrain on user-assistant conversations from SmolTalk, multiple choice questions, tool use. - SFT, evaluate the chat model on world knowledge multiple choice (ARC-E/C, MMLU), math (GSM8K), code (HumanEval) - RL the model optionally on GSM8K with "GRPO" - Efficient inference the model in an Engine with KV cache, simple prefill/decode, tool use (Python interpreter in a lightweight sandbox), talk to it over CLI or ChatGPT-like WebUI. - Write a single markdown report card, summarizing and gamifying the whole thing. Even for as low as ~$100 in cost (~4 hours on an 8XH100 node), you can train a little ChatGPT clone that you can kind of talk to, and which can write stories/poems, answer simple questions. About ~12 hours surpasses GPT-2 CORE metric. As you further scale up towards ~$1000 (~41.6 hours of training), it quickly becomes a lot more coherent and can solve simple math/code problems and take multiple choice tests. E.g. a depth 30 model trained for 24 hours (this is about equal to FLOPs of GPT-3 Small 125M and 1/1000th of GPT-3) gets into 40s on MMLU and 70s on ARC-Easy, 20s on GSM8K, etc. My goal is to get the full "strong baseline" stack into one cohesive, minimal, readable, hackable, maximally forkable repo. nanochat will be the capstone project of LLM101n (which is still being developed). I think it also has potential to grow into a research harness, or a benchmark, similar to nanoGPT before it. It is by no means finished, tuned or optimized (actually I think there's likely quite a bit of low-hanging fruit), but I think it's at a place where the overall skeleton is ok enough that it can go up on GitHub where all the parts of it can be improved. Link to repo and a detailed walkthrough of the nanochat speedrun is in the reply.
669
3,305
731
23,895
5,824,279
Luke in action.Sonic 💥 retweeted
If you cut the Sun or a planet, what would it look like inside: *AI
1,049
7,343
693
51,544
4,425,996
Luke in action.Sonic 💥 retweeted
$S is now live on @Coinbase.
159
431
61
2,320
102,294
Luke in action.Sonic 💥 retweeted
Coinbase will add support for Sonic (S) on the Sonic network. Do not send this asset over other networks or your funds may be lost. Transfers for this asset are available on @Coinbase & @CoinbaseExch in the regions where trading is supported.
140
288
123
1,143
317,686
Luke in action.Sonic 💥 retweeted
100 million transactions achieved. Each with near-instant finality. Zero downtime. Just performance.
92
165
15
1,044
47,237
Luke in action.Sonic 💥 retweeted
The mindset that built Tom Cruise's $600 million empire.
246
4,939
222
33,602
1,746,731
Luke in action.Sonic 💥 retweeted
19,980
39,859
4,539
494,987
80,368,507
Luke in action.Sonic 💥 retweeted
While we wait for Crypto to reset or find direction I'll be using that free time to help people that have lost it all, who want to start a business, and connecting real builders together. I've rebranded my alt to @IncomeStarts to keep the content separate. Trading vs Building.
98
25
1
878
76,981
Luke in action.Sonic 💥 retweeted
Some context for everyone… Tech stocks are currently the most oversold since COVID, and only seven other times since 1988 have we seen more than 55% of stocks within the NASDAQ 100 trading with a 14-day RSI below 30: August 1990 – Iraq War/Oil Spike August 1998 – Russian Default/LTCM September 2001 – 9/11 October 2008 – Lehman Brothers August 2011 – US Debt Downgrade/Eurozone Debt Crisis August 2015 – RMB Devaluation March 2020 – COVID
51
183
11
1,223
122,453
Luke in action.Sonic 💥 retweeted
This week, I am releasing a conversation with @AndreCronjeTech from @SonicLabs ! We go deep into: - South Africa - How he finished 3 years of school computer classes in 8 months - Building Fantom - How Yearn Finance started as a solution that Andre built for himself - Dealing with FUD and Depression - How it felt to receive 10 SEC letters - Why Andre left Twitter for a while but never really left crypto - Why Andre doesn’t believe anymore that people are good - Coming back to bring Sonic to the next level And much more Can’t wait to share this one with ya’ll Out on Thursday! 🚨
33
46
4
357
22,236
Luke in action.Sonic 💥 retweeted
Algorand is bringing real-world assets on-chain. ✈️ Airline Tickets 💰 Currencies 📈 Stocks ⚽️ FIFA World Cup Tickets 🏡 Real Estate ☕ Coffee 🏦 Financial Assets 🏺 Historical Events 🖼️ Art ⚡ Solar Panels 🌊 Water Credits 🏅 Precious Metals 🎶 Music Royalties 🌍 Carbon Credits 🌾 Agriculture ...and more. Algorand is powering real-world adoption, one asset at a time.
31
242
24
814
84,376
Luke in action.Sonic 💥 retweeted
‘No custody’ Limit Orders are now LIVE on @0xSonicLabs ✅ Set your target price and let #OpenOcean handle the rest - Your trade executes automatically when the market hits your. 📈 👉Access limit orders at app.openocean.finance
11
32
2
95
10,440
Luke in action.Sonic 💥 retweeted
Markets are oversold due to tariffs right now. Our Crypto Timing Model anticipates a relief rally on the horizon in Q2, meaning strong cryptos are currently at a discount. The scope and strength of the rally, however, still remain to be seen.
3
2
20
1,230
Luke in action.Sonic 💥 retweeted
FIFA just sold $1.38M worth of NFTs on the Algorand blockchain, in under 3 hours. The @FIFACollect drop featured NFTickets granting holders access to the 2025 Club World Cup and 2026 World Cup. FIFA 🤝 Algorand Real adoption. Real utility.
57
245
45
915
155,550
Luke in action.Sonic 💥 retweeted
We are giving you around 5 hours of FREE live (and on-demand) content very soon. Session one of BOTH of our flagship courses is open-door, meaning everyone is welcome to attend. We even send the recordings to anyone on the list of registrants so you can rewatch them in your own time. Register here... 👇 First session: register.gotowebinar.com/reg… Second session: register.gotowebinar.com/reg…
6
26
2
147
119,466
Luke in action.Sonic 💥 retweeted
State of @SonicLabs Q4 Key Update: Sonic, Fantom's new Layer-1 blockchain, launches with high performance and developer-centric features, positioning itself as a formidable player in the smart contract platform space. QoQ Metrics 📊 • TVL ⬆️ 21x to $565M • DEX volume surpasses $2.3B • 500k users in first 10 days Read the full report 🔗 messari.co/4bKOi5T
21
65
4
266
40,533
Luke in action.Sonic 💥 retweeted
I shared this today at the White House Digital Assets Summit. michael.com/a-digital-assets…
1,106
2,775
343
17,671
1,370,226
Luke in action.Sonic 💥 retweeted
Here's a useful way to categorize tokens -- from network tokens to memecoins, plus a handy flowchart to help figure things out. Token definitions: a16zcrypto.com/posts/article… Company-backed vs. network tokens: a16zcrypto.com/posts/article… by @milesjennings, @skominers, & @eddylazzarin
186
243
59
894
160,312
Luke in action.Sonic 💥 retweeted
Why isn't anyone making a dashboard for @SonicLabs 's incredible growth? While everyone is obsessed with (3, 3), I'll make a three-part dashboard. That's the wizard way 🧙‍♂️ $S Fam LFG🚀 @AndreCronjeTech @Dune dune.com/hashed_official/son…
23
69
7
325
29,347