inference engineering @cartesia // reformed quant
Joined January 2022
- Tweets407
- Following538
- Followers1.4K
- Likes669
flashboy retweeted
imagine what these guys could do with 100 MW of blackwells
I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data.
Language modeling on raw bytes is a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less?
Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.
flashboy retweeted
AI bros discover co-routines 40 years later 😭
AWS just open-sourced a runtime that can fit 75,000 concurrent AI agents in 8GB of RAM.
the trick is that agents don’t sit around consuming resources while waiting for tools to finish. the runtime saves their state, suspends them, and resumes them when something happens.
75,000 agents. raspberry pi 5 memory.
that number is kinda ridiculous.
flashboy retweeted
Joining Big Tech is risky. Just join an elite startup instead.
They pay almost the same, but startups offer a ticket to generational wealth. And don’t tell me most startups fail. You can choose wisely.
50 Startups hiring last week (sorted desc by volume)
1. @grafana
2. @SierraPlatform
3. @ElevenLabs
4. @AtomsHQ
5. @SavvyWealthInc
6. @Hadrian
7. @1Password
8. @VardaSpace
9. @NormalComputing
10. @chainguard_dev
11. @WeAreLegora
12. @trmlabs
13. Neko
14. @Apex_Spacecraft
15. Alice & Bob
16. @cusp_ai
17. @DeepgramAI
18. Omnea
19. @PrimeIntellect
20. @HappyRobot
21. @withshepherd
24. @cohere
25. @joinpogo
26. @temporalio
27. @meter
28. @K2SpaceCo
29. @1x_tech
30. @baseten
31. @mercury
32. @n8n_io
33. Nourish
34. @omni
35. @vast
36. @ashbyhq
37. Northwood
38. @Etched
39. @suno
40. @Get_Writer
41. @generalmatter
42. @RogoAI
43. @StuutAI
44. @linear
45. @LangChain
46. @arq_finance
47. @DiracInc
48. @ExaAILabs
49. @FactoryAI
50. @Lovable
List curated using Jobbie.
flashboy retweeted
Cartesia Managed Agents scores an Elo of 1115 on the Artificial Analysis Speech Agent Arena, 98 points above Cartesia's earlier voice agent product, Cartesia Line, with Task Success Rate up from 77.5% to 91.7%
Managed Agents is @CartesiaAI's fully managed platform for building and deploying voice agents. It is a cascaded system: Cartesia's own Ink Speech to Text and Sonic Text to Speech models run around an LLM of the developer's choice. We evaluated Cartesia Managed Agents with GPT-5.5 as the LLM and the Skylar and Daniel voices.
Key takeaways:
➤ Speech Agent Arena: Cartesia Managed Agents scores an Elo of 1115 (95% CI 1086-1144, 685 samples), 98 points above Cartesia Line at 1017 (95% CI 985-1049)
➤ Agentic tasks: On tasks that need tool calls, Cartesia Managed Agents scores an Elo of 1112
➤ Task Success Rate: 91.7% of eligible tool-calling conversations end with the correct final task-completing tool call
Congrats to the @CartesiaAI team!
See below for more details ⬇️
flashboy retweeted
Ok you’re all going to keep your jobs after all.
flashboy retweeted
i understand why people use partiful but i deeply hate it. only thing it's good at is making people feel like going to your party is going to be a huge pain in the ass and emphasizing how nonessential their attendance is. text your friends and keep an RSVP list in your notes app.
flashboy retweeted
Those in venture, product, media etc. inevitably live in the Nontechnical North
The few engineers here are aesthetes capable of eye contact (spiritually nontechnical)
Tale as old as time: capitalist class in the north, and the oppressed labor class (openai researchers) pushed south
Good software engineers see AI as a tool to build more
Good mathematicians see AI as an extinction event
Tells you a lot about the state of academia
Why is everyone having a meltdown about this? AI didn’t learn some new factoring algo, it ported some code to run on GPUs and ran it on a ridiculous amount of compute
636606729769440499166579950236036751749912014371509557713570027508971809534551913252252094954941974952859310861988904737359709200557919
is a factor of RSA-896
saweis.net/posts/rsa-896.htm…
flashboy retweeted
If all these ex Messari employees had spent as much time building the company as they do now pushing their bags Selkis would have the money to be running Germany
