Tavis Siebert (@tavis_siebert) profile picture

MS CS @ ETH Zurich

Joined June 2024
The Platonic Representation Hypothesis is now a Theorem ◼️ Train JEPAs separately, on any modalities: they provably learn the same representation up to one rotation. The result? A 109M JEPA-Text model that aligns with vision models better than 72B LLMs. w/ @ylecun 🧵
41
187
30
1,113
84,918
Tavis Siebert retweeted
Your world model may know less about the world than you think. I've always wondered what world models really learn. Humans don't memorize every trajectory. We learn rules we can reuse. Can world models do the same? We built AnyGoal to find out. hazel-heejeong-nam.github.io…
13
27
4
184
10,984
Tavis Siebert retweeted
Preparing for AI Research Scientist interviews? 🔥 We just open-sourced PaperLeet 🐈‍⬛ LeetCode for AI researchers: implement the core of ~100 key papers (llm, rl, diffusion, flow matching, JEPA, world models), graded by tests that check the math. paperleet.com
25
115
12
1,024
107,727
Tavis Siebert retweeted
JEPAs can 𝐧𝐨𝐰 jointly imagine what happens and what to do next! Meet 𝐋𝐞𝐖𝐀𝐌: A JEPA for the real world with 32.3× faster planning, 19 ms per plan Improves success 28.6% → 89.7% on contact-rich manipulations But also ... 🫶 a WAM for everyone with 17M · 1 GPU · 1 hyperparameter Works on a real robot, not just a simulation !! 👉 le-wam.github.io/
27
84
12
729
68,769