Lucas Thil (@ThilLucas) header
Lucas Thil (@ThilLucas) profile picture

PhD candidate @Polytechnique, world model representations, predictive maintenance, prev cofounder https://nitter.gq/t.co/cjqlxe7McZ

Joined January 2021
Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)Photo by Lucas Thil (@ThilLucas)
Lucas Thil retweeted
Google, Anthropic, and Databricks were all started by founders with PhDs. But they’re exceptions to the rule. Many of the instincts that help researchers succeed in academia can often work against them when building a startup. YC Visiting Partner @FrancoisChauba1 knows both worlds. He’s currently a PhD student, previously did research in Fei-Fei Li’s lab, and founded and ran Focal Systems (W16). In this episode of Startup School, Francois breaks down 10 mindset shifts researchers need to make to become formidable founders, from learning to thrive without grades or deadlines to distinguishing interesting problems from important ones, moving faster with imperfect information, and starting with what customers actually want. 00:53 - Vanity metrics vs. what people want 01:45 - Interesting vs. important 02:27 - Novelty vs. plagiarism 03:54 - There is no finish line 04:32 - Get on a plane and talk to people 05:53 - Hyperbole is okay 06:28 - The 70% rule 07:11 - You can't delegate the hard stuff 07:52 - Become a capitalist 08:16 - Nobody cares how smart you are 09:04 - Get out of your office
50
51
13
375
43,093
Lucas Thil retweeted
I think the last month might have been the biggest month in (zeroth-order) optimization history. In the 10 days since we released the Noise speedrun, the time to pretrain a transformer went from 1.76 hours to 1.6 seconds, a 4,000x (!!!) speedup. Dust itself was up to 10,000x more compute-efficient than the previous state-of-the-art. Not only can we pretrain a transformer without backprop, it's much more efficient than anyone would've expected. Search fking works! Now, scaling is the biggest open question. Some of the tricks that brought the time down to 1.6 seconds will simply not scale. To discard those, we'll be scaling the dataset every time it gets overfit, starting with 30M tokens instead of 10M. Huge thanks to @jayden_teoh_, @spicey_lemonade, @RobertTLange, @EmanueleRodola, @ChunyuanDeng, @LuochengHuman, @Alaxarr, @pavleculafic, @IsaacYong13, Euraba and areu01or00 (GitHub), for the contributions. And @cs_serdar for gracefully maintaining the speedrun and @bishmdl76 for helping out. Expect a lot more from us over the coming weeks.
54
142
50
1,502
238,925
Lucas Thil retweeted
« Ce n’est que du matériel, ils ont juste à faire jouer les assurances, pas de quoi en faire un drame. » Il faut n’avoir absolument aucune conscience de ce qu’est être commerçant ou entrepreneur pour dire un truc pareil. Voir son outil de travail partir en fumée, c’est traumatisant. Voir ses économies investies dans un commerce qui met parfois des années à rapporter un maigre salaire, c’est violent. Beaucoup ont en plus été frappés, blessés, humiliés. Les assurances ? Si les petits commerces arrivent à se faire rembourser une partie des pertes, ce sera déjà une victoire. Elles ne couvriront pas tout, si elles couvrent quelque chose, et ce sera un enfer administratif et judiciaire pour beaucoup de victimes, ajoutant au traumatisme. Ce n’est pas « que du matériel ». Ce sont des vies brisées, des violences physiques et psychologiques, qui auront des conséquences. Rien ne justifie cela. Aucun motif politique. Il n’y en a pas, ce sont juste des pillages, tout le monde le sait. Ceux qui essayent de minorer ou de justifier cette violence (qui touche d’ailleurs des gens souvent modestes, dont la vie va être encore plus difficile désormais) s’en rendent complices.
853
4,415
310
24,134
1,206,888
The ideal outcome for science isn't a couple of labs using proprietary models and millions of dollars to crack trophy problems, it's to have millions of AI-aided human scientists who follow their curiosity and become way more ambitious
160
344
56
2,650
92,016
You can't solve real-world physical tasks through autoregressive sampling alone. The physical world is entirely unforgiving to hallucination or approximate pattern matching. If we want actual autonomous robotics we have to engineer causality and discrete reasoning back into the loop. Biwei and the team at Aether AI is doing exactly the kind of foundational, non-consensus work the field actually needs right now.
I have spent more than a decade studying causality. For me, causality is about understanding the rules that govern how actions change the world, and reasoning about their consequences before acting. Scaling has made today's models remarkably capable at spotting patterns and predicting what comes next. A system that acts in the physical world needs more. It has to ask what will happen if it acts, check the outcome, and adapt when reality doesn't match the plan. In the physical world, trial and error can be costly or unsafe, and an early mistake can carry through the rest of a task. When we started Aether AI, robotics was the obvious place to begin. CRIS-0 is our first integrated system built on these ideas. It tracks the conditions that matter for a task, predicts how each action will change them, and replans when something unexpected happens. In our demo, that means taking a metal can off a plate before heating it, and telling an empty can from an unfinished drink while tidying a room. Physical AI is just our first proving ground. We're building towards causal intelligence that also works for forecasting, scientific discovery, and more. The technical write-up is linked in the comments.
73
89
16
850
70,331
Lucas Thil retweeted
Nous sommes en 1958 et personne à Colombey…..
18
27
4
201
18,595
« Revendiquer le droit d'étudier dans de bonnes conditions » ? L'Occident a produit les plus grands physiciens de l'Histoire avec des pupitres et des chaises en bois, un professeur et un tableau noir. Il leur faut quoi à ces lycéens ? Un accélérateur de particules par classe ?
Il est absolument impossible de faire société avec des gens qui trouvent ça normal qu'on tire au LBD dans le visage de lycéens qui revendiquent le droit d'étudier dans de bonnes conditions. C'est impossible, on ne fera pas société avec vous.
43
46
11
658
26,405
Ok let me explain how cool this is from my perspective , please RT! I developed one of the first methods to probe RNA structure in high throughput inside living cells, and it takes tons of time and $$ to apply on thousands of viruses - it’s practically impossible. This ML approach is just as good and works in seconds for nearly free ! Not only that, it highlights the MOST IMPORTANT structures that track with function. It’s the future of RNA strucute prediction and discovery across all families 🔥 biorxiv.org/content/10.64898…
6
71
5
268
50,356
Lucas Thil retweeted
Picornaviruses infect 10’s of millions of children every year. We know the sequences but not the structures. Mapping them is key in understanding how they function. So, we mapped all the sequences of Picornaviruses we could find. ~75’000 Structures. Enjoy, it's all Open Source
9
14
5
87
13,571
Lucas Thil retweeted
Borges predicted this.
Map Showing The Maximum PDF Document Size Of 15 million x 15 million Inches brilliantmaps.com/max-pdf-si…
10
250
3
3,012
104,566
Lucas Thil retweeted
Si de Gaulle était là en 2026 il prendrait 50 milliards des retraites pour les mettre dans l'IA parce qu'il comprendrait tout de suite l'enjeu historique de cette technologie.
49
136
7
3,184
92,873
Lucas Thil retweeted
Replying to @SakanaAILabs
Nice! This ends up being a version of what some of us have called "target prop": every layer's input is a free latent variable that serves as a target for the previous layer. As this paper points out, this can be derived from an "augmented Lagrangian" formulation of backprop in which the constraints (input of layer k+1 = output of layer k) are turned into penalties (divergence between input of layer k+1 and output of layer k). I've always hoped more people would pick up on this idea. I'm happy this is happening! I must say though that target prop, in the end, optimizes the same criterion as backprop and does the same thing as backprop while evaluating the gradient in a different way, perhaps more biologically plausible. My lab did some work on this idea in the context of "sparse auto-encoders" in the late 2000s. It turns out when the code in an auto-encoder is regularized (e.g. with L1 to make it sparse) target prop seems more efficient than backprop. scholar.google.com/citations…
20
54
5
624
51,072
Lucas Thil retweeted
28
887
21
9,598
134,540
Lucas Thil retweeted
I gave the fly brain $100 to trade bitcoin. Dopamine neurons are stimulated when the fly makes profit. Neuron activity controls buy/sell decisions and makes trades on coinbase. Will the fly get rich?
676
2,127
789
30,115
4,167,887
the fly is using the blinkers 😭
226
1,045
550
16,964
3,010,873
Lucas Thil retweeted
Our group discovered that reasoning models produce fractals when asked to solve hard problems. We can use nonlinear dynamics to probe the thinking processes of recurrent depth models on Sudoku, mathematics, and even ARC-AGI (1/N) arxiv.org/abs/2609.04963
112
623
126
4,710
462,704
> About to go to bed > Check Twitter > Navier-Stokes is solved and everyone is angry
43
329
20
9,727
179,114