Drawing from this work, I used Sonnet to edit 0.0024% of Qwen3.5 0.8B's weights. We improved fabrication, where a higher score means the model invented fewer specifics, from 39.3% to 92.9% . Sonnet also beat LoRA harlyn1.github.io/weight-spaâŠ
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! đ§”
Blog: rikiyat.github.io/blog/weighâŠ
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-spâŠ
github.com/RikiyaT/lm_undâŠ
huggingface.co/Qwen/Qwen3.5-0âŠ
huggingface.co/RikiyaT/Qwen3.âŠ
A community note on X raises a fair point about the original paper. The loop its editor fixed is already documented in Qwenâs model card, and what the edit repaired was repetition in thinking mode rather than math ability. The same question applies to me.
The original paperâs loop fix was in every one of my arms. I handed it to the editors as a starting point and told them to keep it, so it is fair to ask how much of my result is really theirs.
The answer is none of it, even if we were inspired by the original paperâs loop fix. Our fix did not depend on the loop that Qwenâs model card already documents. It targeted a new problem in the weights, a neuron in layer 23 that was supposed to open an answer with âI donât have that informationâ and stayed quiet instead. This was found independently by four of five models we ran. The mechanisms for discovering problems in weights certainly merit additional experimentation.
The Kimi arm is only the loop fix and no additional model edits. It scored 39.3 on fabrication. The untouched model scored 39.3. The math loop fix was not the reason we succeeded at improving fabrication.
34
Your leadership, portfolio, and vision makes the AI ecosystem stronger. Thank you for letting us be a part of the ride !
Personal update: today weâre launching Mission Street Capital.
@SurbhiTodi and I met as housemates at Mission Control, the oldest hacker house in SF, where we lived, breathed, and cooked with the best founders well before anyone knew them.
As hacker houses rise in popularity, theyâre becoming talent clusters for exceptional hackers to meet and work together.
Our fundâs thesis is in identifying brilliant oddball builders emerging out of these talent clusters. Builders recognize other builders.
Our fund is backed by hacker house alumni, technical leaders from OpenAI and Anthropic, and GPs, partners, and emerging managers at the most iconic funds (a16z, CRV, Emergence, Uncork).
Thank you to our LPs including @AriX @thedanigrant @KevinUnkrich @tanzealous @ashvinair @mgrczyk @nikhilthota @SoheilK @jamdac @caitlinbolnick1 @anamitra @DOitChoco @v_maini @aaronligon @crapshoot101 @PachexMix
Proactive Assistant ftw . Congrats @meetlucasai !
We built an AI that saves your ass.
Meet Lucas. Itâs been meaning to text you.
It lives in your texts, learns your life, and prompts itself.
It books, pays, orders and checks you in. Usually before youâve thought of it.
Overnight, it goes exploring for things your life could use.
Text Lucas today on iMessage and WhatsApp
meetlucas.ai
Harlyn E. Pacheco retweeted
We built an AI that saves your ass.
Meet Lucas. Itâs been meaning to text you.
It lives in your texts, learns your life, and prompts itself.
It books, pays, orders and checks you in. Usually before youâve thought of it.
Overnight, it goes exploring for things your life could use.
Text Lucas today on iMessage and WhatsApp
meetlucas.ai
Harlyn E. Pacheco retweeted
Super excited to have gotten early access to Tinker by @thinkymachines! Tinker is great at making it easy to post-train, but also meant I wound up with lots of model checkpoints đ
This is why I built a finetuning journal to keep track of each model iteration, with the help of Claude Code!
Harlyn E. Pacheco retweeted
Rushing McCarl LLP is writing a pro bono amicus brief supporting the University of Michiganâs efforts to block the Big Tenâs suspension of Head Coach Jim Harbaugh. Hundreds of alumni have added their names to the brief. rushingmccarl.com/harbaugh-b⊠#goblue @UMichFootball @mgoblog
cosmopolitan.com/lifestyle/aâŠ
A queer altar.
Heartfelt writing from Fernie .
1
376
Harlyn E. Pacheco retweeted
We are working on a new experiment: âAssistant with Bardâ. Itâs the evolution of Assistant on your phone, combining the âHey Google'' we know today with Bard and the latest Generative AI capabilities.
Read more at: blog.google/products/assistaâŠ
Harlyn E. Pacheco retweeted
Jim Harbaugh is opening his ECU week press conference with a statement on âthe state of college football.â
The big one: He wants a system of revenue sharing with athletes.
âI donât understand how the NCAA, TV networks, conferences and schools can continue to pull in millions off the efforts of college students across the country without sharing ever-increasing revenue.â
I used to fly an American route during which the pilot quoted Nas mid flight and made my day .
âSit back, relax, catch your contact, sip your coâŠâ
2
276
Alphabet
Alfabeto
Teaching âsound it outâ in English inspires requests for flexible spelling. A language that evolves and acquires must also change spelling that arbitrarily creates unnecessary learner friction.
Contextual etimólogy valué <<< early reading ease
210
Harlyn E. Pacheco retweeted
@KyberKnightVC has officially launched! Our founding partners @liang_linus and @SunDhillon recently spoke with @FortuneMagazine to talk about what technologies we are excited about and how we work with our founders.
#VentureCapital #AI
fortune.com/2023/06/12/michaâŠ
Proud of our work on #PixelTablet !
The #PixelTablet is engineered by @Google and available for pre-order later today starting at just $499 đ
P.S. The Charging Speaker Dock is included đ
#GoogleIO
2
297
Harlyn E. Pacheco retweeted
đŁ Applications for the Black Founders Fund in Africa, Brazil, Europe and the United States, as well as our Latino Founders Fund in the US, are now open here: goo.gle/foundersfunds #FundBlackFounders #FundLatinoFounders



















