Harlyn E. Pacheco (@PachexMix) header
Harlyn E. Pacheco (@PachexMix) profile picture

Tied for third place in NPR Planet Money pick a number game. Angel investor-ish. 🇹🇮 + . Go Blue

Dallas, Berkeley, Latam
Joined September 2011
Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)Photo by Harlyn E. Pacheco (@PachexMix)
Drawing from this work, I used Sonnet to edit 0.0024% of Qwen3.5 0.8B's weights. We improved fabrication, where a higher score means the model invented fewer specifics, from 39.3% to 92.9% . Sonnet also beat LoRA harlyn1.github.io/weight-spa

We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! đŸ§” Blog: rikiyat.github.io/blog/weigh

Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math. rikiyat.github.io/blog/weight-sp
 github.com/RikiyaT/lm_und
 huggingface.co/Qwen/Qwen3.5-0
 huggingface.co/RikiyaT/Qwen3.

2
1
7
429
A community note on X raises a fair point about the original paper. The loop its editor fixed is already documented in Qwen’s model card, and what the edit repaired was repetition in thinking mode rather than math ability. The same question applies to me. The original paper’s loop fix was in every one of my arms. I handed it to the editors as a starting point and told them to keep it, so it is fair to ask how much of my result is really theirs. The answer is none of it, even if we were inspired by the original paper’s loop fix. Our fix did not depend on the loop that Qwen’s model card already documents. It targeted a new problem in the weights, a neuron in layer 23 that was supposed to open an answer with “I don’t have that information” and stayed quiet instead. This was found independently by four of five models we ran. The mechanisms for discovering problems in weights certainly merit additional experimentation. The Kimi arm is only the loop fix and no additional model edits. It scored 39.3 on fabrication. The untouched model scored 39.3. The math loop fix was not the reason we succeeded at improving fabrication.
34
Your leadership, portfolio, and vision makes the AI ecosystem stronger. Thank you for letting us be a part of the ride !
Personal update: today we’re launching Mission Street Capital. @SurbhiTodi and I met as housemates at Mission Control, the oldest hacker house in SF, where we lived, breathed, and cooked with the best founders well before anyone knew them. As hacker houses rise in popularity, they’re becoming talent clusters for exceptional hackers to meet and work together. Our fund’s thesis is in identifying brilliant oddball builders emerging out of these talent clusters. Builders recognize other builders. Our fund is backed by hacker house alumni, technical leaders from OpenAI and Anthropic, and GPs, partners, and emerging managers at the most iconic funds (a16z, CRV, Emergence, Uncork). Thank you to our LPs including @AriX @thedanigrant @KevinUnkrich @tanzealous @ashvinair @mgrczyk @nikhilthota @SoheilK @jamdac @caitlinbolnick1 @anamitra @DOitChoco @v_maini @aaronligon @crapshoot101 @PachexMix
1
1
1
4
882
Proactive Assistant ftw . Congrats @meetlucasai !
We built an AI that saves your ass. Meet Lucas. It’s been meaning to text you. It lives in your texts, learns your life, and prompts itself. It books, pays, orders and checks you in. Usually before you’ve thought of it. Overnight, it goes exploring for things your life could use. Text Lucas today on iMessage and WhatsApp meetlucas.ai
1
1
1
501
Harlyn E. Pacheco retweeted
We built an AI that saves your ass. Meet Lucas. It’s been meaning to text you. It lives in your texts, learns your life, and prompts itself. It books, pays, orders and checks you in. Usually before you’ve thought of it. Overnight, it goes exploring for things your life could use. Text Lucas today on iMessage and WhatsApp meetlucas.ai
234
307
90
974
1,366,430
Harlyn E. Pacheco retweeted
A SoirĂ©e in the Mission✹
3
5
53
9,625
C.R.E.A.M. Context 
 [compacting our 
 everything ? until 
 ]
1
123
Harlyn E. Pacheco retweeted
Super excited to have gotten early access to Tinker by @thinkymachines! Tinker is great at making it easy to post-train, but also meant I wound up with lots of model checkpoints 😅 This is why I built a finetuning journal to keep track of each model iteration, with the help of Claude Code!
38
40
9
834
69,590
Harlyn E. Pacheco retweeted
Rushing McCarl LLP is writing a pro bono amicus brief supporting the University of Michigan’s efforts to block the Big Ten’s suspension of Head Coach Jim Harbaugh. Hundreds of alumni have added their names to the brief. rushingmccarl.com/harbaugh-b
 #goblue @UMichFootball @mgoblog
34
51
18
263
104,917
Harlyn E. Pacheco retweeted
We are working on a new experiment: “Assistant with Bard”. It’s the evolution of Assistant on your phone, combining the “Hey Google'' we know today with Bard and the latest Generative AI capabilities. Read more at: blog.google/products/assista

7
10
3
43
13,656
Jim Harbaugh is opening his ECU week press conference with a statement on “the state of college football.” The big one: He wants a system of revenue sharing with athletes. “I don’t understand how the NCAA, TV networks, conferences and schools can continue to pull in millions off the efforts of college students across the country without sharing ever-increasing revenue.”
84
231
170
1,654
717,227
R.C.R.E.A.M. Retention curves 

197
I used to fly an American route during which the pilot quoted Nas mid flight and made my day . ‘Sit back, relax, catch your contact, sip your co
’
2
276
Alphabet Alfabeto Teaching ‘sound it out’ in English inspires requests for flexible spelling. A language that evolves and acquires must also change spelling that arbitrarily creates unnecessary learner friction. Contextual etimĂłlogy valuĂ© <<< early reading ease
210
Proud of our work on #PixelTablet !
The #PixelTablet is engineered by @Google and available for pre-order later today starting at just $499 🎉 P.S. The Charging Speaker Dock is included 😎 #GoogleIO
2
297