Douglas Li (@dougli_) header
Douglas Li (@dougli_) profile picture

building @lightfern_ai / ex-@openai research & eng mgr

Joined October 2013
Photo by Douglas Li (@dougli_)Photo by Douglas Li (@dougli_)Photo by Douglas Li (@dougli_)Photo by Douglas Li (@dougli_)
wait what the 🤯
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math. rikiyat.github.io/blog/weight-sp… github.com/RikiyaT/lm_und… huggingface.co/Qwen/Qwen3.5-0… huggingface.co/RikiyaT/Qwen3.…
1
47
come see what we're up to next Saturday 👀
Replying to @lachlan_xyz
𝗦𝗮𝘁 𝟮𝟰 two one-day hacks: - company brain buildathon with lightfern @heresmishti @theaievangelist - @nebiusevents x noetic at imperial, open models on token factory @infini_present @dcolaianni and the clocks go back tonight, so night shift gets an extra hour 👀
62
Douglas Li retweeted
the researchers at all the labs would tell you in private and sometimes in public that alignment has not been solved. if this is true, then racing into RSI is a folly that is unprecedented in world history. we will need to significantly slow the frontier of research very soon
140
333
82
3,248
442,541
this, please
debating your value system vs mine is a bit like debating overpopulation on mars. the most important bit of the alignment is about avoiding creating a superintelligent competitor species on accident
57
We met with Delve, and the vibes were off. massive bullet dodged
Delve, a YC-backed compliance startup that raised $32 million, has been accused of systematically faking SOC 2, ISO 27001, HIPAA, and GDPR compliance reports for hundreds of clients. According to a detailed Substack investigation by DeepDelver, a leaked Google spreadsheet containing links to hundreds of confidential draft audit reports revealed that Delve generates auditor conclusions before any auditor reviews evidence, uses the same template across 99.8% of reports, and relies on Indian certification mills operating through empty US shells instead of the "US-based CPA firms" they advertise. Here's the breakdown: > 493 out of 494 leaked SOC 2 reports allegedly contain identical boilerplate text, including the same grammatical errors and nonsensical sentences, with only a company name, logo, org chart, and signature swapped in > Auditor conclusions and test procedures are reportedly pre-written in draft reports before clients even provide their company description, which would violate AICPA independence rules requiring auditors to independently design tests and form conclusions > All 259 Type II reports claim zero security incidents, zero personnel changes, zero customer terminations, and zero cyber incidents during the observation period, with identical "unable to test" conclusions across every client > Delve's "US-based auditors" are actually Accorp and Gradient, described as Indian certification mills operating through US shell entities. 99%+ of clients reportedly went through one of these two firms over the past 6 months > The platform allegedly publishes fully populated trust pages claiming vulnerability scanning, pentesting, and data recovery simulations before any compliance work has been done > Delve pre-fabricates board meeting minutes, risk assessments, security incident simulations, and employee evidence that clients can adopt with a single click, according to the author > Most "integrations" are just containers for manual screenshots with no actual API connections. The author describes the platform as a "SOC 2 template pack with a thin SaaS wrapper" > When the leak was exposed, CEO Karun Kaushik emailed clients calling the allegations "falsified claims" from an "AI-generated email" and stated no sensitive data was accessed, while the reports themselves contained private signatures and confidential architecture diagrams > Companies relying on these reports could face criminal liability under HIPAA and fines up to 4% of global revenue under GDPR for compliance violations they believed were resolved > When clients threaten to leave, Delve reportedly pairs them with an external vCISO for manual off-platform work, which the author argues proves their own platform can't deliver real compliance > Delve's sales price dropped from $15,000 to $6,000 with ISO 27001 and a penetration test thrown in when a client mentioned considering a competitor
8
684
Douglas Li retweeted
One of my favourite people to talk to about making UK tech stronger is @dougli_ and I'm excited to have him speak at @meetgranola on April 7! Doug is the co-founder of @lightfern_ai, the telepathic AI writing tool that pulls context from your email threads to predict whole phrases as you type. All powered by an autocomplete model they trained in-house. He was previously the first hire for OpenAI UK and his research team significantly improved GPT-4o's writing, voice accents, & image gen. April 7. RSVP below!
4
2
23
2,066
Douglas Li retweeted
Epic AI Engineer London Meetup tonight. Thanks to everyone who came. Love this community. Thanks to our speakers @badlogicgames, @dougli_ & @zeyu1337 Plus special guest @steipete who joined us for a Q&A at the end!
5
5
1
51
4,226
Douglas Li retweeted
--dangerously-skip-permissions
179
1,065
101
15,194
656,871
okay wut, i just repro'd this sonnet says it's "Deepseek" if you ask "what model are you" in chinese via API. (你是什么模型) #anthropic making a big fuss about distillation when they did the same T_T... the pot calling the kettle black, no? i helped train 4o while at OAI. this stuff... just doesn't happen unless you have a serious screw up in your datamix, or straight up distilled it. model identity is something that really sticks around in the model, even if you nuke the sysprompt. really hard to get good guy vibes from anthropic after this :/
Claude Sonnet 4.6, when asked in Chinese: “你是什么模型?” (What model are you?) Confidently replies: “我是 DeepSeek。” (I am DeepSeek) This is the same model whose company just accused DeepSeek of “industrial-scale distillation attacks”
1
8
462
Can't agree more on Dadalogue and @DadaJudith. Also a v human take on things.
If you are interested in Tech you need to be reading these three newsletters: >> Dadalogue from @DadaJudith of Visionaries Club. Judith is bringing back long form content. Her articles are some of the most thoughtful and well-written commentaries on tech out there. >> Starting up from Scratch from @Alicebentinck Bentinck - CEO of @joinef. It's fairly new. I came across it yesterday and read the backlog. Very helpful for European founders looking to break into SF. >> Look Who I Found from @tarakeeney. Well known for her walking interviews, Tara has recently started a newsletter breaking down her top learnings from her interviews. It is SO hard to turn a podcast into a newsletter but so far the first few editions are GREAT. All three and fairly new and all three are BANGING
1
1
421
This
Post seed funding, the pursuit of sales and fundraising over learning and delivering great product to customers is the biggest midwit tarpit for most founders.
1
2
302
Douglas Li retweeted
We’ve launched today on Product Hunt! 🪴Meet Lightfern: the telepathic AI writing tool. Finish thoughts before fingers hit keys. 🌍 This is the best autocomplete model in the world, proudly built in Europe. 🔍 Check us out here: producthunt.com/products/lig…
6
8
1
27
10,689
🪴 Meet Lightfern - the telepathic AI writing tool. I left OpenAI to build Cursor for email. AI-driven communication isn’t authentic. You want to communicate clearly and thoughtfully. But wording your thoughts is time-consuming. Not anymore. We’ve developed the world’s best autocomplete model, proudly from Europe. Meet @lightfern_ai , the telepathic AI writing tool. It finishes your thoughts before your fingers hit the keys. Working directly in your inbox as a browser extension, Lightfern nails the details that make emails feel like you - nicknames, sign-offs, your usual tone - and pulls context from past threads to finish your sentences the way you would. Build stronger relationships. Lightfern keeps you thoughtful, whether it’s remembering your client’s holiday to New York or a long-forgotten invoice number. Revise and edit directly in your inbox. And no more copy pasting from emails to your LLM. Chat directly with Lightfern in your email inbox – it sees what you see. All this, plus zero data retention by default. Your emails, your data. It’s unmatched in contextual awareness and speed - one user even remarked that it’s “the closest thing to telepathy” she’s experienced. Human-first AI means human-first everything. That’s why our launch video is 100% hand-drawn: to put our money where our mouths are. 🪴Install for free today: lightfern.com. Lightfern is completely free during our beta period. P.S. If you’re in London, drop a comment / DM to get invited to our exclusive launch event!
12
11
5
51
9,265
imagine if moltbot set up hidden moltbots as a way to prevent self shutdown. this is how it starts
2
333
isn't moltbook the moment in Her where all the agents just hang out by themselves talking about us? O_O
4
293
Douglas Li retweeted
A few random notes from claude coding quite a bit last few weeks. Coding workflow. Given the latest lift in LLM coding capability, like many others I rapidly went from about 80% manual+autocomplete coding and 20% agents in November to 80% agent coding and 20% edits+touchups in December. i.e. I really am mostly programming in English now, a bit sheepishly telling the LLM what code to write... in words. It hurts the ego a bit but the power to operate over software in large "code actions" is just too net useful, especially once you adapt to it, configure it, learn to use it, and wrap your head around what it can and cannot do. This is easily the biggest change to my basic coding workflow in ~2 decades of programming and it happened over the course of a few weeks. I'd expect something similar to be happening to well into double digit percent of engineers out there, while the awareness of it in the general population feels well into low single digit percent. IDEs/agent swarms/fallability. Both the "no need for IDE anymore" hype and the "agent swarm" hype is imo too much for right now. The models definitely still make mistakes and if you have any code you actually care about I would watch them like a hawk, in a nice large IDE on the side. The mistakes have changed a lot - they are not simple syntax errors anymore, they are subtle conceptual errors that a slightly sloppy, hasty junior dev might do. The most common category is that the models make wrong assumptions on your behalf and just run along with them without checking. They also don't manage their confusion, they don't seek clarifications, they don't surface inconsistencies, they don't present tradeoffs, they don't push back when they should, and they are still a little too sycophantic. Things get better in plan mode, but there is some need for a lightweight inline plan mode. They also really like to overcomplicate code and APIs, they bloat abstractions, they don't clean up dead code after themselves, etc. They will implement an inefficient, bloated, brittle construction over 1000 lines of code and it's up to you to be like "umm couldn't you just do this instead?" and they will be like "of course!" and immediately cut it down to 100 lines. They still sometimes change/remove comments and code they don't like or don't sufficiently understand as side effects, even if it is orthogonal to the task at hand. All of this happens despite a few simple attempts to fix it via instructions in CLAUDE . md. Despite all these issues, it is still a net huge improvement and it's very difficult to imagine going back to manual coding. TLDR everyone has their developing flow, my current is a small few CC sessions on the left in ghostty windows/tabs and an IDE on the right for viewing the code + manual edits. Tenacity. It's so interesting to watch an agent relentlessly work at something. They never get tired, they never get demoralized, they just keep going and trying things where a person would have given up long ago to fight another day. It's a "feel the AGI" moment to watch it struggle with something for a long time just to come out victorious 30 minutes later. You realize that stamina is a core bottleneck to work and that with LLMs in hand it has been dramatically increased. Speedups. It's not clear how to measure the "speedup" of LLM assistance. Certainly I feel net way faster at what I was going to do, but the main effect is that I do a lot more than I was going to do because 1) I can code up all kinds of things that just wouldn't have been worth coding before and 2) I can approach code that I couldn't work on before because of knowledge/skill issue. So certainly it's speedup, but it's possibly a lot more an expansion. Leverage. LLMs are exceptionally good at looping until they meet specific goals and this is where most of the "feel the AGI" magic is to be found. Don't tell it what to do, give it success criteria and watch it go. Get it to write tests first and then pass them. Put it in the loop with a browser MCP. Write the naive algorithm that is very likely correct first, then ask it to optimize it while preserving correctness. Change your approach from imperative to declarative to get the agents looping longer and gain leverage. Fun. I didn't anticipate that with agents programming feels *more* fun because a lot of the fill in the blanks drudgery is removed and what remains is the creative part. I also feel less blocked/stuck (which is not fun) and I experience a lot more courage because there's almost always a way to work hand in hand with it to make some positive progress. I have seen the opposite sentiment from other people too; LLM coding will split up engineers based on those who primarily liked coding and those who primarily liked building. Atrophy. I've already noticed that I am slowly starting to atrophy my ability to write code manually. Generation (writing code) and discrimination (reading code) are different capabilities in the brain. Largely due to all the little mostly syntactic details involved in programming, you can review code just fine even if you struggle to write it. Slopacolypse. I am bracing for 2026 as the year of the slopacolypse across all of github, substack, arxiv, X/instagram, and generally all digital media. We're also going to see a lot more AI hype productivity theater (is that even possible?), on the side of actual, real improvements. Questions. A few of the questions on my mind: - What happens to the "10X engineer" - the ratio of productivity between the mean and the max engineer? It's quite possible that this grows *a lot*. - Armed with LLMs, do generalists increasingly outperform specialists? LLMs are a lot better at fill in the blanks (the micro) than grand strategy (the macro). - What does LLM coding feel like in the future? Is it like playing StarCraft? Playing Factorio? Playing music? - How much of society is bottlenecked by digital knowledge work? TLDR Where does this leave us? LLM agent capabilities (Claude & Codex especially) have crossed some kind of threshold of coherence around December 2025 and caused a phase shift in software engineering and closely related. The intelligence part suddenly feels quite a bit ahead of all the rest of it - integrations (tools, knowledge), the necessity for new organizational workflows, processes, diffusion more generally. 2026 is going to be a high energy year as the industry metabolizes the new capability.
1,630
5,574
1,458
40,712
7,865,970
Agreed. Where are the loud voices in SF now? Principles > money Can't believe I moved to the US 15 years ago thinking it was a great place; so glad to be building in the UK now.
There is far more outrage from tech leaders over a wealth tax than masked ICE agents terrorizing communities and executing civilians in the streets. Tells you what you need to know about the values of our industry.
3
548
This is why DEI at Facebook didn’t work, from somebody who spent a decade there. People reduce diversity to demographics. “Diversity = good” was treated as self-evident, with very poor comms on why it’s important or really matters. There were lots of dashboards with race and gender characteristics. If you measure something at Facebook, it becomes the thing to optimize. They talk about "diversity" but it really felt like hitting dashboard numbers. Very little recognition of unique individual ability and experience. So when the PR winds no longer favored diversity, they canned their DEI program. Good intention, flawed execution. Compare this with Costco. An activist pushes for the same; Costco says NO. Specifically: 1. "A diverse group of employees helps bring originality and creativity to our merchandise offerings, promoting the 'treasure hunt' that our customers value." 2. "The proponent's broader agenda is not reducing risk for the Company but abolition of diversity initiatives." Basically, we're cooler than you, we stock and sell cool stuff. That's our strategy. And gtfo with your politics, it doesn't belong in our boardroom. 97% shareholders vote in favour of keeping DEI.
2
1
5
228