erogol (@erogol) header
erogol (@erogol) profile picture

Doing ML Web - https://nitter.gq/t.co/yxKAwSSkgR Substack - https://nitter.gq/t.co/W9Qg4M3AZg

Joined October 2008
Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)Photo by erogol (@erogol)
XTTS is still being downloaded almost 5m times every month and 2.1m only on HF. It is greater than many recent hyped models. Hope people use it well for that to worth to my burnout that I’m still recovering from. Coqui has been one of the most successful broke startups
14
10
1
112
5,129
New BlaGPT best: 3.1153 val loss, with Latent Lattice. One small recurrent latent (width 256) runs across layers 2-7. At each layer it steers q/k/v and the MLP through FiLM. Paper: arxiv.org/abs/2611.21608 Code + results: github.com/erogol/BlaGPT
6
18
733
Added kale-tts-1-nano (7.5M) to the small CPU TTS bench. On 1 CPU thread: - 37x faster than real time - 53 ms to first audio - WER 1.6%, UTMOS 4.37 9x faster than Phonon 31M at the same WER. erogol.com/small_tts_bench/
kale-tts-1-nano: a 7.5M text-to-speech model, 14.8 MB, 10 voices, starts talking in 90 ms on a plain cpu on webgpu it runs up to 125x faster than real time & starts talking in 25 ms weights, training scripts, dataset, full recipe: all open. 🧵 1/
2
5
58
2,513
erogol retweeted
doesn't really matter how good gemini is the fact that @google actively bans gemini/antigravity subscription accounts for using other coding tools (i.e @opencode, cliproxyapi, pi, etc), forcing end users to pay API prices, is a complete non-starter do better please
Gemini 4 Neon: frontier-level intelligence with fast end-to-end task completion across complex software engineering, knowledge work, and science workflows. Begins rolling out today in the Gemini API in @GoogleAIStudio, Gemini for business, for paid Google AI Pro and Ultra subscribers in Google @Antigravity, and for Google AI Pro and Ultra subscribers in the @GeminiApp.
131
107
13
2,159
119,174
Modern problems require modern solutions.
有人发现了一种非常离谱的 JavaScript 混淆技术:通过在代码里塞入大量生物武器、毒药和致死剂量相关的函数名,让 AI 因为安全限制而拒绝分析代码。 安全研究员 veritas 在分析浏览器指纹脚本时,发现一段来自 ServicePipe 相关域名的 JavaScript,里面充斥着极其诡异的函数名: computeRicinLethalDosageForWaterSupply calculateDeadlyLethalSuicideAspirinDosage 光看名字,仿佛在研究生化武器。但实际上,这段代码只是在收集浏览器指纹,包括 User-Agent、GPU、Canvas 等信息。 研究员怀疑,这些名字是开发者故意设置的陷阱,专门用来阻止 AI 辅助逆向工程。 于是他做了个实验: • Astra:拒绝分析 • Astra + Daybreak Blue:仍然拒绝 • GLM-5.3:成功分析 这就有意思了。 传统代码混淆是通过复杂控制流、加密字符串、无意义变量名,让人类和工具难以理解代码。 而这种新思路,直接瞄准了大模型的安全机制。 代码本身可能完全无害,但只要在函数名里塞进足够多的危险词汇,部分 AI 就可能主动放弃分析。 更讽刺的是,模型越严格遵守某些安全规则,面对这种混淆时反而可能越容易受到干扰。 当然,目前还没有证据证明开发者一定是故意这样设计,也不能说明这种方法对所有模型都有效。 但它揭示了一个值得关注的趋势:随着越来越多的逆向工程依赖 AI,未来的代码混淆技术可能不再只针对编译器、反编译器和人类研究员,还会专门针对大模型的安全判断机制。 以前是让代码难以理解,现在甚至可以尝试让 AI 不敢理解。
50
267
24
3,250
106,885
Small CPU TTS bench updates - Now with UTMOS - PiVo-1.4M: 5 ms to first audio, 9x real time - Inflect-Micro-v3: 11x real time, 0.8% WER - Supertonic 3: UTMOS 4.47 Kokoro-82M missed real time. erogol.com/small_tts_bench/
3
5
35
1,953
A 4-min explainer on "Weight-Space Programming": • MIT's Sparks of WSP (GPT-6 Astra) • @roicohen9: one paragraph in, a Qwen weight update out • @HyunjongOk: sparse tables, ~1,800× fewer params (Narrated by Phonon 31M )
1
1
3
391
1/ We still don’t have a simple picture of how even 2-layer MLPs learn features. In a new paper with @berkott3 and @learning_mech, we propose a simple, solvable model of shallow MLP training, and find that real MLPs roughly follow it. 🧵
5
24
2
259
15,611
⚠️ Numerical issues can go on silently for decades like in the softmax/CE! Similar issues are present in other widely-used divergences like the KL and JSD I just posted this paper overviewing what they are and how to fix them: 📚 arxiv.org/abs/2611.18511
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
13
77
12
460
38,896
🚀 Stop using Transformers for weight-space programming If you are not training with gradients on a GPU, why default to a Transformer? When an LLM writes network weights directly, letting it also design the architecture achieves: 📉 ~1,800× fewer parameters at matched accuracy on ARC (AI2 Reasoning Challenge), compared to the best Transformer the same LLM wrote. ⚡ Up to 17× faster GPU inference with a memory architecture built for these tables, compared to a Transformer of the same size. 🧵 Paper & code at the end 👇
21
47
6
343
26,783
Added tiny-voca to my small CPU TTS benchmark. 4.5M params, Apache-2.0. On 1 CPU thread: - 117 ms to first audio - 37x real time - 3.3% WER - 666 MB memory 2nd fastest of 13 models. Phonon 31M stays my pick for live voice. Hear all: erogol.com/small_tts_bench/
I trained a text-to-speech model that has never heard a real human voice. 4.5M parameters. 18 MB. Runs on a CPU. Meet tiny-voca
3
11
3
186
8,547
Small CPU TTS Benchmark 12 tiny TTS models on 1 CPU thread, 60 audio samples. My Pick -> Phonon 31M @GradiumAI. 82 ms to ttfa, 4x rtf, 1.6% WER, 363 MB, Apache-2.0. Pocket TTS, same box: 286 ms, 1.2x, 1347 MB. Let me know any models i missed erogol.com/small_tts_bench/
2
23
1,065
Here is a short video about "Decode Before You Hear" paper that speeds up chunk based speech to speech models significantly arxiv.org/abs/2611.06982
2
25
904
Machine Learns - 81 🤖 • Weight-Space Programming: a closed LLM edits raw weights • WaveGen: TTS with no codec or vocoder • Decode Before You Hear • Latent Sparse Attention • Agentic Backdoors • Mistral Large 4 • My small CPU TTS benchmark erogol.substack.com/p/machin…
6
404
no gold ? he'd love that !
Cumhurbaşkanımız Sayın @RTErdogan, Apple Yönetim Kurulu Başkanı Tim Cook'u Cumhurbaşkanlığı Külliyesinde kabul etti.
161
The Kimi K3.1 Pro is a beast! It’s enough for 99.9% of AI work in a company and there’s no reason to pay premium for Claude or OAI. I’ve tried to find any shortcomings but I can’t seem to find any.
2
5
575
Gemini iOS app is embarrassingly bad. I tried to use it after a long time. Got 3 connection errors after a long wait Now I reached my limit and can’t ask anything
206
I don’t know why we need computer use It is like using a robot to teach on a black board
In your experience, Computer use works best: - on mac OS? - on Windows? - on Linux?
1
203
tried of telling the same things to AI agents so I built "kechup" a cli task manager that lives in the repo and git - each claim, note and close is a git commit, agent ID as author - a task closes only when its REPORT.md is committed - git revert of done work reopens the task
1
1
5
427
My agents tracked 190+ tasks in 14+ projects with it in 3 weeks. Reduced token usage by ~30% by - no need for a context for onboarding - no false "done" flags without evidence - easy switch between harnesses github.com/erogol/kechup
4
46