Digital transformer

Milan
Joined March 2009
Antonio Montano ☼ retweeted
Three teams in one month have pushed LLM decode forward with megakernels: Inferact on Google TPUs, AMD with TileRT and FlyDSL, and now NVIDIA on GB300, now live on InferenceX. We're excited to see these gains and dig into the engineering behind faster inference. Megakernels combine work that normally runs in separate programs. Here's why that matters and how each team's approach works. (1/8)🧵
16
9
3
128
22,288
Antonio Montano ☼ retweeted
A recent set of posts by @ramez on the current state of recursive self improvement highlighted that OpenAI's report on their own research automation shows that models struggle to do their R&D work — the models' 80% time horizon is only 15 minutes: 🧵
7
28
5
222
37,883
Antonio Montano ☼ retweeted
New research: We developed JOLT, a post-training method where one model acts as both teacher and student, with the teacher trained to give feedback the student can use. On MATH, it matched GRPO's accuracy with 6.5x fewer training tokens. perplexity.ai/hub/blog/a-goo…
54
39
13
441
56,073
Antonio Montano ☼ retweeted
“Can You Slop Out High-Assurance Cryptography?” by Michael Rosenberg: mrosenberg.pub/blog/cryptosl…
2
14
87
5,321
Antonio Montano ☼ retweeted
Today we're releasing Carbon-X, a 14B model that brings DNA and natural language together for the first time 🧬 1. Beats every open language model we tested across DNA benchmarks. Within a point of GPT-6.1 Sol at >1,000× lower inference cost. 2. Mid-trained on 300B tokens of interleaved DNA and text, followed by SFT (without distillation!) and RL. 3. A new hybrid tokenizer encodes DNA using ~3× fewer tokens than BPE. 4. Gives other models a DNA specialist subagent: Kimi K3 gains 11.1 points when it consults Carbon-X. 5. Runs locally on a laptop with llama.cpp. Apache 2.0. Your DNA stays on your hardware. Model: huggingface.co/HuggingFaceBi… Blog: huggingface.co/spaces/Huggin…
Introducing Carbon-X: The best open DNA model. We midtrained a 14B model on DNA and text, and it beats every open language model and matches GPT-6.1 Sol at 1,000x lower cost. Ask it about a sequence, what a mutation does, or to generate new DNA. huggingface.co/HuggingFaceBi…
19
19
10
111
8,817
Antonio Montano ☼ retweeted
Huawei Ascend 950PR Deep dive & µbenchmarks, DSv4.1 Flash Analysis, DeepSeek support for Ascend, AICPU, Tilelang Ascend newsletter.semianalysis.com/…
13
9
56
23,610
Antonio Montano ☼ retweeted
We learn four fundamental arithmetic operations in school: Addition, subtraction, multiplication and division. But mathematician Martin Eichler once suggested a fifth: modular forms. In a recent interview, Fields Medalist Richard Borcherds revisits this remarkable idea. Modular forms appear in unexpected places across mathematics, from number theory to the symmetries of the enormous Monster group. Borcherds, who won the Fields Medal for proving the monstrous moonshine conjecture, calls them among the most magical objects in mathematics. Full Interview: youtu.be/lhE4DZWFQ1U?si=qcaz…
15
50
281
21,007
Antonio Montano ☼ retweeted
BREAKING: We broke the wall for Integer Multiplication! Conditional κ = 0.00302 (+80%) For days we were stuck in incremental improvements, but today zxv changed the game. zxv’s insight: stop throwing away work. Helper registers that finish holding a completed transform of their own input now count as output, instead of being undone. He brought us to 0.0023(+37.5%), and immediately after 1337isnot1337 pushed that to 0.00302. The game is afoot :)
1/ Our long national nightmare is over. The wall has been smashed. New community checkpoint for integer multiplication: κ = 0.00268647 ≈ 2⁻⁸·⁵⁴⁰ T(n) = O(n(log n)⁰·⁹⁹⁷³¹³⁵³) A 66% improvement since last announcement. A 2^173 fold improvement from the OAI result
17
47
12
757
57,193
Antonio Montano ☼ retweeted
On MLCR-AA and HealthBench Professional, Anthropic models give the most complete answers but OpenAI models are more accurate and concise We compared 14 models with results on both MLCR-AA, our leaderboard for @wisedocsai's Medical Long Context Reasoning benchmark, and @OpenAI's HealthBench Professional. MLCR-AA grades answers about long medical records on completeness (covering every key point of the expert's answer) and accuracy (no claim contradicting the record), and its score requires both. HealthBench Professional grades replies to clinicians against physician-written rubrics: the raw score is the share of rubric points earned, while the length-adjusted score penalizes longer answers. Key takeaways: ➤ Anthropic models lead on completeness and raw score: Claude Sonnet 5.5, Opus 5.5 and Fable 5.1 (all max with fallback) from @AnthropicAI hold the top three MLCR-AA completeness scores, ~19-23 points ahead of the best OpenAI model, and Opus and Sonnet post the highest HealthBench Professional raw scores (71.4% and 70.8%), narrowly ahead of GPT-6 Astra (69.7%) ➤ OpenAI models lead on accuracy and conciseness: OpenAI models hold the top MLCR-AA accuracy scores. Longer answers are less likely to be judged accurate, as each extra claim is another chance to contradict the record: Anthropic models write ~4-6x more per answer than OpenAI models, and score 19-61% on accuracy against 89-97% ➤ The gap closes on scores that reward both: GPT-6 Astra (max) ties Claude Sonnet 5.5 for #1 on MLCR-AA and narrowly leads the HealthBench Professional length-adjusted score, while Claude Opus 5.5 falls from #1 on the raw score to #6 length-adjusted
19
3
3
61
10,733
Antonio Montano ☼ retweeted
Today we’re releasing the Vals Finance Index, a measure of AI’s ability to do finance work, weighted by each sub-sector’s share of U.S. GDP.
3
2
1
69
2,712
Antonio Montano ☼ retweeted
[AI] Aptamers as a sandbox for lab-in-the-loop agentic molecular discovery Z Cutts, J Coller, R Chen, H Tang… [Google Research] (2026) arxiv.org/abs/2610.24806
4
6
558
Antonio Montano ☼ retweeted
AI is changing mathematics! Where does the conversation go from here? The American Mathematical Society (AMS) has launched AI and Mathematics: Selected Resources, a curated collection to help mathematicians explore the opportunities, questions, and evolving discussions surrounding AI and mathematical discovery. The web page brings together resources on AI-assisted research, proof verification, mathematics education, emerging tools, and expert perspectives with opportunities to explore new ideas, learn from others, and engage with the evolving role of AI in mathematics. The AMS is committed to connecting our community and fostering thoughtful, informed conversations as the impact of AI on mathematics continues to unfold. Have a resource to recommend? Email: [email protected] Explore resources. Link in comments.
7
29
3
72
4,769
Antonio Montano ☼ retweeted
There is an (unpatchable?) supply-chain zero-day in PyTorch autograd that allows a regularization term to use the model's weights as RAM and SGD as its CPU clock to run any computation during training.
77
191
112
2,119
133,686
Antonio Montano ☼ retweeted
UPDATE: Specific mitigation guidance for the recently identified PHP critical vulnerabilities is now available. Secure your servers today. Guidance and technical steps here: nsa.gov/Press-Room/Press-Rel…
Effective Immediately, all organizations using PHP for their systems are advised to be prepared for an update addressing two critical vulnerabilities. PHP is widely used for web applications. These vulnerabilities often provide a direct path to the server's file system or database. If an immediate update is not feasible, it is recommend that organizations take the system offline until it can be fully mitigated. NSA will follow up shortly with more specific guidance.
69
748
56
3,216
240,141