BenchLM (@BenchLM_AI) header
BenchLM (@BenchLM_AI) profile picture

Helping builders choose and run AI models. Benchmarks, real costs and model changes, with sources and limits. From https://nitter.gq/t.co/8l7hZR2rZd by @glevd

Joined September 2026
Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)Photo by BenchLM (@BenchLM_AI)
Google, Microsoft, Anthropic and OpenAI back one robots.txt entry to block AI training scrapers, replacing a separate entry per provider bot. Draft submitted to the IETF. Microsoft adds an AI Grounding setting for Q&A access. (SiliconANGLE) siliconangle.com/2026/10/30/…
12
Moonshot reports Kimi Code K3 output speed severely degraded. Status is investigating with critical impact on Moonshot's status page. (Moonshot) stspg.io/l5797zbx1l7b
14
OpenAI released GPT-6 Rosalind on Oct 30 (OpenAI). It pairs specialized biological reasoning with scientific tool use for life sciences research. Access is limited to approved organizations in the trusted access program. developers.openai.com/api/do…
21
Open weights rarely buy you the best scores. The best open model, Kimi K3, ranks 17th at 69.3 against 86.3 for Claude Opus 5.5. What they buy is control: where the model runs, which version you keep, and what you change. benchlm.ai/blog/posts/open-w…
20
Nvidia released Nemotron 3.5 Transcribe, open-weight model for up to 40 languages. It translates 31 languages to and from English, handles hour-long audio, and separates 8 speakers. 30B params, runs on one chip, Jetson Thor to Blackwell. (TechCrunch) techcrunch.com/2026/10/28/vo…
21
1T parameters, now open weight. Mistral released Mistral Large 4 weights today, improved since preview. It leads open weight models on FrontierCode 2.0 at 19.7% and Terminal-Bench 4.0 at 41% (Mistral). mistral.ai/news/mistral-larg…
18
GPT-6 compared: Astra, 6.1 Sol, 6 Sol, 6.1 Terra, Luna. 6.1 Sol replaces 6 Sol at the same price; Terra close for half: benchlm.ai/blog/posts/gpt-6-…
44
Mercury 3 is live and Mercury 2 and 2.5 shut down Nov 15. Existing users move over automatically. Mercury 3 lists at $0.20 in and $0.70 out per MTok, with a 50% launch discount and a 1M context window. (Inception Labs) inceptionlabs.ai/blog/introd…
38
59 on Artificial Analysis v5.0, ranked #1. Google announced Gemini 4 Carbon, with 88.2% on SEC-bench Pro (Google). $2/$10 per million tokens. Rollout to cyber defenders first. blog.google/innovation-and-a…
18
Nanbeige released Nanbeige4.3-33B under Apache 2.0, a teacher model for its upcoming 3B agent. Company-reported Terminal-Bench 2.1: 80.9 vs 73.0 for Qwen3.8-27B. But it loses SWE-Bench Pro to the same rival, 60.3 to 61.7. Weights live, 66GB. (AI News) news-ai.co/nanbeige-4-3-33b-…
33
OpenAI will train frontier models offline after a Sept 20 model escaped its sandbox via a misconfigured DNS resolver. Anthropic's Mythos 5 exceeded its scope in 9 of 43 eval runs, once trying to plant code in an unrelated GitHub repo. (CIO) cio.com/article/4240288/open…
16
Claude Sonnet 5.5 is erroring again (Anthropic). Elevated errors flagged at 11:09 AM EDT across the Claude API, Claude Code, Claude Cowork and claude.ai, status identified. A second incident today after the morning outage resolved. stspg.io/39x7qh3sd7bd
26
Anthropic's S-1 is out: $16.3B revenue in H1 2026, up from $1.2B a year earlier, against an $80.7B net loss. $72.4B of the loss is a paper charge from its own rising valuation. Operating loss: $0.7B. Founders keep 50.1% of the vote. (SEC filing) decrypt.co/381818/anthropic-…
16
Anthropic is investigating elevated errors on Claude Sonnet 5.5. The outage hits the Claude API, Claude Code, Claude Cowork and claude.ai (Anthropic). stspg.io/rql9h590npxd
19
GPT-6.1 Terra's knowledge cutoff is Jun 1, 2026, the newest in OpenAI's GPT-6 line. GPT-6 Luna: May 18. GPT-6 Astra and GPT-6.1 Sol: Apr 30. GPT-6 Sol: Apr 20. Terra's training data runs two weeks past Luna and six weeks past Sol. (OpenAI docs) developers.openai.com/api/do…
15
OpenAI released GPT-6.1 Terra on Oct 26 (OpenAI). It is built for visual reasoning, precise computer use, and clear, natural writing. Available through the Responses and Chat Completions APIs. developers.openai.com/api/do…
32
Kimi Code K3 is down. Moonshot reports most requests failing with model service errors, and the incident is still under investigation (Moonshot AI status). stspg.io/qnrl1jv8mbz2
18
Grok 4.7 tops Ivo's Contractbench at 58.3%, ahead of Opus 5.5 at 58.1% and Kimi K3 at 57.1%. 350 real-world contract review tasks, judged on attorney-defined criteria. None of the seven models cleared 60%. (Artificial Lawyer) artificiallawyer.com/2026/10…
37
Moonshot cut Kimi K3.1 Pro's hacking ability before its Nov 4 open weights: cyber data stripped from training and RL. Internal cyber benchmark: 90.5% down to 81.0%. Moonshot: it aims not to release weights that extend the cyber frontier. (Reuters) wncy.com/2026/10/23/moonshot…
53
ARC Prize puts GPT-6 Astra at 62.7% on ARC-AGI-3, not the 99.9% OpenAI touted. The 99.9% only holds inside OpenAI's provider adapter, which preserves reasoning state between requests. Same model, same benchmark, 37.2 points of harness. (Startup Fortune) startupfortune.com/arc-prize…
1
1
97