xLight retweeted
Fuck you, @ArtificialAnlys
Your new index says Claude Haiku 5.5 is smarter than DeepSeek V4.1 Flash 1017 and GLM-5.3.
Haiku is Anthropic's small cheap model. DeepSeek 1017 is the model Cursor put on its cost frontier this month, and Cursor says no model scores higher at those prices. I run it every day on my 4x 3090. I dont believe for a second that Haiku beats it.
Look at how they got there. 60% of the index now runs on private tests nobody outside can see. GDPval-AA, SciCode and the long context test are gone. In comes a private coding benchmark from Cognition. And the open weights gap goes from 3 points to 12 in 1 release, 4x. Released open models are now 26 points behind the top.
1 day before v5, on the old version, they gave Ling 3.1 Flash 1019 a 44. Now the best released open model gets 32.
The weights didnt change. The tests did, and you cant see the tests.
This is a bought benchmark. A leaderboard where you cant check a single question, that widens the gap 4x overnight and puts Haiku above DeepSeek, is marketing for closed labs. Its not measurement. I hope at least you were paid enough money to publish such garbage. Liars.
Publish the questions or stop calling it an index.
Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets
The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers.
Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale.
New to the Intelligence Index:
➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change
➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment
Upgraded:
➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions
➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised
➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool
Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0
Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1
Key results:
➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50
➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36)
➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04
闭关搞出了一个多年前想做的广域网优化协议,正好是七夕,就叫 Queqiao 吧。在 MSRA 的时候直连外网的专线非常爽,一般只能通过香港中转才能达到这种性能。最近测了下发现,中美之间大多数情况下都是 erasure channel + upper bandwidth bound,因此自适应的 FEC 非常好用。
做了一个协议,自己在 Mac 上跑了 3 天非常好用,开源出来。只要在本地和美国的出口网关服务器上分别装上 daemon 就可以用。(Mac/Linux 就是个 daemon 可以搭配现有的客户端使用,iOS/Android 自己开发测试中)
欢迎测试 & star & 提 issue!
github.com/bojieli/queqiao
xLight retweeted
Takaichi's Ambiguity Betrayal of History
Eighty-one years ago, Nagasaki was erased in a blinding flash, with 74,000 victims incinerated by a weapon that should have been the last. Three days earlier, Hiroshima had suffered the same fate.
Japanese Prime Minister Sanae Takaichi made it clear at the Hiroshima memorial ceremony on Thursday and again at the Nagasaki memorial ceremony on Sunday that the country's neo-militarists have learned nothing from the horrors of the bombings.
At Nagasaki's Peace Park, the city's mayor, Shiro Suzuki, called nuclear weapons an "absolute evil". Yet, standing just a few feet away, Takaichi offered only deliberate ambiguity over whether her government will abide by the Three Non-Nuclear Principles.
Japan already operates under the protection of the United States' nuclear umbrella. To invoke a purported "external threat" as a rationale for acquiring an independent nuclear deterrent is hardly the "realistic and pragmatic approach" Takaichi describes — rather, it lays bare the unmistakable ambitions of the country's neo-militarist faction.
Takaichi will not say she intends to revise the principles, but neither will she promise to preserve them. She speaks only of current policy, deliberately leaving the future open to interpretation. This is the slow-motion dismantling of a commitment that has defined postwar Japan.
The hypocrisy is staggering. Here is a prime minister attending the memorials for victims of nuclear hellfire, surrounded by aging hibakusha, victims of atomic destruction — whose average age is over 86 — yet she will not reaffirm the principles these survivors have defended for decades.
When the hibakusha protest her stance on "nuclear sharing" with the US, and when a record 128 local assemblies urge her government to uphold the three principles, her response is little more than a verbal shrug. No wonder Moscow called Japan's nuclear memorial act hypocritical — Takaichi equivocates on the non-nuclear principles while refusing to even ask why the bombs fell on Japan.
Eighty-one years after Fat Man fell on Nagasaki, Takaichi stood in Peace Park and blurred the edges of a promise generations of Japanese have held sacred. The city's mayor was right: Nuclear deterrence does not eliminate the risk of catastrophe; it institutionalizes it.
The Takaichi government is intent on "honoring" the dead by placing their descendants under the shadow of the same weapons that destroyed them. When the last hibakusha is gone, what will remain of their plea?
A prime minister who could not bring herself to unequivocally declare: "I promise to uphold the Three Non-Nuclear Principles". That is not realism. It is a betrayal of history.
#Hiroshima #PeaceMemorialCeremony
#ShinjiroKoizumi #Shinjiro #Koizumi
#Nagasaki #hibakusha
#ShiroSuzuki
#ThreeNonNuclearPrinciples #nuclear
#JapaneseMilitarism #Militarism
#NeoMilitarism
#Japan #TakaichiSanae #Sanae
#Takaichi #SanaeTakaichi
#ChinaMilitary #ChinaMilBugle
#钧正平
????
The Trump administration has agreed to take a stake in xLight — a startup seeking to develop free-electron lasers viewed as key to making faster computing chips. More here: reut.rs/4owVAim










