Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers. Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale. New to the Intelligence Index: ➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change ➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment Upgraded: ➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions ➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised ➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0 Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1 Key results: ➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50 ➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36) ➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04

What's New in Grok Bot 00:00 🎃 00:13 Pages in Grok Bot 01:09 Vault 02:05 1Password 02:21 Apple integrations 03:21 Bot makes videos 03:47 New bot characters 04:13 X Spaces 04:31 Font fun 04:54 Design polish 05:11 Rapid fire

We are entering a new dark age of cybersecurity. Devin is here to help. Introducing the new Devin Security: powered by Claude Mythos and frontier cyber models, plus hundreds of millions of dollars of credits to help teams find, prioritize, and fix urgent vulnerabilities.

We keep improving performance across Claude, and you may have noticed it starts responding sooner! Claude Code now gzips the conversation it sends on every turn, so it reaches the model faster. Cloud sessions also start up as soon as you start typing.

The craziest thing I've ever built with AI 🤯🤯🤯🤯 An interactive Rick and Morty experience never seen before. Scenes are created while you play. Live gameplay demo below. 👇👇👇 Want to play? I'll send the link to 2 people from the comments. (This is a Fan-made project)

@semihdev Hocam Timber Tycoon'a yeni özellikler gelmiş, hiç söylemiyorsunuz 👍👍👍👍

What happens to the software development lifecycle when AI agents join the team? Our DevRel Manager Semih Kışlar (@semihdev) will take the devnot stage with his talk, "The Next Evolution of SDLC: ADLC." ⏰15:15 |📍Elite World Asia Hotel Istanbul See you there! 👋 #DevnotSummit26

We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI, and we’re grateful to the agents and prosecutors who moved quickly to make an arrest. The FBI’s investigation is ongoing and we will continue to support their work. At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data. The employee was terminated. We take protecting our technology, data, and people seriously, and as a matter of national importance. Our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.

Gemini 4 Argon is now available in Devin Desktop and CLI. On FrontierCode 1.1, Gemini 4 Argon scores 60.5%, making it the highest performing Gemini model on the leaderboard. Through October 27th it is available at 75% off for Devin users.

Topluluk önünde ilk sunum deneyimi yaşamak isteyen yazılımcılar için düzenlediğimiz Hello Talks 14 Kasım Cumartesi günü yeniden sizlerle. Detaylar ve sunum başvurusu için: kommunity.com/devnot/events/…