Software Engineer | LLM hobbyist | Self-hosting my own AI infra | Problem Solver

Florida
Joined October 2023
Chris Scott retweeted
I can't trust a benchmark that ranks Grok, Gemini, Terra, and Muse above DeepSeek Flash, and by a mile.
Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers. Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale. New to the Intelligence Index: ➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change ➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment Upgraded: ➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions ➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised ➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0 Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1 Key results: ➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50 ➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36) ➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04
72
26
12
631
32,353
Chris Scott retweeted
Best opensource model right now is DeepSeek v4.1 Flash 1017 and you’d be crazy if you don’t realize how close to the frontier its intelligence level is
57
38
7
1,010
50,846
Chris Scott retweeted
deepseek-v4.1-flash-1017 is the most underrated opensource model of the year 2026
38
21
3
780
24,442
our next dev meetup will be nov 19! register to attend or submit a 5 minute talk about anything you're stoked about in the dev world right now! luma link hereee: luma.com/vjkq92vm
4
1
8
812
Two ways I use agents, and I keep flipping between them. 1. Opus 5.5 for planning and review. 2. Local DeepSeek-V4.1-Flash for execution: 200-400 tok/s, 15k prefill, unlimited calls. Opus runs the minions. The local model does the volume.
1
89
Chris Scott retweeted
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
1,649
4,899
2,336
43,339
6,800,134
It's going to be about a lot more than recipes really soon. Stay tuned. We're cooking hard. 👨‍🍳
1
3
2
20
8,269
Our team created the technology behind CSF to give your local machines even more capacity for long workflows, large swarms and other tasks. It's lossless, too. Meaning you don't lose any of the data you are caching by using it. Enjoy your new free KV cache tokens!
Get up to 30% more KV cache using our lossless CSF version of @deepseek_ai V4.1-Flash-1017. No drop in quality, just more room for you to do what you want to do! Find the weights on our @huggingface page: huggingface.co/local-inferen…
2
3
1
30
7,391
Chris Scott retweeted
DeepSeek V4.1 Flash 1017 everyone's talking about it for a reason. It does great with 3d built this honeybee on a sunflower like it was nothing. Used Deepseek Harness, 1 turn, looks so good!
56
54
11
1,203
43,791
Awesome!!!! Imagine having this at home with 200-400 tps / 15k prefill tps unlimited usage . Oh I don’t need to imagine 😁
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
23
Chris Scott retweeted
you can now return custom HTTP denial messages to your agent or harness when a network or secret policy blocks a request in a microsandbox. 🛡️ tell it what to do next, or disable responses to close the connection without an explanation.
3
3
19
740
Chris Scott retweeted
FLUX 3 Image Klein is here. Open Weights with the quality of a large frontier model. Customizable and fast. 5.6B parameters and runs on a single consumer GPU. Native 4K, bounding boxes, and pixel-perfect editing.
180
401
223
3,313
339,012
Chris Scott retweeted
it's crazy how easy it is to spot 10x engineers these days for a certain set of people LLMs totally unlocked their potential to the point where imagining their life before this seems totally depressing
209
178
67
5,306
391,979
Favorite sandbox solution
microsandbox v0.7.7 + v0.7.8 are out! ⚙️ run commands in the background (jobs) 🔑 choose which headers receive secrets 🌐 use HTTP CONNECT proxies 🧹 inspect and clean up local storage plus control over clock syncing when restoring snapshots, and more. 🧵
1
41
I trained a DMD teacher > student version after the first release. Well the creators have gone and released a official version. Very cool.
🚀 Meet Qwen-Image-2.1-Turbo — create and edit images in just 8 denoising steps! Open weights now available! Built on Qwen-Image-2.1, Turbo is an accelerated checkpoint on the same 7B visual generation architecture. Fewer steps does not mean lower quality: it still generates strong 2K images from text, and supports continued creation through natural-language edits, from adding accessories to changing a scene. Start directly with Diffusers: load QwenImage21Pipeline and the checkpoint’s recommended 8-step sampling schedule is ready to go. 🌐 Prefer an API? Qwen-Image-2.1 Pro and Turbo APIs are now officially live. Choose a hosted API for your application, or use the Turbo weights in your own workflow. 🤖 ModelScope: modelscope.cn/models/Qwen/Qw… 🤗 Hugging Face: huggingface.co/Qwen/Qwen-Ima… 🔗 Pro API: modelstudio.console.alibabac… 🔗 Turbo API: modelstudio.console.alibabac… What will you create with 8 steps? Share your results with us!
1
79
Worth investigating
Meet EmbeddingGemma 2, our first natively multimodal open model for on-device embeddings. It expands beyond text to unify code, images, audio, and video in a shared space. 🧵
1
45
Chris Scott retweeted
GLM 5.3 Flash, DeepSeek V4.1 Flash, Qwen 3.8 Next Flash, and even Qwen 3.8 27B are all outperforming (in both intelligence and capabilities) every model that was considered "frontier intelligence" in Xmas 2025 (just 10 months ago) Opensource AI is on fire
55
103
18
1,665
52,395