Is DeepSeek V4.1 Flash 1017 really better than Kimi K3, Opus 5 and GPT 5.6 Sol? In this article I go through everything in detail, sharing my own benchmarks, real world tests and results to see how these models actually compare!

This is the first time Tibo has reset our limits two days in a row, they really should give us a banked reset instead! Most of us, myself included, have barely used any of our allowance today, and I still have 94% left with less than 12 hours to use it all. How am I supposed to get through that much usage before the next reset? I guess I'll be trying GPT 6 Astra Ultra fast for the first time just to see how much I can actually use haha Also, a quick reminder for everyone on the old x20 plans, we'll be moving to x10 in less than a week, so make sure to get the most out of your subscription while you still can!

gemini-4-argon-high : 01a15e05-e56b-7d68-8cc1-82fa… kibitz : 01a160c3-f5eb-7dca-a81a-1f68…

🚨 Gemini 4 Carbon vs Kimi K3.1, after my first tests I feel like both models could easily compete with Opus 5.5 Medium when it comes to 3D, and I'm really liking what I'm seeing from both of them! The quality is impressive and they're both very fast, but I think Kimi K3.1 is going to surprise a lot of people, myself included. If they manage to release it at prices similar to DeepSeek, it could be game over for a lot of closed source coding models from US labs, especially when you consider how good the quality already looks in these early tests. Now I'm just hoping they finally release the model along with its open weights so we can run a quantized version locally! I can't wait to see how it performs outside Arena and how much we can push it with more demanding projects. What a great week we have ahead of us!

🔴 Qwen 4 Kalmia vs GPT 6.1 Sol Ultra, the quality of this new Qwen model in my Magnetar benchmark really surprised me! I'd say it's already on the same level as GPT 6.1 Sol Ultra, although I still don't think it's quite at Opus 5.5's level yet. What's even more interesting is that it's expected to be pretty affordable, possibly around the same price as Haiku 5.5, and you can tell they're doing a great job optimizing it. I'm really liking what I've seen so far, it's a little slower than some of the other models I've tested, but I have a feeling it's going to rank among the top models once the official benchmarks come out. With so many new releases coming, I can't wait to see what the next few days and weeks have in store for us!

Qwen 4 is showing up as Kalmia on Arena, and I can't believe how many impressive Chinese models we're seeing this month! I think we're all waiting for a quantized version of Qwen 4 so we can finally run it locally, and from what I've tested so far, the quality is incredible. The only thing we can't really tell is whether it's using its highest reasoning setting, but even without knowing that, this particular test turned out much better than what GPT 6.1 Sol Ultra produced with the exact same prompt. I'm really impressed with how quickly these Chinese labs are improving, and with so many new models still on the way, I can only imagine what's coming next, Buckle up because October and November are going to be absolutely wild for AI!

Kimi K3.1 Kibitz is now confirmed to be a very affordable model, similar to GLM 5.3, I just got this new test on Arena and so far my results have been pretty mixed, in some tests Kibitz performs at the level of GPT 6 Astra Medium or Opus 5.5 Medium, while in others the quality drops quite a bit. But considering how good some of these results are and how affordable the model is expected to be, I'm really looking forward to seeing what Kimi has been working on these past few months My prediction is that Kimi K3.1 could become the best open weight AI model we've seen so far, and if it really delivers this level of performance at such a low price, it could put some serious pressure on Zhipu's upcoming GLM 5.4 and GLM 5.5 models, which are expected next month. The competition between these Chinese AI labs is getting more interesting with every release, and the best part is that we're the ones who benefit from all of this, getting better models, faster performance and lower prices