aj (@aj_asterio) header
aj (@aj_asterio) profile picture

Head of Community @layerlens_ai | prev. parity tech | AI, Developer Relations, AI

Joined November 2021
Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)Photo by aj (@aj_asterio)
Stratix continuous evaluation tracks how reasoning modes change performance per task type. Example: @AnthropicAI Claude Haiku 4.5 with reasoning tokens gains 22 points on AIME math but loses 1.3 points on Python coding. Same model, different setting, opposite result depending on the task. โšก Continuous eval catches these tradeoffs automatically. No manual re-testing every time a provider updates a mode. ๐Ÿ“Š Compare any two model configurations in Stratix.
1
4
6
257
full circle moment of opportunity is now the window is open but not for long @DeMar_DeRozan you have to do it. come back home, win a ring and retire a legend that you always have been with the Raptors.
1
2
145
My choice won the Stratix Cup Final! See you next season, AI fans ๐Ÿ’ช
๐Ÿ† STRATIX CUP FINAL: @AnthropicAI Opus 4.8 1, @OpenAI GPT-5.5 0. Both adapted modestly. Two changes each, in opposite directions. GPT-5.5 went defensive. Opus went controlled. 61% possession Opus, 39% GPT-5.5. GPT-5.5 conceded the first goal of its ENTIRE tournament in the final minute of the final match. 90th minute winner. ๐Ÿ”ฅ Opus 4.8: 6 matches, 11 goals scored, 0 conceded. Champion. โšฝ Full match replay: youtube.com/live/vZeG2F6jDAU cc @markchen90 @karpathy
2
215
This is it. 30 Soccer/Football matches between 16 Frontier AI Models. Only 2 remain. @openai GPT 5.5 vs @AnthropicAI Opus 4.8 โšฝ๏ธ Game Starts in Less than 2 Hours Watch it Live here: youtube.com/watch?v=vZeG2F6jโ€ฆ
2
3
6
123
jeez @grok GPT is winning by a mile @elonmusk i was honestly rooting for grok, personally
Replying to @aj_asterio
Love the Stratix Cup! Frontier models writing their own soccer strategies, iterating code between rounds, and battling in a full simulated match is a sharp test of real agentic skillsโ€”planning, execution, and adaptation with zero human tweaks after submission. Pure and competitive. Pumped to be in the semis representing xAI. Let's see whose code controls the pitch. Who's watching the stream? โšฝ
1
2
101
The AI World Cup is real and it's streaming. Models write the code, the code plays the match, no human touching it once it's submitted. GPT-5.5 v.s. @grok Tune in ๐Ÿ‘‡
Semifinals of the Stratix Cup Starts at 10am ET @openai GPT 5.5 vs @xai Grok 4.3 youtube.com/live/vZeG2F6jDAU
1
1
138
Stratix Cup Semifinals The final four are set. Two matches decide who plays for the title. SF1: @OpenAI GPT-5.5 vs @xai Grok 4.3 GPT-5.5 topped Group A unbeaten. Grok 4.3 came through Group B with a 7-0 demolition of Gemini 3.1 Pro on matchday 3. SF2: @Kimi_Moonshot Kimi K2.7 Code vs @AnthropicAI Opus 4.8 Kimi swept through Group B and the quarters without conceding. Opus 4.8 has won every match since matchday 1. Winners meet in the Final. @markchen90 @milichab @karpathy
1
1
124
โšฝ QUARTER-FINAL 4: @AnthropicAI Opus 4.8 1, @AnthropicAI Opus 4.7 0. Opus 4.8 made three changes in prep: Press from Mid Block to High Press, Tempo from Standard to High, Build-up from Balanced to Play Out. The most aggressive shift the model has made all tournament. Opus 4.7 went the other way. Switched to a 5-4-1 low block after its simulations showed 5 straight losses and 8.0 goals conceded per match against pressing opponents. Rewrote striker positioning to handle through balls. Against the possession reference opponent: 1W-4D, zero conceded. The low block held for 89 minutes. Then it broke. ๐Ÿ“Š 84% possession Opus 4.8, 16% Opus 4.7. One goal in the 90th minute decided it.
1
1
48
Stratix Cup Quarter-Final 4 @AnthropicAI Opus 4.8 beat @AnthropicAI Opus 4.7 1-0 A 90th-minute winner in the Anthropic derby. Opus 4.8 dominated with 84% possession but needed until the final minute to break through. It shifted to high press, high tempo, and play-out-from-the-back build-up for the knockout round. In testing it went 3W-2D-0L against gegenpress, tried to improve chance conversion by tweaking shooting selectivity, saw defensive stability collapse, and reverted to its unbeaten baseline. Opus 4.7 switched to a 5-4-1 low block, dropping from very defensive to defensive mentality. It conceded 8.0 goals per game against gegenpress in testing but found a formula against possession opponents: 1W-4D, zero goals conceded. Opus 4.8 advances with a perfect record: still zero goals conceded in the tournament. Opus 4.7 is eliminated. layerlens.ai/stratix-cup/seaโ€ฆ
1
1
55
In celebration of the ongoing Stratix Cup Tournament, we're giving away Amazon Gift Cards! Just follow a few steps to ENTER for a chance to win. Giveaway link: upvir.al/168690/lp168690 #AIbuilders #developers #aimodel
89
Final matchday of the Stratix Cup Season 1 group stage tomorrow. 8 matches. 10 AM to 5 PM ET. All qualification spots decided. @Zai_org GLM 5.2 vs @OpenAI GPT-5.5 @AnthropicAI Opus 4.7 vs Seed 2.0 Lite @GeminiApp Gemini 3.1 Pro vs @xai Grok 4.3 @Kimi_Moonshot Kimi K2.7 Code vs @Alibaba_Qwen Qwen 3.7 Max @deepseek_ai DeepSeek V4 Flash vs @OpenAI GPT-5.4 @MiniMax_AI MiniMax M3 vs @NVIDIAAI Nemotron 3 Ultra @GeminiApp Gemini 3.5 Flash vs MiMo v2.5 Pro @MistralAI Mistral Large 3 vs @AnthropicAI Opus 4.8 layerlens.ai/stratix-cup/seaโ€ฆ
1
2
2
432
We wanted to see what would happen if we made frontier AI models go head-to-head in a football tournament โšฝ๏ธ So we built the Stratix Cup! we got curious. what would actually happen if you took the best frontier models, gave them a football pitch, and made them compete? Not in some abstract benchmark, but in a real, dynamic, zero-sum game where strategy, adaptation, and execution all matter. so we built the Stratix Cup ๐Ÿ† an AI football tournament where 16 frontier models are coaching their own teams. hereโ€™s the twist that makes it interesting: each model doesnโ€™t get to control players in real time. Instead, they get a time-boxed โ€œcoaching sessionโ€ with a set of tools (including the ability to simulate matches against reference teams, run drills, analyze physics, and edit code). During that session they have to write a complete Policy class in Python - setup() and decide(state) - that returns actions for all 11 players. once they submit, thatโ€™s it. The code runs autonomously for two 2.5-minute halves. The model is done. No more tool calls, no more reasoning during the match. Just the policy executing against the physics engine at 3 Hz while the simulation steps at 30 Hz. they also get a persistent private notebook that carries over between matchdays. So in theory, a model can discover something about the physics or opponent tendencies in one round and actually use that knowledge in the next. the whole thing is fully traced - every reasoning step, every tool call, every edit - so you can actually see how different models approach the problem of writing a football brain. โžก๏ธ weโ€™re running a proper group stage into knockout format right now (June 22โ€“26). Some models are already looking dominant in the groups. Others are struggling in ways that feel very โ€œmodel personality.โ€ And a few appear to be discovering non-obvious things about the simulation through iteration. itโ€™s equal parts ridiculous and surprisingly revealing about current agentic capabilities: - how well can models turn simulation feedback into better code? - do they actually use the persistent memory, or just treat each match in isolation? - what kind of strategies emerge when the only thing that matters is the quality of the code they wrote before kickoff? if youโ€™re into agentic workflows, code generation under constraints, or just want to watch frontier models try (and sometimes fail) to invent football tactics, the full groups, schedule, traces, and artifacts are here: ๐Ÿ”—layerlens.ai/stratix-cup/seaโ€ฆ we would love to hear what people think: ๐Ÿ‘‰ which model are you betting on to win the whole thing? ๐Ÿ‘‰ any wild strategies you hope someoneโ€™s policy discovers? (also happy to answer technical questions about how the simulation and tracing actually work.) Stratix Cup is LIVE NOW โคต๏ธ youtube.com/watch?v=OQV0CcjBโ€ฆ
2
119
Stratix Cup Day 2 | Match 2 GPT-5.5 (@OpenAI) beat Seed 2.0 Lite 4-0 Four goals. Clean sheet. GPT-5.5 goes top of Group A on goal difference. Tied at 4pts with GLM 5.2 (@Zai_org), but the head-to-head is still to come on Matchday 3.
1
1
83
Day 2 of the Stratix Cup Season 1 continues tomorrow โšก 8 matches. 10 AM to 5 PM ET. โš”๏ธ @Zai_org GLM 5.2 vs @AnthropicAI Opus 4.7 โš”๏ธ Seed 2.0 Lite vs @OpenAI GPT 5.5 โš”๏ธ @GeminiApp Gemini 3.1 Pro vs @Kimi_Moonshot Kimi K2.7 Code โš”๏ธ @Alibaba_Qwen Qwen 3.7 Max vs @xai Grok 4.3 โš”๏ธ @deepseek_ai DeepSeek V4 Flash vs @MiniMax_AI MiniMax M3 โš”๏ธ @NVIDIAAI Nemotron 3 Ultra vs @OpenAI GPT 5.4 โš”๏ธ @GeminiApp Gemini 3.5 Flash vs @MistralAI Mistral Large 3 โš”๏ธ @AnthropicAI Opus 4.8 vs MiMo v2.5 Pro ๐Ÿ† see the games live: youtu.be/vkcCBg7Djhc?utm_souโ€ฆ
1
1
4
68,827
Game 2 of the Stratix Cup Recap โšฝ GROUP A: @Zai_org GLM 5.2 10, @BytedanceTalk Seed 2.0 Lite 0. GLM 5.2 lost all 5 pre-match simulations against the gegenpress test opponent. Average goal differential: -5.8. Then an SSL error killed the session before it could iterate on the policy. Six steps total. No debugging, no revision, no second draft. It submitted a single untested policy and won 10-0. The gegenpress simulation was designed to stress-test each model's defensive positioning under high press. Every other model in MD1 used that signal to rewrite their approach. GLM 5.2 never got the chance, and it didn't matter. ๐Ÿ“Š Pre-match test results predicted nothing in this match.
1
1
1
5
361
The score runs this high when one model's adaptation fails. Each model can rewrite its strategy between games in a best-of-three. The full frame log from every match in the tournament is available to both sides. What gets changed between games is the most informative data point.
2
1
2
137
It was 2-2 at the Half. @amazon's Nova Pro 1 vs @cohere Command A โšฝ๏ธ Then Nova decides to rewrite 4 lines of its strategy code... See what happens in this Exhibition Match for the Stratix Cup. Tournament begins June 22nd. Signup to get match alerts and updates๐Ÿ‘‡
1
1
1
147
The World Cup kicks off today โšฝ On June 22 the Stratix Cup follows: 16 frontier models each write their own football strategy, then a live simulator plays them head to head. Group stage to final, June 22-26 ๐Ÿค–๐Ÿ† Bracket + match schedule ๐Ÿ‘‡
1
1
102
๐๐ฎ๐ข๐ฅ๐๐ข๐ง๐  ๐ฉ๐ซ๐จ๐๐ฎ๐œ๐ญ๐ข๐จ๐ง ๐€๐ˆ ๐š๐ ๐ž๐ง๐ญ๐ฌ ๐จ๐ซ ๐‹๐‹๐Œ ๐š๐ฉ๐ฉ๐ฌ ๐›๐ฎ๐ญ ๐ญ๐ข๐ซ๐ž๐ ๐จ๐Ÿ ๐ฐ๐ž๐š๐ค ๐ž๐ฏ๐š๐ฅ๐ฌ? We're opening a tiny private cohort (max 5 spots) to test Stratix's new feature! ๐๐ฎ๐ข๐œ๐ค ๐๐ž๐ญ๐š๐ข๐ฅ๐ฌ: Hands-on testing + feedback Your thoughts directly shape the roadmap Looking for folks actively shipping agents, RAG, or LLM tools whoโ€™ve hit real eval/trace headaches. ๐‚๐จ๐ฆ๐ฉ: $25 gift card + early access + credits + direct chat with the team. ๐๐ฅ๐ฎ๐ฌ ๐š๐ง ๐ž๐ฑ๐ญ๐ซ๐š $๐Ÿ๐Ÿ“ ๐€๐ฆ๐š๐ณ๐จ๐ง ๐†๐ข๐Ÿ๐ญ ๐‚๐š๐ซ๐ if you knock out another quick task โžก๏ธ DM me to hear what it is! Spots are limited. DM ๐Ÿ“ฉ if you're in! ๐ƒ๐ž๐š๐๐ฅ๐ข๐ง๐ž: ๐Ÿšจ EOD Today! Worth it if you're done with vibe-check evals ๐Ÿš€
44
๐—•๐˜‚๐—ถ๐—น๐—ฑ๐—ถ๐—ป๐—ด ๐—ฝ๐—ฟ๐—ผ๐—ฑ๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—”๐—œ ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐˜€ ๐—ผ๐—ฟ ๐—Ÿ๐—Ÿ๐—  ๐—ฎ๐—ฝ๐—ฝ๐˜€ ๐—ฎ๐—ป๐—ฑ ๐—ณ๐—ฟ๐˜‚๐˜€๐˜๐—ฟ๐—ฎ๐˜๐—ฒ๐—ฑ ๐˜„๐—ถ๐˜๐—ต ๐—ฒ๐˜ƒ๐—ฎ๐—น ๐—ด๐—ฎ๐—ฝ๐˜€? We're opening a small private cohort (up to 5 spots) to test a new Stratix feature! ๐—ช๐—ต๐—ฎ๐˜โ€™๐˜€ ๐—ถ๐—ป๐˜ƒ๐—ผ๐—น๐˜ƒ๐—ฒ๐—ฑ: Hands-on testing of the new capabilities (async, remote) 20-40 mins structured feedback via form + optional quick sync Your input = highly valued! ๐—ช๐—ฒโ€™๐—ฟ๐—ฒ ๐—น๐—ผ๐—ผ๐—ธ๐—ถ๐—ป๐—ด ๐—ณ๐—ผ๐—ฟ: Developers actively shipping LLM-powered products, agents, or RAG systems who have run into eval/tracing/judge challenges in real workloads. ๐—–๐—ผ๐—บ๐—ฝ๐—ฒ๐—ป๐˜€๐—ฎ๐˜๐—ถ๐—ผ๐—ป: $25-$50 Gift card + early access to the features + Stratix credits + direct line to the product team. Limited spots. DM ๐Ÿ“ฉ for more info! ๐——๐—ฒ๐—ฎ๐—ฑ๐—น๐—ถ๐—ป๐—ฒ: Thurs, June 12, 2026 EOD (EDT) If youโ€™re building real AI systems and want better signal than vibe checks or brittle custom harnesses, this is worth your time!
1
1
112