Made with @kitao's Pyxel, which is actually a retro game engine. In 1200 lines of python.
gist.github.com/dkenw/b0f4aa…
1
2
174
such a big gap between opus 5.5 xhigh and high
Introducing FrontierCode 2.0: our new coding benchmark that measures a model’s ability to go beyond the spec.
Most coding evals measure a model’s ability to write code that meets a spec. With FrontierCode 1.0, we asked a new question: would you actually merge the PR?
FrontierCode 2.0 is comprised of more diverse tasks, featuring larger scopes and higher mergeability standards. We are now asking: not only would you merge this PR, but should you?
One key feature of FrontierCode 2.0 is underspecified prompts. Rather than including every engineering decision, prompts are deliberately ambiguous, giving the models room to demonstrate their judgment.
The result is a benchmark that is far from saturated, with the top model scoring just 45%.
Astra (surprisingly) performs consistently better than Opus 5.5 at drawing **low-res pixel art visual effect**.
Opus 5.5 gets the idea quick and is often more creative, but couldn’t draw well without supervision.
Astra is lazy, always draws badly in the 1st pass, but if u keep pushing it to iterate, it’ll often arrive at something much nicer
1
5
378
Turns out the 32MB rom size limit is the biggest hurdle.
Porting a Pyxel game to Butano (GBA ROM), ffs how could GBA devs build games in such crazy constraint of CPU and RAM???
My 6.1 sol has been porting the game for 16hrs and still hasn’t finished optimizing the game enough to run in the emulator.
1
3
1,106














