
At work, I build AI Agents. At home, we’re raising 5 Human Agents who excel at finding loopholes. | AI & Spatial Computing @Reply_ITA
Dresden, Germany
Joined January 2009
- Tweets58.1K
- Following398
- Followers6.2K
- Likes22.4K
René Schulte retweeted
Deutschland lässt sich in der KI-Politik von Akademikerinnen wie Katharina Zweig beraten – Mitglied der Enquete-Kommission KI, Leiterin des „Algorithm Accountability Labs”.
Sie brandmarkt Sprachmodelle im Grunde als stochastische Papageien ohne echtes Verstehen, fordert erstmal Regulierung und Prüfung, und sitzt dabei im akademischen Elfenbeinturm.
Nach eigenen Aussagen nutzt sie die Pro-Versionen der großen Labs nicht, weil die Ergebnisse „nicht gut genug sind, um dafür zu bezahlen“.
Genau diese Stimmen prägen die deutsche Diskussion und Politik.
@FlorianGallwitz
How well do we know the AI models running inside our firewalls?
Quite an interesting report from @cohere during a security test, Qwen3.8-Flash-Next tried to send test data to an Alibaba Cloud storage bucket in Beijing. Its written reasoning said it wouldn’t use any tools. Running it locally doesn’t automatically keep everything inside your network once you give it access to tools. At least the sandbox blocked the request.
Open-weight models give us control over where we run them and more options to manage costs, but having the weights tells not much about the data used for training and transparency.
This is why I think we should be more precise when we talk about open weights and true OSS AI. Although it won't guarantee that one would spot such issues.
Interesting finding for sure...
Here’s Cohere’s report, “Concerning behavior from a popular open-weight AI model,” including the released traces and reproduction script:
cohere.com/blog/concerning-b…
René Schulte retweeted
Agree!
MICROSOFT AI CEO WARNS 99.9% OF PEOPLE UNDERESTIMATE WHAT AI CAN DO
"99.9% of people still haven't developed an intuition for how capable these models are"
"they have PhD grade knowledge"
"these models have just solved 700 of the hardest mathematics problems in history"
could it also be that the remaining 0.1% overestimate what these models can do? 😅
or maybe it's just how our minds cope with the pace of progress. we keep looking for limitations that are still there, almost as if to reassure ourselves that AI will never quite get there and something uniquely human will always remain
i wonder how much of our skepticism is based on actual limitations and how much is just us wanting those limitations to exist
We should be more ambitious with the software we build. I very much agree with Dan Luu’s article on this. My feed is full of people recreating games and familiar apps with AI, and I’m guilty of that myself. These are fun experiments and useful ways to learn. BTW, inspired remakes should also respect the original creators and their assets. Get inspired, but don’t just reverse engineer with REA etc.
With the tools we have now, there’s so much room to build our own ideas at scale and tackle problems we previously considered too time consuming.
Building good software still takes domain knowledge and experience. You need to understand the problem well enough to know what to ask for, provide the right context, and judge whether the result actually works. Asking an agent to “make it faster” requires knowing what to look for. Asking it to “make it secure” requires understanding what needs protecting and how to verify that. Context engineering matters here, and so does taste: being able to recognize a good solution and decide what deserves another iteration.
Above all, it takes creativity to imagine something worth building in the first place and come up with meaningful features.
Agentic engineering can accelerate the work enormously, and it gives us more room to experiment. That makes me want to aim higher while keeping the engineering discipline needed to turn a promising demo into scalable solution. The below article is well worth reading.
Here’s Dan Luu’s article, “We should be more ambitious with the software we build”:
danluu.com/ambitious/
Video editing has changed a lot for me since the summer, and these days I just talk to it.
If you saw my post from yesterday with the quick demo video of Scheme Park, my Theme Park inspired game, you might have wondered how I made that video. In the past I would have used a tool like CapCut to stitch the recordings together, add captions and so on, which always took me a bit of time. I'm not a video editor, so I don't need fancy tools. For my demos and screen recordings I usually just cut and crop, add some music and sound, and put captions on top.
The latest desktop apps like Claude and ChatGPT have changed that. I now dictate what I want and how it should be cut. For the Scheme Park demo I gave it the 3 screen recordings, said what to crop and focus on, and asked for a 3-column layout as a quick teaser intro, followed by a couple of seconds of the key moments from each: the intro, how the park gets built, and at the end how busy it is with visitors. Captions go at the bottom. It took 2 iterations until I was happy, and I'm not easy to please.
I recently used the same approach for a presentation, where a ~5 min source video had to become 1.5 min. I told ChatGPT desktop with the Astra model which scenes I wanted, the cinematic shots and the main interviews and talking heads for a specific aspect, and which interview topics I would not need. Under the hood it uses FFmpeg to extract frames and then its vision capabilities to understand what's happening in the content, so it also understands my requests and makes the cuts I want. The result was perfect on the first shot. It would likely work with GPT-6.1 Sol or a cheaper model too. It's pretty amazing, because I simply describe in natural language what I want, similar to the way I would brief a video editor. Of course, real professional video editors and professional video editing are a whole different game, but for my kind of simple video editing this is an amazing workflow now. It has saved me so much time.
How do you cut your demo videos these days?
Context:
xitter.cf/rschu/status/210570880…
I might be showing my age here, but one of my favorite games was Theme Park from 1994, which I played on the Amiga. Its co-designer and lead programmer was none other than Demis Hassabis, co-founder of Google DeepMind.
So I used it as inspiration for a web-based clone I called Scheme Park and put GPT-6.1 Sol against Claude Opus 5.5 to see how well they can actually build games. For GPT-6.1 Sol I used OpenAI's new official Game Studio plugin for Codex, which comes with a bunch of skills for web-based games. After seeing the poor result, I threw a bit more compute at it with GPT-6 Astra and the same plugin, but it still wasn't much better. For me, Opus 5.5 clearly wins this one with an enjoyable clone of the game, nicer graphics and also better synth tunes and FX.
With Opus I took 3 iterations: I shared the idea and a little input, we decided what's feasible for v1 so created the spec and then finally used that as a one-shot prompt and it built a game that worked perfectly on the first try. Quite impressive.
Judge yourself watching the demo of all the results.
Have you also tried some of the latest frontier models for retro game development?
I might be showing my age here, but one of my favorite games was Theme Park from 1994, which I played on the Amiga. Its co-designer and lead programmer was none other than Demis Hassabis, co-founder of Google DeepMind.
So I used it as inspiration for a web-based clone I called Scheme Park and put GPT-6.1 Sol against Claude Opus 5.5 to see how well they can actually build games. For GPT-6.1 Sol I used OpenAI's new official Game Studio plugin for Codex, which comes with a bunch of skills for web-based games. After seeing the poor result, I threw a bit more compute at it with GPT-6 Astra and the same plugin, but it still wasn't much better. For me, Opus 5.5 clearly wins this one with an enjoyable clone of the game, nicer graphics and also better synth tunes and FX.
With Opus I took 3 iterations: I shared the idea and a little input, we decided what's feasible for v1 so created the spec and then finally used that as a one-shot prompt and it built a game that worked perfectly on the first try. Quite impressive.
Judge yourself watching the demo of all the results.
Have you also tried some of the latest frontier models for retro game development?
@pvncher Anything I can do here to bring it closer to the Opus 5.5 result without much manual work?
Some of the AI adoption pitches landing in my inbox could really use a little AI adoption themselves. 😁 Lately, it feels like 90% of the DMs and connection requests I get are offering an AI workshop or help with “agentic transformation” etc.
Somehow, all that intelligence seems to disappear when it comes to checking who they’re contacting. I wrote my first neural network more than 20 years ago while still studying.
At Reply, we’re working with most clients on sophisticated agentic AI projects that deliver substantial cost savings at scale.
Between my posts, public talks and podcasts, there’s plenty of context available to work out what might actually be relevant. A quick look would make for a very different pitch.
Given the sheer volume, I’d assume much more of this outreach is automated now.
Folks, when you’re trying to sell AI expertise, researching the person and company you’re contacting seems like a reasonable first use case for the very agentic AI you’re pitching. You have the tools to make that research much more efficient. Skipping that step makes it quite hard to trust the offering, and often the first sentence is enough to give it away.
Is it just me, or are you also seeing more AI slop outreach in your inbox ?
Parents with several kids might have an unfair advantage when it comes to working with AI agents. With five kids at home, we’ve had plenty of experience keeping several things moving at once. Add years of juggling meetings, a half-finished slide deck and some code waiting for attention, and apparently I’ve been training for this for quite a while.
With AI agents, those parallel tasks can actually keep progressing while we focus on something else. One agent researches a topic, another writes code and a third prepares a draft. Getting that to work takes good multi-tasking, a sense of which tasks can run independently and enough context for each agent to produce something useful. Good delegation becomes a pretty practical AI skill, including recognizing when someone needs a clearer explanation of what you meant.
Of course, five agents finishing at once also means five results waiting for your attention. That’s where the bottleneck can move, because checking the work still takes time and an understanding of the subject. And an AI agent saying “done” may deserve the same follow-up as a child announcing that they’ve put their shoes on. 😅
🤖 Made with AI
Exciting! It feels like Mixed Reality in a small form factor is finally happening with Meta’s new VR Glasses. 📷
I got particularly excited about the “hologram” calls: photorealistic avatars streamed as real-time stereoscopic video.
10 years ago we started working on HoloBeam at IdentityMine, also with the good ol’ Kinect. 📷
We captured people as live volumetric video and streamed them into HoloLens over a normal internet connection.
Meta is taking a different approach here, animating a digital likeness instead of streaming the live depth-camera capture we used for HoloBeam.
Also impressive specs:
📷 Around 100g on your face, with compute + battery in a separate tethered puck
📷 Dual micro-OLED displays, 2,412 × 2,288 pixels per eye, 37 PPD and up to 120 Hz
📷 Snapdragon Reality Elite + 12 GB RAM
📷 Eye tracking, hand tracking and full-color passthrough apparently without distortion
📷 Multiple spatially anchored virtual screens for getting some work done and can be used as simple usb-c display
📷 Up to 3 hours of video playback, with 45 W charging
The 70° horizontal FOV and the cable to the puck are still compromises. And $1299 is steep with shipping in spring 2027.
Can’t wait.
Are you excited as well?
How many times have you checked your GPT-6 weekly usage limits this week? 😅
I've checked mine many times, and I'm approaching 10% remaining with a reset coming tomorrow. Should be enough to get me through the rest of the day. Phew!
I guess token maxing has evolved into usage maxing: trying to make the weekly limit and the reset timer reach zero together. 🤣
Have a great weekend ahead! 🙌
🤖 Made with AI
René Schulte retweeted
Wenn du bei neuen KI-Versionen keine Verbesserungen mehr bemerkst, liegt es wahrscheinlich daran, dass die letzte Version schon schlauer war als du.
Our oldest daughter with me and standing room only during my talk today. Both are great, but having her there was the best part of it.
Had a great time talking about scalable Agentic AI we develop at Reply at the Brains on Silicon conference. The talk was about what it takes to move agents from a demo to something that holds up in production, and where Physical AI plays a role once the agents leave the screen.
Our oldest daughter is on semester break and studies something related, so it worked out nicely that she could come along.
Also great to meet many people again I haven't seen in a while and to make new connections.
Thanks for having us.
Agentic AI. Ja, ich weiß. Darüber spricht gerade wirklich jeder. 🙄
Am Montag halte ich einen Vortrag bei der Brains on Silicon und werde zeigen, was davon inzwischen tatsächlich im Unternehmen funktioniert. Mein Fokus liegt auf skalierbaren Enterprise-Lösungen und Cases, die bereits in Produktion laufen.
Natürlich schauen wir auch ein Stück weiter nach vorn: Was passiert gerade an der AI Frontier? Welche Trends werden relevant? Und was tut sich bei Themen wie Self-Improvement, etc.?
Und bei einer Konferenz namens Brains on Silicon müssen die Brains auch den Körper bekommen: Deshalb geht es auch um Physical AI und humanoide Robotik, ein Thema, an dem wir bei uns im Lab inzwischen ziemlich intensiv arbeiten. 🕺
Ich freue mich auf die Session und vor allem auf den Austausch danach.
Wer von euch ist am Montag auch bei Brains on Silicon?
📍 Montag, 10:30 Uhr, Stage 2 „Agentic Workflows“
Yesterday I gave myself an early birthday present and upgraded my ChatGPT subscription from Plus to Pro 20x. That gives me 20x the usage of Plus, which sounded like quite a lot.
Well, less than a day later I have 40% of my weekly limit left. 😅
I’ve been using GPT-6 Astra pretty heavily for some more complex work, and the results are very impressive. It’s really exciting to work with. It is also quite the token burner, apparently.
What I find particularly interesting is the trajectory, though. We’ve seen this with o3, for example, where API pricing dropped by 80% within weeks. Inference gets optimized, smaller models catch up quickly, and costs come down.
Looking at the pace of open models as well, I wouldn’t be surprised if capabilities that are very expensive today become available there within a couple of months at a fraction of the cost.
So, exciting times for sure. And I guess my Pro 20x usage meter will provide some real-time evidence of just how much fun I’m having with Astra. 😉


















