
AI @Roblox. Projects at https://xitter.cf/t.co/GZ9OF5sgak. Made UE5 ModelingMode & GeoScript @epicgames. Invented @autodesk @meshmixer. PhD in Computer Shapes.
Toronto šØš¦
Joined September 2011
- Tweets7.8K
- Following573
- Followers8.4K
- Likes8.2K
itās funny how if you make any kind of web data viewer or control panel now, everyone just thinks itās some slop UI they can ignore, and that you canāt possibly have put any thought into it.
Ryan Schmidt retweeted
watching LLMs replicate UIās of existing CAD systems and calling them āAI-native CADā is like Henry Ford watching people build these and call them āEngine-powered horseāsā
Ryan Schmidt retweeted
PSA: if you are using a startupās product, founders genuinely love if you reach out to them to give feedback. i would be 10x happier if i had 10x the feedback
Ryan Schmidt retweeted
So basically, today PHP got two critical bugs that let anyone run code on your server without even logging in, which is bad, and then the details leaked before the patch was even out, which is worse, and it works on WordPress and MediaWiki and Magento and Joomla and Laravel, and Censys says like 1.5 million servers are running a version with no fix, so the NSA was like "take your system offline," and the FBI was like "take your system offline," and CISA and the UK and CERT-EU were all like "take your system offline," and then the Prime Minister of Japan, the actual Prime Minister, posted at 5:55 in the morning telling 48.8 million people to take their system offline, so everyone took their system offline, like the Dutch cybersecurity agency took its own website offline, and the Dutch parliament went offline, and the Port of Rotterdam went offline, and Finland and France and Denmark started pulling government sites, and Wikipedia went down, and Archive.org went down, and Asana and GOG and Something Awful went down, and the University of Vienna's webmail went down for some reason, and that's just PHP. Because GitLab also dropped a CVSS 10.0, which is the highest score they give out, for a bug that's been there since 2014, so that's every self-hosted GitLab for twelve years, and then LiteLLM 1.107.0 got hijacked and shipped a credential stealer and a remote access trojan in every single wheel and the Docker images, including latest, and you didn't even have to import it, just installing it was enough, and it's the second time this year, and then Railway paused every deployment on the entire platform because someone got into the environment variables, so now everyone has to rotate every secret they've ever stored there, and TiDB Cloud said someone was walking around inside with stolen credentials for basically a month and an extortion group says they took 10.6 terabytes, and Zeabur got breached for the second time in two months and is just shutting down, like the whole company, and Node.js patched remote code execution and a TLS bypass, and CISA says Plex is being actively exploited, and someone took over 300 Tor exit relays to steal SSH passwords, and SafePay ransomware has hit over 600 critical infrastructure orgs, and India's biggest bank filed a data loss incident, and Japan has been in an official state of emergency in cyberspace since October 9, which honestly explains the 5:55 AM post. Oh, and eMudhra, a certificate authority that's issued over 60 million certificates, whose entire job is proving websites are who they say they are, was supposed to be using private keys that are random numbers over a hundred digits long, and one of them was 4. Just 4. And the others were like 66 and 237. Anyway, it's Wednesday.
Ryan Schmidt retweeted
Today, weāre introducing Ideogram's first vector model.
Generate clean, editable SVGs with smooth gradients and sharp typography from a text prompt, or turn any image into a detailed, scalable vector.
Live in Ideogram and the API: ideogram.ai/models/vector
Ryan Schmidt retweeted
[8/n] By the way, for the simulation folks wondering how we simulated tight-clearance parts: the usual tools didn't work for us. SDF was so slow and hard to tune. Off-the-shelf convex decomposition like V-HACD or CoACD filled the clearance, so parts that should fit jam.
So we built mjfit. It decomposes common assembly parts (pegs and holes of any outline, threads, and gears) into convex pieces that keep the clearance exactly as designed, and it runs an order of magnitude faster than SDF.
It's open source: github.com/younghyopark/mjfiā¦
great example of what can happen when an AI-empowered Artist sets out to achieve a specific vision - building custom tools to explore the design space, vs just accepting "something that looks good" from the slot machine.
Well, as you've probably noticed, there's a controversial discussion going on, and since controversy isn't something I shy away from, I'd like to chip in.
Specifically I would like to show example of using Ai acceleration to achieve YOUR vision while maintain absolute control over the result, hence this thread.
So here's a tool I've made, which I'll talk about a bit more in the comments.
#gamedev #indiedev
Ryan Schmidt retweeted
A lot of folks getting into game dev with ai donāt know this but, you really need to make sure your game is fun without a bunch of fancy art.
Llms make it too easy to build visually rich levels with no real gameplay. Thatās backwards!
revisiting an old opus4.6 project with opus5.5, interesting how many bugs it is discovering as it just does general work (ie not explicitly trying to find or fix those bugs, just seeing them as it passes through).
Ryan Schmidt retweeted
If anyone's interested in what I've been up to lately, I've been leading development of some 3D foundation models at @Robloxālike a next-gen texture generator, released today: devforum.roblox.com/t/beta-iā¦
4k resolution, PBR materialsā¦Ā and it's free. :-)
Also gets some things right that are important in practice (and annoying with other tools), like generating good texture even in spots where different parts of the mesh intersect.
Was happy this required not just ML, but some classic signal processing to really get right. Great work, by a great team.
Has definitely been a journey of understanding how generative AI tools can be designed as just another level of abstraction for creationārather than a āone shotā replacement for artists. Still a lot of work to do, and more to comeā¦
Ryan Schmidt retweeted
This is very true. Here is Qwen 3.8 27B compared to all the sota models 1 year ago today on artificial analysis.
If 27B released a year ago, it would be the best model in the world by a wide margin.
interesting thread about NVidia's "new" CAD kernel. Like most major CAD kernels its code goes back to the 70's - but it is quite different than Parasolid/ACIS/etc.
Ryan Schmidt retweeted
ive wanted something like this for years, and today, i can one-shot it.
code's on github. ask your agent to add your own, commonly used functions
github.com/azadbal/RightClicā¦
made my Roblox tools plugin be live-code-able by claude/codex - the tool system (UI & functionality) is (safely) hot-reloaded on file changes. Then I added an agent-chat inside it, so the plugin can edit itself, ie live-code it's own tools & other features. (link below)
I was pleasantly surprised that this all could work so smoothly (credit to claude who figured out how to do it). Lua scriptability of Studio is really good, especially in-viewport 2D UI.
open-source on github (ask your agent to install it): github.com/gradientspace/stuā¦
new Roblox terrain system (3D SDF-based) is good, I especially like the procedural elements. Hasn't shipped yet but it will be a huge step up in visual fidelity when it does.
At #RDC26, we shared whatās next for terrain and worldbuilding.
Hereās our breakout session āTerrain Reimagined: An Early Previewā where we:
1) Get into the technical details of what weāre shipping and why for the very first time.
2) Host a fun and insightful fireside chat with special guests @steakbacon (founder of @looknorthworld and co-founder of @Bungie) and @Erythia_roblox (Creative Director at @Twin_Atlas).
Hope it's helpful!
youtu.be/BiIAmVN6r2M?si=jSoSā¦
supise suprise!
I have tried having agents port one of my 3D tools (a 2D/3D sketching app) from desktop to web. Not even 1/10th the size of Photoshop. I gave it the full source code. It had Playwright. We spent several hours planning. I set up guardrails. I said "validate everything against the source, do an amazing job, make no mistakes".
It was still a shitshow. It doesn't matter how good 'computer use' gets, coding agents do not understand what is important vs not-important in a complex UI unless you tell them explicitly. They are pretty good at basic buttons and other trivial web UI stuff. Ask them to build a custom widget for a precise 2D/3D interaction without super explicit instructions, and what you get is nearly always dogshit. They can't know what "feels right" because we can't actually describe it in words.
They cannot keep even a small fraction of the actual app code in context. So they are working off 'memory' which means they are constantly deviating. It works OK for math/algorithms/libraries where things are generally componentized and easy to validate. It does not work for framework/UI type stuff where there are little bits of functionality across the entire app, that have to interact *just right*.
(you know, the kind of stuff that gives you Photoshop vs GIMP...)
So even for porting a small app, you have to be on top of it constantly, checking everything it does, because it's going to fuck up *all the time*. And not just in all the small ways. Also ways like "This button doesn't work because the agents interpreted one single phrase in the prompt in an unexpected way and so decided to skip the entire subsystem the button talks to".
Do you think the guy robo-porting the entire Creative Suite in a week is putting in that time and attention? Testing everything (anything)? Clearly not. That's why it takes huge teams to build this kind of software. Because at some point someone - often a whole team of people - had to give a shit about every tiny little bit of it.
The robots are amazing code-typists. I haven't typed a line of code in months. But I don't let it decide how a UI should work, that's stupid.


















