
Principal Animation Programmer @epicgames on @unrealengine. Previously anim tech lead at @amazon and other places. I like coding, investing and gaming.
Joined May 2015
- Tweets2.7K
- Following247
- Followers2.1K
- Likes5.9K
Pinned Tweet
Here's a screengrab of the sections of the ML Deformer presentation in the State of Unreal stream that shows it in action.
It shows an approximation to a full muscle sim that takes 1 minute per frame normally. Also does cloth approximation. Running live on PS5. #mldeformer #ue5
I'm working on making Gaia (likely new name for AnimGenOffline) and Kimodo work well with AI agents inside UE 5.9. The official release will work way better with agents than the previews so far.
It will be able to work like 20x faster than the preview versions according to some tests. So way less time spent by agents, also reducing costs a lot.
The prompt to the agent asks it to walk to the car, open the door and get inside.
The Kimodo one is what it generated through Kimodo by controlling that through Gaia and the Agent Only is just purely Opus 5.5 generating the animation without Gaia or Kimodo. It's just one shot, without any iterations.
It's not perfect, but it's already cool to see this working.
Also Preview 2 now should work fine without python errors. The Geforce 5xxx series will just fall back to CPU for now, but hopefully that will be GPU accelerated in the official release. Please let me know if you still run into any issues somehow.
#UE5 #Gaia #Kimodo
John van der Burg retweeted
Introducing improved character animation workflows in the UE 5.9 Preview 2!
You can now generate animation directly inside Sequencer using the new AnimGenOffline plugin, and use the new @NVIDIAGameDev Kimodo plugin with it to make characters follow trajectories, set key poses and describe animations based on text descriptions.
Our new Guided AI Animation plugin integrates NVIDIA Kimodo with Sequencer and animation tools, enabling AI-assisted animation generation from text prompts, trajectory paths, and frame-specific target poses.
Learn more➡️ dev.epicgames.com/documentat…
John van der Burg retweeted
Unreal Engine 5.9のプレビュー版、
めちゃくちゃアツい…❤️🔥
エージェント型ワークフローをメインに作られた初のバージョンで、しかもNVIDIAのモーション生成AI「Kimodo」を使えるEpic公式プラグインが最初から入ってます(まだ実験的機能)。
この4人の歩き、キーフレームは一切打ってません。
床にスッと線を1本引いて、英語でひとこと書いただけ。
同じ線でも、プロンプトを変えるだけで
忍び足、おじいちゃん歩き、ゾンビ、モデルウォーク…
歩き方がまるっきり別物になります。
・1回の生成は20秒ちょい
・一度に4パターン出してくれる
・「ここだけはこのポーズ」って一瞬だけ指定もできる
・クラウド不要、ぜんぶ手元のPCで完結
Trying UE 5.9 vibe game dev a bit. I tried to use mostly local models, so using local image gen, music generation, modeling, etc. Only took one evening. I mean it's not much of course, but fun to play with. Might try to polish it a bit and continue with it. Based on a 2D game I worked on many years ago but never continued with.
Still used Astra though so not fully local. A few explosion sound fx downloaded and 2 images for vegetation I think.
Even has some loopable animation generated with Kimodo, although you can't really see it :) And ragdoll officers that fly into the air when hit by bombs, but not so visible :)
#UE5
John van der Burg retweeted
Text-to-Animation, Now Free and Local in Unreal Engine 5.9. No Mocap, No Subscription
Type a motion in Sequencer, and the new Kimodo plugin animates your own character locally, for free.
Highlights:
• Two experimental plugins in 5.9 Preview 1: AnimGenOffline and Kimodo
• Auto retarget to your humanoid, baked as an Animation Sequence
• Spline paths and key poses via Control Rig
• Text model on CPU, about 1 GB of VRAM
• No fingers yet
Source: @smart_poly
John van der Burg retweeted
Fable 5.2 で、曲に合わせた演奏モーションを付けられるようになりました
曲(mp3)からベースの音符を検出し
Kimodo(UE 5.9 の AnimGenOffline)で動き生成
Unity 上で指先を弦の正しい位置に合わせる補正と、足の固定・体の揺れを加えています
John van der Burg retweeted
Unreal Engine 5.9's AnimGen plugin is INSANE! 🤯
You can now generate character animations directly inside Unreal Engine 5.9 using AI, completely FREE on your local GPU!
No subscriptions. No cloud processing. Just text-to-animation directly inside Unreal Engine!
UE 5.9 preview 1 now ships with a new plugin I worked on called AnimGenOffline (name might change) which allows you to guide animations at high level and use AI to generate the actual frames. This integrates that functionality into Sequencer.
As initial plugin into this system we integrated NVidia's Kimodo. But the system itself is not limited to this. Basically any algo that generates pose data over time can integrate with it.
You can draw splines and make characters follow them, type a style in text, set target key poses at certain frames, etc. You can pose your character directly with Control Rig and retargeting is all handled automatically.
You can also type: "Use Kimodo to generate an animation of a drunk person walking forward and save it as an Animation Sequence asset in /Game/Anims/DrunkWalk".
Weights still have to be downloaded from Huggingface (goes automatically after creating an account and read-only token etc). We're working on making that easier too.
It can run on basically any PC, but for fastest generation you need a Geforce 3xxx series or better. And probably Windows only for now, although I haven't tried on other platforms yet.
This is just the start of course!
Worked on this with @FredNilsson
Will show some videos soonish, or share some community videos.
The Unreal Engine 5.9 MegaJam Preview is here!
It’s the first Unreal Engine release built primarily with agentic workflows and opens up a few new Experimental features: check out Unreal MCP’s expanded toolsets, work with AI coding agents directly in Editor, explore AI-assisted content creation, and run your projects in a browser.
This isn’t your typical Unreal Engine Preview, but it’s ready just in time for the Epic MegaJam.
Invite your agents and start experimenting: epic.gm/ue-5-9-preview
Just a little headsup: there are some python issues in the preview 1. You can work around it by pasting the errors in an AI agent. But will fix that for preview 2 of course. Also if you have a Geforce 5xxx series generation on GPU will fail becuase the engine ships a too old version of PyTorch which isn't compatible with that. We're also working on that.
Bit rough around the edges still lol :) But will be fixed!
1
7
950
John van der Burg retweeted
We vibe coded the Epic Games Launcher to be faster than the other guy.
Don't believe us? Test it out for yourself in Preview:
launcher.epicgames.com
Some strong tents! Now coupled simulation, so cloth interacts with cloth and other objects.
This ain't realtime btw. I guess next would be tearing/damage on the tent. But I first need to optimize it some more.
First subtle cloth sim results with self collisions and collision with objects, and some wind simulation and ropes.
13
751
Working on some more physics stuff. Building a little tower of London inspired scene that will involve some trebuchets firing projectiles.
The simulation will be pretty advanced on this one. Aiming to include fire, smoke, destruction, fluids, realistic material bending, mud simulation, cloth sim and damage and more, all in a coupled simulation. That's the goal at least, and not realtime. Just the goal, not fully realized yet :)
2
6
601
Some initial destruction with Pinata. All is dynamic, so no pre-fracturing. There is also some stress calculations to make stuff collapse when it should.
John van der Burg retweeted
My god this is such a good speech that every SWE needs to hear. You know what? Every person should hear it
Keep the happy memories, eyes on the reality, be excited about the future. That’s the best that anyone can do
Little disclaimer, this is of course not the average game scenario. This is like worst case 4000 boxes on a pile. That doesn't happen often in game. So this might make Chaos look worse than it is of course.
108
Some more improvements. This runs over 24000 cubes at over 100 fps, none of them are sleeping. It's running on the GPU now, but with sync back to CPU/RAM, which is of course a bottleneck. But this is now basically running instanced static meshes in UE, but simulation done on the GPU in compute shaders.
I can do a 100% GPU sim too which will allow way more objects. But with read-back it feels more 'real'. More experiments coming up soon :))
Need moar cubes! Tens of thousands of them! :)
Sorry for the blurry mess, I think something with the motion vectors not updating. Every cube is actively simulated and generating contacts. Trying to take another approach and got some first results.
Much faster performance. Data oriented design with full SIMD now. I think its like 4x faster than before.
Still need to get my multithreading faster and some more optims. But from my profiles in some tests it was now on par with Box3D and PhysX and Jolt performance wise (need to try different tests and Pinata has way less features of course). It is about 2x as fast as Chaos physics in the test I ran (using UE 5.6).
I noticed some parts of Chaos are very slow. I might try optimize that as side quest sometime at work lol. Already got several side quests though :S
I guess I'll check multithreading performance next and try to optimize that.
Further stability improvements. Added some initial optimizations. Still have to do bigger optimizations though. This is also a bit worst case, all in one big pile :)
Have to test in a shipping build also to see if that makes any difference. Will do some design changes soon to make it data oriented for better perf.
12
833













