Jiteng Mu (@JitengMu) profile picture

@Adobe Firefly. Ph.D. @UCSD ; M.S. @JohnsHopkins ; Intern @Nvidia @Adobe

Joined March 2018
Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)Photo by Jiteng Mu (@JitengMu)
Do we need separate models for image editing and conditional generation? We introduce🌟EditAR, a unified autoregressive model for diverse tasks, e.g., image editing, depth-to-image, edge-to-image, segmentation-to-image. jitengmu.github.io/EditAR/ More details🧵👇
5
31
4
147
36,336
When an image-editing agent fails, does it really need another try? Introducing our new paper: EditAgent: Rethinking Agentic Image Editing. We argue that editing agents are bounded by two spaces: 🔧 Action space: what the agent can do. 🔍 Observation space: what its judge can see. Three findings: 1️⃣ Expanding the action space matters. Across 600 expert-annotated candidate sets, FLUX.2-klein-9B produced no acceptable candidate in 42.7%. Specialized methods rescued 175 of those 256 failures. 2️⃣ Expand what the judge can observe. EditAgent enriches the observation space with parallel candidates for comparison, task-specific verification evidence, and earlier images and requests as historical context—supporting better candidate selection and detecting when a new edit undoes an earlier one. 3️⃣ Explore diverse alternatives through parallel search. Different specialists, generalists, and repeated samples offer different ways to fulfill a request. Parallel search lets the judge compare these alternatives, while generating each candidate from the same source avoids carrying errors from one attempt into the next. Even with a single editor and the same four-generation budget, experts preferred parallel search over sequential refinement in 78.5% of non-tied comparisons—with at most half as many judge calls. EditAgent expands both spaces and connects them through parallel candidate generation and comparative judging. It improves two editing backbones on three benchmarks, and its accepted sessions provide training data that strengthens standalone editors. Our takeaway: building reliable editing agents requires expanding both what they can do and what their judges can observe.
8
6
1
23
33,620
I will join Tsinghua University, College of AI, as an Assistant Professor in the coming month. I am actively looking for 2026 spring interns and future PhDs (ping me if you are in #NeurIPS). It has been an incredible journey of 10 years since I attended an activity organized by Tsinghua University and decided to change my undergraduate major from Economics to Computer Science, inspired by one of the teammates. During the 10 years, I met with appreciation of many wonderful researchers/professors who led me to continued growth. 🐿️ My research focus will continue to be AI & Robotics, with a specific emphasis on Interactive Embodied Intelligence. You can check my homepage to learn more: maureenzou.github.io/lab.htm…. I am currently local to San Diego and will be attending #NeurIPS. Please ping me over WeChat or Email if any old or new friends are interested in having a coffee chat! (Really looking forward to meeting as many friends as possible at #NeurIPS) [The photo is one of the places that I will miss a lot in the US]
69
81
13
1,091
113,497
How to generate billion-scale manipulation demonstrations easily? Let us leverage generative models! 🤖✨ We introduce Dex1B, a framework that generates 1 BILLION diverse dexterous hand demonstrations for both grasping 🖐️and articulation 💻 tasks using a simple C-VAE model.
15
90
16
374
73,506
It's challenging, but so rewarding! Thank you, @xiaolonw, 🥰 for being a steady source of support and mentorship. I am especially grateful for the freedom you gave me to follow my curiosity. I also feel lucky to have shared this journey with such an inspiring group of labmates!
Congratulations to the graduation of @Jerry_XU_Jiarui @JitengMu @RchalYang @YinboChen ! I am excited for their future journeys in industry: Jiarui -> OpenAI Jiteng -> Adobe Ruihan -> Amazon Yinbo -> OpenAI
5
24
1,863
🥳 EditAR code is released! Welcome to check it out. 👉Presenting EditAR at #CVPR2025! (Friday afternoon, Jun 13, 4:00pm-6:00pm, Hall D #242) Code: github.com/JitengMu/EditAR Project: jitengmu.github.io/EditAR
Do we need separate models for image editing and conditional generation? We introduce🌟EditAR, a unified autoregressive model for diverse tasks, e.g., image editing, depth-to-image, edge-to-image, segmentation-to-image. jitengmu.github.io/EditAR/ More details🧵👇
1
4
31
3,976
Test-Time Training (TTT) is now on Video! And not just a 5-second video. We can generate a full 1-min video! TTT module is an RNN module that provides an explicit and efficient memory mechanism. It models the hidden state of an RNN with a machine learning model, which is updated via gradient descent. Combined with a Diffusion Transformer, we are able to generate a 1-min Tom and Jerry cartoon. Enjoy our video with input script (not seen before): Jerry happily eats cheese in a tidy kitchen until Tom playfully takes it away, teasing him. Annoyed, Jerry packs his belongings and leaves home, dragging a small suitcase behind him. Later, Tom notices Jerry's absence, feels sad, and follows Jerry's tiny footprints all the way to San Francisco. Jerry sits disheartened in an alleyway, where Tom finds him, gently offering cheese as an apology. Jerry forgives Tom, accepts the cheese, and the two return home together, their friendship restored.
29
162
40
1,205
186,786
Today's visual generative models are mere stochastic parrots of imagery, much like early language models, which could only statistically mimic short sentences with little reasoning. In contrast, modern large language models (LLMs) can comprehend long documents, keep track of dense information contexts, reason about complex problems, all the while providing natural human interactions. Reve’s mission is to invent the future of intent-driven visual creation. Capturing creative intent requires advanced machine understanding of natural language and other interactions. Turning this intent into compelling visuals calls for interactive systems that have a deep understanding of the visual world they generate, so they can iteratively amend it. Our vision is to build a new semantic intermediate representation that both a human and a machine can understand, reason about, and operate on, together with a probabilistic render to decode that representation. Today, we are thrilled to share our first renderer, Reve Image, with the world! (also, it’s [ʀɛv], from “rêve” 🙂)
Halfmoon is Reve Image — and it’s the best image model in the world 🥇 (🔊)
32
28
3
207
30,490
Excited to come out of stealth at @reveimage! Today's text-to-image/video models, in contrast to LLMs, lack logic. Images seem plausible initially but fall apart under scrutiny: painting techniques don't match, props don't carry meaning, and compositions lack intention. (1/4)
The Halfmoon 🌓 reveal: Congratulations to @reveimage on creating the world’s leading image generation model with Reve Image! Reve Image has been in the Artificial Analysis Image Arena over the past week and is the clear leader, beating strong competition including Recraft V3, Google's Imagen 3, Midjourney v6.1, and Black Forest Lab's FLUX.1.1 [pro]. The model stands out for its impressive text rendering, prompt adherence, and aesthetics. Currently, the model is accessible through Reve’s website (link below), an API is not yet available. See below for example images and a link to try the model out for yourself 🧵
41
83
20
823
150,926
Jiteng Mu retweeted
Meet our first general-purpose robot at @DexmateAI dexmate.ai/vega Adjustable height from 0.66m to 2.2m: compact enough for an SUV, tall enough to reach those impossible high shelves. Powerful dual arms (15lbs payload each) and omni-directional mobility for ultimate versatility. More videos showcasing Vega in action coming this week! Stay tuned to see this robot partner.
Introducing Vega: 🤖 @DexmateAI's newest robot that makes complex manipulation tasks simple. ✨ A step closer to intelligence and automation. 🚀 🎥 Watch now: youtu.be/PecqfiJNwQI #Robotics #AI #Automation
14
36
6
221
33,256
Glad to share EditAR has been accepted to @CVPR 2025 ! jitengmu.github.io/EditAR/
Do we need separate models for image editing and conditional generation? We introduce🌟EditAR, a unified autoregressive model for diverse tasks, e.g., image editing, depth-to-image, edge-to-image, segmentation-to-image. jitengmu.github.io/EditAR/ More details🧵👇
3
14
53
7,501
🐅 Want to rig your favorite meme character? Try “RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assets”! ✨RigAnything is a transformer-based model that sequentially generates skeletons without predefined templates. It creates high-quality skeletons for shapes in any pose, completing rigging in under 2 seconds per shape. 🧵(1/n)
20
220
28
1,253
129,839
Introducing “Diffusion Autoencoders are Scalable Image Tokenizers” (DiTo). We show that with proper designs and scaling up, diffusion autoencoders (a single L2 loss) can outperform the GAN-LPIPS tokenizers (hybrid losses) used in current SOTA generative models. (1/4)
6
100
7
495
90,923
Autoregressive models are picking up for image generation, but how about image editing? Given an image and a language description, we train one Autoregressive Transformer to do ANY EDITING.
Do we need separate models for image editing and conditional generation? We introduce🌟EditAR, a unified autoregressive model for diverse tasks, e.g., image editing, depth-to-image, edge-to-image, segmentation-to-image. jitengmu.github.io/EditAR/ More details🧵👇
7
12
80
13,734
EditAR produces photo-realistic results and offers substantial sample diversity. Our experiments show that it achieves even better FID 🌟compared to various specialized diffusion methods.
1
1
2
769
Human videos are scaling up vision-language navigation! 🚀 It has been a rewarding journey to tame the VLM into the VLA model and enable it to learn from real-world human touring videos🚶🏽. Watching robots move through all kinds of places, following our instructions, and doing it all WITHOUT A MAP is amazing! Checkout our page: navila-bot.github.io
Without any maps and prior knowledge of the scene, our humanoid and quadruped can now navigate with human language instructions to anywhere outdoors and in any house we go!🔥🔥🔥 Introducing NaVILA, a 2-level navigation foundation model (mid-level action VLA + locomotion skills) leveraging massive offline datasets, e.g., not only sim envs, but also human touring videos. A thread 1/N
17
1
59
14,235