Lei Yang retweeted
12 Simulation benchmarks, 8 real robots, 1 question:
Has GPT-6-Astra achieved Embodied Intelligence?
Our answer:
- Embodied competence? Yes.
- Practical embodied inteligence? Not yet.
Here’s what we found: sensenova.ai/has-gpt-6-astra…
HF daily paper: huggingface.co/papers/2610.2…
Lei Yang retweeted
We release the most comprehensive 𝗲𝗺𝗽𝗶𝗿𝗶𝗰𝗮𝗹 𝘀𝘁𝘂𝗱𝘆 𝗼𝗳 𝗚𝗣𝗧-𝟲-𝗔𝘀𝘁𝗿𝗮’𝘀 𝗲𝗺𝗯𝗼𝗱𝗶𝗲𝗱 𝗶𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 across 12 simulation benchmarks and 8 real-robot platforms, together with 𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮-𝗥𝗼𝗯𝗼𝗥𝗦𝗜: an open-source harness framework and a 27B model that runs at ~1/50 the cost of GPT-6-Astra.
Here's what we found:
🔹 𝗧𝗵𝗲 𝗰𝗮𝗽𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗰𝗲𝗶𝗹𝗶𝗻𝗴 𝗶𝘀 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝗺𝘂𝗰𝗵 𝗵𝗶𝗴𝗵𝗲𝗿. Under a unified protocol (ICL + up to 10× the interaction budget), GPT-6-Astra achieves clear SOTA across all 12 benchmarks: RoboDojo: 27.6% at 1× → 81.9% at 10×, DexJoCo: 87.3% vs. 40.3% prior SOTA, while the LIBERO benchmarks are pushed to saturation.
🔹 𝗧𝗼𝗼 𝗺𝘂𝗰𝗵 𝗯𝘂𝗰𝗸 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗯𝗮𝗻𝗴. Even a simple task like placing pens in a holder costs ~$55 in inference.
🔹 𝗧𝗵𝗲 𝘄𝗼𝗿𝗹𝗱 𝗱𝗼𝗲𝘀𝗻’𝘁 𝘄𝗮𝗶𝘁. Time matters as real robots overheat, and an egg burned while the model was still thinking.
Our takeaway: GPT-6-Astra has largely crossed the threshold of 𝗲𝗺𝗯𝗼𝗱𝗶𝗲𝗱 𝗰𝗼𝗺𝗽𝗲𝘁𝗲𝗻𝗰𝗲, but 𝗽𝗿𝗮𝗰𝘁𝗶𝗰𝗮𝗹 𝗲𝗺𝗯𝗼𝗱𝗶𝗲𝗱 𝗶𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 is not here yet.
🌐 Project page: sensenova.ai/has-gpt-6-astra…
📄 Report: sensenova.ai/gpt-6/assets/do…
💻 Code & model: github.com/OpenSenseNova/Sen…
Lei Yang retweeted
Blog for our ECCV paper Demystifying Video Reasoning
In 1935, Erwin Schrödinger put a cat in a box with a Geiger counter. Until you open the box, you do not know if the cat is alive or dead. According to Schrödinger, the cat is alive and dead, at the same time.
90 years later, it is the best picture I have for how a video model solves a problem.
Link: hokindeng.com/schrodingers-c…
A coding model may build a world model, but it is not a world model itself. The neuroscience examples, especially rats' cognition maps, are fascinating. Well worth reading.
Wrote this article in the past few days. GPT-6 stunned many people with its spatial and embodied abilities. Some people shout out: "Coding is All You Need", "Coding is AGI", "Coding is World Model".
Here is a rebuttal. hokindeng.com/coding-is-all-…
Lei Yang retweeted
We hope to launch the Verification Age for video models: 50 scientists, 6 months, 100 rule-based verifiers, 300 new tasks, and a worked RL recipe.
Coding models are advancing crazily thanks to the synthetic RL envs paradigms. Verification via codes or Lean gives models super-human math/coding intelligence like that in Astra and Fable.
However, video models are still in the GPT-3 stage, where we just dump million hours video data into the model training and hope for magic.
In this work,
1) we built 100 rule-based verifiers each paired with a synthetic data generators which give 10k+ diverse samples within the task domain
2) we made additional 300 tasks generators, including classic games i.e. Snake, Gold Miner, Mario, to further scale training data distribution with million samples rendered ready available on HuggingFace
3) ~60 experiments to find a worked RL recipe for video model post-training
4) comparison studies between image models, unified models, video models - which is the best model for visual thinking?
5) failure modes of how VLM-as-Judge will not satisfy video models RL in long term
6) interpretability studies show all image models, unified models, video models emerged "Schrödinger Effect", CoS reasoning through diffusion steps
7) many more insights
A detailed thread [1/n]
Full support @haozhangml and FastVideo! As LightX2V contributors, we also shared H3-Turbo. Quality-preserving speedups are hard, but we share the same vision: making good models accessible on affordable GPUs. Calling it “random pixels” is unfair. We appreciate FastVideo's effort.
oh, thanks for evaluting this for us. We wish we had more compute to distill with more data (like you would have), but it is happy to see that, with our very limited dozens of GPUs, we are already generating good videos.
Also, I hope you could be less mean to us next time, as I believe fastH3 generates sufficient decent videos that many users can already use at much lower cost, definitely not a "random pixel generator"
Lei Yang retweeted
Accepted at ECCV 2026: "Demystifying Video Reasoning"
On Friday Aug 28, first author Ruisi Wang @Rui147000038622 the work at our journal club. The finding: video models don't reason across frames (Chain-of-Frames) — they reason along diffusion denoising steps (Chain-of-Steps).
Paper: arxiv.org/abs/2603.16870
Fri Aug 28 · 7:30 PM PT
RSVP: lu.ma/video-t1jl
Excited to share VBVR-Pro! 💡Our findings suggest that intermediate visual states can matter more than textual rationales, while verifiable rewards enable stronger generative RL than VLM judges. Looking forward to further exploring visual intelligence beyond language. 🚀
💡Videos and images should not be treated merely as inputs to understand or outputs to render. They can be first-class substrates for problem solving beyond language.
🎉Introducing VBVR-Pro: an infrastructure suite for visual intelligence: trainable, verifiable, RL-optimizable, and experimentally controllable.
🔗Homepage: video-reason.com/
SenseNova U1.5 is here. Exciting to see such a big progress since U1.
🎯 Highly controllable: Complex conditioned generation and precise editing
🖼️ High resolution: Stunning 4K output with fine-grained details
⚡ Highly cost-effective: An 8B-MoT model that rivals the latest commercial models
Smaller model. Powerful performance. Limitless creativity.
𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮 𝗨𝟭.𝟱 𝗟𝗶𝘁𝗲 — 𝗦𝗵𝗮𝗿𝗽𝗲𝗿. 𝗠𝗼𝗿𝗲 𝗖𝗼𝗻𝘁𝗿𝗼𝗹𝗹𝗮𝗯𝗹𝗲. 𝗠𝗼𝗿𝗲 𝗖𝗼𝘀𝘁-𝗘𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝘁. An 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲, lightweight native unified multimodal model for visual understanding, generation & editing.
𝗕𝘂𝗶𝗹𝘁 𝗳𝗼𝗿 𝗿𝗲𝗮𝗹-𝘄𝗼𝗿𝗹𝗱 𝘃𝗶𝘀𝘂𝗮𝗹 𝗮𝗿𝘁𝗶𝗳𝗮𝗰𝘁 𝘄𝗼𝗿𝗸𝗳𝗹𝗼𝘄𝘀:
🔹𝗡𝗮𝘁𝗶𝘃𝗲 𝟰𝗞 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗼𝗻 with better detail, composition & realism
🔹𝗖𝗼𝗺𝗽𝗹𝗲𝘅 𝗶𝗻𝘀𝘁𝗿𝘂𝗰𝘁𝗶𝗼𝗻 𝗳𝗼𝗹𝗹𝗼𝘄𝗶𝗻𝗴 across subjects, counts, text, layouts & styles
🔹𝗘𝗻𝗵𝗮𝗻𝗰𝗲𝗱 𝗖𝗵𝗶𝗻𝗲𝘀𝗲/𝗘𝗻𝗴𝗹𝗶𝘀𝗵 𝘁𝗲𝘅𝘁 𝗿𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴 & 𝗺𝘂𝗹𝘁𝗶-𝘁𝗲𝘅𝘁 𝗹𝗮𝘆𝗼𝘂𝘁
🔹𝗣𝗿𝗲𝗰𝗶𝘀𝗲 𝗶𝗺𝗮𝗴𝗲 𝗲𝗱𝗶𝘁𝗶𝗻𝗴 & 𝗰𝗼𝗻𝘁𝗿𝗼𝗹 with visual markers, bounding boxes & multi-image references
Just 𝟴𝗕 parameters — outperforming same-size models in instruction following and editing preservation, while 𝗰𝗼𝗺𝗽𝗲𝘁𝗶𝗻𝗴 𝘄𝗶𝘁𝗵 𝗹𝗮𝗿𝗴𝗲 𝗰𝗼𝗺𝗺𝗲𝗿𝗰𝗶𝗮𝗹 𝗺𝗼𝗱𝗲𝗹𝘀 𝗶𝗻 𝘁𝗲𝘅𝘁 𝗿𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴 𝗮𝗻𝗱 𝗰𝗼𝗺𝗽𝗹𝗲𝘅 𝗹𝗮𝘆𝗼𝘂𝘁𝘀.
🛠️GitHub: github.com/OpenSenseNova/Sen…
🤗HF: huggingface.co/collections/s…
👾Discord: discord.com/invite/BuTXPHmQu…
🎨SenseNova Studio: unify.light-ai.top/
Lei Yang retweeted
𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮 𝗨𝟭.𝟱 𝗟𝗶𝘁𝗲 — 𝗦𝗵𝗮𝗿𝗽𝗲𝗿. 𝗠𝗼𝗿𝗲 𝗖𝗼𝗻𝘁𝗿𝗼𝗹𝗹𝗮𝗯𝗹𝗲. 𝗠𝗼𝗿𝗲 𝗖𝗼𝘀𝘁-𝗘𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝘁. An 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲, lightweight native unified multimodal model for visual understanding, generation & editing.
𝗕𝘂𝗶𝗹𝘁 𝗳𝗼𝗿 𝗿𝗲𝗮𝗹-𝘄𝗼𝗿𝗹𝗱 𝘃𝗶𝘀𝘂𝗮𝗹 𝗮𝗿𝘁𝗶𝗳𝗮𝗰𝘁 𝘄𝗼𝗿𝗸𝗳𝗹𝗼𝘄𝘀:
🔹𝗡𝗮𝘁𝗶𝘃𝗲 𝟰𝗞 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗼𝗻 with better detail, composition & realism
🔹𝗖𝗼𝗺𝗽𝗹𝗲𝘅 𝗶𝗻𝘀𝘁𝗿𝘂𝗰𝘁𝗶𝗼𝗻 𝗳𝗼𝗹𝗹𝗼𝘄𝗶𝗻𝗴 across subjects, counts, text, layouts & styles
🔹𝗘𝗻𝗵𝗮𝗻𝗰𝗲𝗱 𝗖𝗵𝗶𝗻𝗲𝘀𝗲/𝗘𝗻𝗴𝗹𝗶𝘀𝗵 𝘁𝗲𝘅𝘁 𝗿𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴 & 𝗺𝘂𝗹𝘁𝗶-𝘁𝗲𝘅𝘁 𝗹𝗮𝘆𝗼𝘂𝘁
🔹𝗣𝗿𝗲𝗰𝗶𝘀𝗲 𝗶𝗺𝗮𝗴𝗲 𝗲𝗱𝗶𝘁𝗶𝗻𝗴 & 𝗰𝗼𝗻𝘁𝗿𝗼𝗹 with visual markers, bounding boxes & multi-image references
Just 𝟴𝗕 parameters — outperforming same-size models in instruction following and editing preservation, while 𝗰𝗼𝗺𝗽𝗲𝘁𝗶𝗻𝗴 𝘄𝗶𝘁𝗵 𝗹𝗮𝗿𝗴𝗲 𝗰𝗼𝗺𝗺𝗲𝗿𝗰𝗶𝗮𝗹 𝗺𝗼𝗱𝗲𝗹𝘀 𝗶𝗻 𝘁𝗲𝘅𝘁 𝗿𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴 𝗮𝗻𝗱 𝗰𝗼𝗺𝗽𝗹𝗲𝘅 𝗹𝗮𝘆𝗼𝘂𝘁𝘀.
🛠️GitHub: github.com/OpenSenseNova/Sen…
🤗HF: huggingface.co/collections/s…
👾Discord: discord.com/invite/BuTXPHmQu…
🎨SenseNova Studio: unify.light-ai.top/
Lei Yang retweeted
𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮 𝗨1.5-𝗟𝗶𝘁𝗲-𝗣𝗿𝗲𝘃𝗶𝗲𝘄.
An early open-source preview of our lightweight, natively unified multimodal model — built on the native NEO-Unify architecture to natively understand, reason, generate, and edit across modalities. 𝗪𝗶𝘁𝗵 𝗷𝘂𝘀𝘁 8𝗕-𝗠𝗼𝗧 𝗽𝗮𝗿𝗮𝗺𝗲𝘁𝗲𝗿𝘀, 𝗶𝘁 𝗱𝗲𝗹𝗶𝘃𝗲𝗿𝘀 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗼𝗻 𝗮𝗻𝗱 𝗲𝗱𝗶𝘁𝗶𝗻𝗴 𝗾𝘂𝗮𝗹𝗶𝘁𝘆 𝘁𝗵𝗮𝘁 𝗿𝗶𝘃𝗮𝗹𝘀 𝗰𝗼𝗺𝗺𝗲𝗿𝗰𝗶𝗮𝗹 𝗰𝗹𝗼𝘀𝗲𝗱-𝘀𝗼𝘂𝗿𝗰𝗲 𝗺𝗼𝗱𝗲𝗹𝘀.
🌟This preview brings:
🔹𝗨𝗽 𝘁𝗼 4𝗞 𝗿𝗲𝘀𝗼𝗹𝘂𝘁𝗶𝗼𝗻, delivering richer details and fewer visual artifacts
🔹𝗦𝘁𝗿𝗼𝗻𝗴𝗲𝗿 𝗘𝗡/𝗖𝗡 𝘁𝗲𝘅𝘁 𝗿𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴 𝗮𝗻𝗱 𝗰𝗼𝗺𝗽𝗹𝗲𝘅 𝗹𝗮𝘆𝗼𝘂𝘁 𝗰𝗼𝗺𝗽𝗼𝘀𝗶𝘁𝗶𝗼𝗻
🔹𝗠𝗼𝗿𝗲 𝗽𝗿𝗲𝗰𝗶𝘀𝗲 𝘃𝗶𝘀𝘂𝗮𝗹 𝗰𝗼𝗻𝘁𝗿𝗼𝗹 with long, multi-constraint prompts
🔹𝗠𝗼𝗿𝗲 𝗿𝗲𝗹𝗶𝗮𝗯𝗹𝗲 𝗻𝗮𝘁𝗶𝘃𝗲 𝗶𝗺𝗮𝗴𝗲 𝗲𝗱𝗶𝘁𝗶𝗻𝗴 across reference-guided style transfer, multi-reference composition, local infographic editing and text editing
🌟Improvements over U1 on generation & editing benchmarks:
🔹Qwen-Image-Bench: 47.14 → 55.20 (w/ PE)
🔹ImgEdit-Bench: 3.90 → 4.37
🔹GEdit-Bench-en: 7.47 → 8.17
🔹GEdit-Bench-zh: 7.42 → 8.05
From U1 to U1.5, this open-source journey reflects our continued innovation at the foundation-model level. Meanwhile, U1 Pro, our production-ready model for creators, will open for public access soon.
🛠️ GitHub: github.com/OpenSenseNova/Sen…
🤗 Hugging Face: huggingface.co/sensenova/Sen…
👾 Discord: discord.com/invite/BuTXPHmQu…
A big thank you to @HuggingApps for building this Space! More people can now try our latest model directly, with no deployment required. Give it a try 🤗
huggingface.co/spaces/sensen…
SenseNova U1 is the best open image model you maybe didn't heard of yet
Unified language-image (like Nano Banana 2 / GPT-Image-2) that does precise generations and edits
It has a general version and a specialized infographics one, where it shines
▶️ huggingface.co/spaces/huggin…
👑 The #WorldCupFinal is set! A true coronation.
Past 👑 Messi 🆚 Future 👑 Yamal.
Detailed analysis by SenseNova U1 Pro predicts a 1-2 Argentina win!
🔁 RT if 🇦🇷 takes the 4th star
❤️ LIKE if 🇪🇸 takes the crown
𝗪𝗲 𝗮𝘀𝗸𝗲𝗱 𝗥𝗮𝗰𝗰𝗼𝗼𝗻 𝗪𝗼𝗿𝗸, 𝗼𝘂𝗿 𝗔𝗜 𝗮𝘀𝘀𝗶𝘀𝘁𝗮𝗻𝘁, 𝘁𝗼 𝗽𝗿𝗲𝗱𝗶𝗰𝘁 𝘁𝗼𝗻𝗶𝗴𝗵𝘁’𝘀 𝗪𝗼𝗿𝗹𝗱 𝗖𝘂𝗽 𝗙𝗶𝗻𝗮𝗹, then used 𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮 𝗨𝟭 𝗣𝗿𝗼 to create this score prediction graphic with historical data on both teams. The call: 𝗔𝗿𝗴𝗲𝗻𝘁𝗶𝗻𝗮 𝟮–𝟭 𝗦𝗽𝗮𝗶𝗻! 🇦🇷⚽🇪🇸
Just for fun! Whatever the result, here’s hoping for a spectacular match tonight! 🏆✨
Congrats on the impressive GenCeption! Beyond the strong results, we are inspired by a broader message: the choice of generative pretraining shapes what a general-purpose vision model can naturally understand. Perhaps @CeyuanY's Omni Model offers a ultimate way to unify them all
Can video generation models do for vision what LLMs did for language?
Introducing GenCeption from @GoogleDeepMind: one feed-forward video model for various vision tasks — SOTA, data-efficient, and emerging behaviors (ECCV 2026)
🌐 genception.github.io
(1/8)
SenseNova-Vision, Vision Banana, and GenCeption all point to the same future: unifying vision tasks within a single model.
We believe the field is moving toward combining perception, understanding, and generation, enabling one model to see, reason, and imagine much like humans do
𝗢𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗶𝗻𝗴 𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮-𝗩𝗶𝘀𝗶𝗼𝗻-7𝗕-𝗠𝗼𝗧 — 𝗼𝗻𝗲 𝗺𝗼𝗱𝗲𝗹, 𝗮𝗹𝗹 𝗺𝗮𝗷𝗼𝗿 𝘃𝗶𝘀𝗶𝗼𝗻 𝘁𝗮𝘀𝗸𝘀.
Reimagines CV as multimodal generation. Steerable by language or visual prompts. 𝗡𝗼 𝘁𝗮𝘀𝗸-𝘀𝗽𝗲𝗰𝗶𝗳𝗶𝗰 𝗵𝗲𝗮𝗱𝘀 — 𝘀𝘁𝗶𝗹𝗹 𝗦𝗢𝗧𝗔, 𝘀𝘂𝗿𝗽𝗮𝘀𝘀𝗶𝗻𝗴 𝗚𝗼𝗼𝗴𝗹𝗲 𝗗𝗲𝗲𝗽𝗠𝗶𝗻𝗱'𝘀 𝗩𝗶𝘀𝗶𝗼𝗻 𝗕𝗮𝗻𝗮𝗻𝗮 𝗼𝗻 𝘀𝗲𝗴𝗺𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻 𝗮𝗻𝗱 𝗱𝗲𝗻𝘀𝗲 𝗴𝗲𝗼𝗺𝗲𝘁𝗿𝘆.
📊 𝘃𝘀. 𝗩𝗶𝘀𝗶𝗼𝗻 𝗕𝗮𝗻𝗮𝗻𝗮 (𝗚𝗼𝗼𝗴𝗹𝗲 𝗗𝗲𝗲𝗽𝗠𝗶𝗻𝗱):
🔹Referring segmentation (RefCOCOg cIoU): 80.3 vs 73.8
🔹Semantic segmentation (Cityscapes mIoU): 71.2 vs 69.9
🔹Depth estimation (NYUv2 δ1): 98.1 vs 94.8
🔹Surface normal (NYUv2 mean error): 14.4 vs 17.8
Built on a decade of SenseTime's CV leadership — #1 in China's Vision AI market for 10 consecutive years, and named a Tech Innovator in global GenAI CV by Gartner. 𝗩𝗶𝘀𝗶𝗼𝗻, 𝗻𝗼𝘄 𝗻𝗮𝘁𝗶𝘃𝗲 𝘁𝗼 𝗳𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗺𝗼𝗱𝗲𝗹𝘀. New tasks, defined by instruction — not by new model heads.
An important step towards emergent intelligence from visual learning.
SenseNova-Vision just dropped, which unifies a wide range of vision tasks into a single generative model.
Not only achieving competitive performance on all these tasks, but more importantly showing the capability of doing unseen and complex vision tasks.
𝗢𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗶𝗻𝗴 𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮-𝗩𝗶𝘀𝗶𝗼𝗻-7𝗕-𝗠𝗼𝗧 — 𝗼𝗻𝗲 𝗺𝗼𝗱𝗲𝗹, 𝗮𝗹𝗹 𝗺𝗮𝗷𝗼𝗿 𝘃𝗶𝘀𝗶𝗼𝗻 𝘁𝗮𝘀𝗸𝘀.
Reimagines CV as multimodal generation. Steerable by language or visual prompts. 𝗡𝗼 𝘁𝗮𝘀𝗸-𝘀𝗽𝗲𝗰𝗶𝗳𝗶𝗰 𝗵𝗲𝗮𝗱𝘀 — 𝘀𝘁𝗶𝗹𝗹 𝗦𝗢𝗧𝗔, 𝘀𝘂𝗿𝗽𝗮𝘀𝘀𝗶𝗻𝗴 𝗚𝗼𝗼𝗴𝗹𝗲 𝗗𝗲𝗲𝗽𝗠𝗶𝗻𝗱'𝘀 𝗩𝗶𝘀𝗶𝗼𝗻 𝗕𝗮𝗻𝗮𝗻𝗮 𝗼𝗻 𝘀𝗲𝗴𝗺𝗲𝗻𝘁𝗮𝘁𝗶𝗼𝗻 𝗮𝗻𝗱 𝗱𝗲𝗻𝘀𝗲 𝗴𝗲𝗼𝗺𝗲𝘁𝗿𝘆.
📊 𝘃𝘀. 𝗩𝗶𝘀𝗶𝗼𝗻 𝗕𝗮𝗻𝗮𝗻𝗮 (𝗚𝗼𝗼𝗴𝗹𝗲 𝗗𝗲𝗲𝗽𝗠𝗶𝗻𝗱):
🔹Referring segmentation (RefCOCOg cIoU): 80.3 vs 73.8
🔹Semantic segmentation (Cityscapes mIoU): 71.2 vs 69.9
🔹Depth estimation (NYUv2 δ1): 98.1 vs 94.8
🔹Surface normal (NYUv2 mean error): 14.4 vs 17.8
Built on a decade of SenseTime's CV leadership — #1 in China's Vision AI market for 10 consecutive years, and named a Tech Innovator in global GenAI CV by Gartner. 𝗩𝗶𝘀𝗶𝗼𝗻, 𝗻𝗼𝘄 𝗻𝗮𝘁𝗶𝘃𝗲 𝘁𝗼 𝗳𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗺𝗼𝗱𝗲𝗹𝘀. New tasks, defined by instruction — not by new model heads.
Lei Yang retweeted
🔥Vision as Unified Multimodal Generation🔥
🎯SenseNova-Vision🎯 unifies vision tasks (e.g., detection, keypoints, segmentation, depth, surface normals, point maps, and camera pose) as unified multimodal model (UMM) generation *with SOTA results*
- Code: github.com/OpenSenseNova/Sen…
Thanks, Songyou. VisionBanana has been a great inspiration! We believe it’s time for one model to unify more vision tasks, just like GPT did for language. We’ve fully open-sourced the model, code, and data, and hope to explore this with the community.
Lei Yang retweeted
#ICML Two last-authored papers at ICML 2026 this week.
A Very Big Video Reasoning Suite.
Video models today are optimized for one thing: visual quality. Whether they can reason, track causality, follow constraints, execute multi-step plans, has been nearly impossible to study, because the field never had the data. VBVR changes that.
Over 50 researchers and engineers across 30+ institutions built:
1) 150 reasoning tasks grounded in cognitive and developmental psychology
2) 2,015,000 samples and over one million videos, roughly 1,000× larger than the nine prior video-reasoning datasets combined
3) every task procedurally generated with deterministic ground truth, so evaluation is fully rule-based and verifiable, no LLM judges, and it agrees with human judgments
Insights:
1) Fine-tuning an open-source 14B model on VBVR lifts overall performance by 84.6 percent, a new state of the art that surpasses every proprietary system we evaluated, including Sora 2 and Veo 3.1.
2) The learned skills generalize to out-of-domain task families the model never saw, early evidence of emergent generalization in video reasoning.
3) And the honest part: gains saturate with scale, on two different architectures. A persistent gap to human performance remains that data alone cannot close. The bottleneck is architectural.
4) One principle kept surfacing throughout: controllability, doing exactly what is asked — is the bedrock of verifiable video reasoning.
Great thanks to my collaborators @MaijunxianWang @Rui147000038622 @juyi_lin @SaraJiran @thwiedemer @Kaiagaoqy @carrot0817_ @RubyFreax Lianyu Huang Zelong Hong Jiahui Ge Qianli Ma Hang He Yifan Zhou Lingzi Guo Lantao Mei Jiachen li Hanwen Xing Tianqi Zhao Fengyuan Yu Weihang Xiao Yizheng Jiao Jaden Hou Danyang Zhang Pengcheng Xu Boyang Zhong Zehong Zhao Gaoyun Fang John Kitaoka Yile Xu Hua Xu Kenton Blacutt @tin_ng_qn @siyuansong_ @HaoranSunMr Shaoyue Wen @LinyangNeuroAI @RunmingW @Yanzhi_Wang_ @Mengyue_Yang_ @ziqiao_ma @raphaelmilliere @fredahshi Nuno Vasconcelos @DanielKhashabi Alan Yuille @du_yilun @ZimingLiu11 @Brian_Bo_Li Dahua Lin @liuziwei7 @Vikashplus Yijiang Li @drowsyleilei @caizhongang
The second paper — "Vision Language Models Cannot Reason About Physical Transformation" — asks a question Piaget asked children 70 years ago. Pour water into a taller, thinner glass: is it the same amount? Seven-year-olds pass this reliably. We built ConservationBench of 384 real videos of conservation tasks with matched non-conserving controls, and evaluated 112 VLMs across 23,040 trials. Humans score 98 percent; models sit near chance, with 82 of 112 under 10 percent on the strict paired test. The most telling result: models answer "better with no image at all" than with the actual video, and chain-of-thought prompting makes things worse, showing they're leaning on a textual prior, not tracking object state through change.
#videomodel #AI #research #reasoning
Excited to see this to go live. Our new infographics model brings a big step forward in detail, structure and visual clarity.
𝗦𝗲𝗻𝘀𝗲𝗡𝗼𝘃𝗮-𝗨1-8𝗕-𝗠𝗼𝗧-𝗜𝗻𝗳𝗼𝗴𝗿𝗮𝗽𝗵𝗶𝗰-𝗩2 𝗶𝘀 𝗻𝗼𝘄 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲!
What's new vs. V1:
🔹Crisper small text rendering
🔹Better stability on complex, dense layouts
🔹Leveled-up aesthetics for posters, dashboards & reports
🔹Reduced unwanted black background artifacts
🤗HF: huggingface.co/sensenova/Sen…
⚒️GitHub: github.com/OpenSenseNova/Sen…
👾Discord: discord.gg/BuTXPHmQub

























