#CS Associate Prof @YorkUniversity #ComputerVision Researcher, @VectorInst Affiliate @UofT status only, @ELLISforEurope Member, X-social media chair 4all vision

Toronto, Ontario
Joined August 2015
I’ve launched 2 new course websites for my Introduction to #ComputerVision and #DeepLearning in Computer Vision courses. 🆕 Gaussian Splatting 🆕 Flow Matching 🆕 Sparse Autoencoders 🆕 Lecture Notes (work in progress) The videos don’t include voiceovers, but that’s coming in a future revision 🤞 Share your feedback in the thread.
8
31
1
325
45,073
Kosta Derpanis retweeted
The Platonic Representation Hypothesis argues that vision and text are two projections of the same underlying world. As vision and language models scale, their representations converge toward this shared reality. We ask: Can physical robot motion be viewed as another projection of that same world? Our answer is yes. We find that more capable embodied models better align their vision and language representations with the structure of motion trajectories. 🚀 Based on this, we introduce Sensorimotor Alignment (S²): A Platonic Proxy for Embodied Policy Success. 📈 First, we find that S² is positively correlated with downstream robot task success across model families, in both simulated and real-world settings—making S² a training-free predictor of robot policy success. 🔍 Furthermore, we use S² to explain, at the representation level, several phenomena in VLAs and WAMs that were previously observed only through closed-loop results—such as why VLAs struggle to follow language instructions and why Fast-WAM can skip test-time future generation. 💡 We believe Sensorimotor Alignment offers a low-cost, representation-level view of robot foundation models that closed-loop success rates alone cannot reveal. More: 🌐 Blog & Video: yunfeixie233.github.io/s2/ 📄 Paper: arxiv.org/abs/2610.31670 💻 Code: github.com/yunfeixie233/sens… I’m sincerely grateful to Howard H. Qian, Shiyi Lan, Kaiyu Hang, and Chen Wei @Chen_Wei for their guidance and collaboration.
3
11
1
42
2,209
Kosta Derpanis retweeted
anthropic just killed the REA it stops claude from doing it that’s why local models are important
301
436
133
7,831
407,137
Found one! Just arrived 🤗
RIP my favourite slide clicker. It’s been discontinued too 😢 Now what? 🤔
2
641
Kosta Derpanis retweeted
You can animate flowing water in splats now with more splats. And yes it also works with lava 😂
5
11
1
99
5,714
Kosta Derpanis retweeted
We’re hiring a summer research intern at the MIT–IBM Computing Research Lab in Boston. We are looking for a PhD student near graduation. We’re interested in non-autoregressive architectures for language generation and reasoning, including diffusion models, flows, and EBMs.
2
8
1
155
6,458
Kosta Derpanis retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
877
2,613
1,435
19,717
4,447,534
Kosta Derpanis retweeted
Hello, #CVPR2027 World! We’ll be back with more coverage soon.
4
35
3,001
Kosta Derpanis retweeted
Ideogram Vector + Opus 5.5 = 🔥
Been experimenting with @ideogram_ai's new Vector model 👀 One prompt → a clean, editable SVG storyboard. Then passed it to @claudeai Opus 5.5 → a fully animated explainer about Brain Rot. 🧠 From vector design to motion graphics. #Ideogram #ClaudeAI #MotionDesign
2
1
21
2,189
Kosta Derpanis retweeted
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
56
286
42
2,773
169,117
Kosta Derpanis retweeted
If you liked the ZurichNLP or ZurichCV or similar meetups in the earth's best town, you should follow @zurich_tech and check out zurich.tech (cool domain name), where they are trying to put all the local meetups in one central place. And if you run some kind of relevant meetup or event, get in touch with them too. I be think it's a great initiative! Also, pic related, from the office today i saw that snow is starting to cover the mountains again!! ⛷️
We're excited to announce ZurichCV#15 is next Thursday at the @ETH_AI_Center! Said Gürbüz (ETH Zurich, IBM Research) will present DeskForge: Controllable Desktop Environments for Training Computer-Use Agents. Lorenzo Steno @lsteno (Seldon Technologies @seldon_tech) will talk about building RL environments for computer use. RSVP: zurich.tech/events/zurichcv-… (PS: this is our new account for zurich.tech. please help out by sharing!)
6
9
82
6,233
Kosta Derpanis retweeted
Hinton is giving the Gödel lecture at TU Wien and this is our current state according to him:
33
38
18
415
53,472
“Go with the Flow” Trailer for my Flow Matching lecture, coming this winter to my #DeepLearning course 🎬
7
6
2
57
3,531
Kosta Derpanis retweeted
1984년 매킨토시로 변한 아이폰 듀오 애플의 첫 폴더블폰 〈iPhone Duo〉를 반쯤 접으면 1984년 매킨토시를 재현한 작은 노트북으로 변신합니다. 새롭게 공개된 〈Tiny Computers〉는 매킨토시부터 윈도우 95·XP까지 고전 컴퓨터 10종을 체험할 수 있는 앱입니다. 키보드 입력은 물론 그림 그리기와 간단한 게임도 즐길 수 있으며, 일반 아이폰과 아이패드에서도 이용할 수 있습니다. 🎥 idanbo
110
1,185
287
8,537
716,361
Kosta Derpanis retweeted
Probability paths describe how a distribution evolves from source to target. The Linear Path connects each paired sample with a straight line. Alternative paths behave differently. This Variance-Preserving Path uses cosine–sine interpolation to trace a curved, elliptical arc.
3
14
1
190
7,994
Kosta Derpanis retweeted
Excited to share our NeurIPS 2026 paper (+code): Learnable Spectral Activations 📢 Prior INR work tunes which frequencies are available. LSA learns how to compose them. Gains on audio, images, NeRFs & more. 📄 arxiv.org/abs/2610.07419 Kudos to Tamir Shor who led it like a champ
16
87
3,616
Kosta Derpanis retweeted
Visual artist @tommyoshima and Kaukokaipuu Kobo are converting Dr. Kenji Kohiyama's two decades of macro insect photogrammetry into 3D Gaussian splats. The project is part of the exhibition "Insects: An Exhibition by Takeshi Yoro and Kenji Kohiyama, Look, Feel, and Think," produced by Crevis. The show opened at the Okayama Prefectural Museum of Art on 9 October 2026 and runs until 29 November 2026.
1
3
1
23
1,391
Music: "Terminus" by Scott Buckley – released under CC-BY 4.0. scottbuckley.com.au
1
1
240
I think you will like this one @bose_joey 😉
2
1
144