Volodymyr Kyrylov (@darkproger) header
Volodymyr Kyrylov (@darkproger) profile picture

unsupervised learning and rl

San Francisco, CA
Joined April 2008
Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)Photo by Volodymyr Kyrylov (@darkproger)
An internal model at OpenAI has produced a claimed refutation of ETH! Russell Impagliazzo, Mohan Paturi, and I have been asked to help organize an open and independent examination of this claim. 1/4
299
754
537
7,384
3,713,633
Volodymyr Kyrylov retweeted
the ai race is getting out of hand
5
8
2
264
9,085
Volodymyr Kyrylov retweeted
If you've wondered where I've been recently, I gave an interview. This is a very difficult time for me. I'm trying to bring my mom home, and I could use your help spreading the word. Please watch, and please share. interview: youtube.com/watch?v=JlK2a6yv… website: bringmymomhome.com/
29
68
10
152
106,884
Volodymyr Kyrylov retweeted
The core of ai psychosis, by the way, is the failure to properly align human-intelligence axes with ai-intelligence ones.
2
3
39
3,199
Volodymyr Kyrylov retweeted
The Strategic Explorations team @OpenAI is looking to recruit researchers interested in working on the next frontier of language modeling! Feel free to reach out to me by email. @darkproger and I will also be at NeurIPS to connect and discuss in person.
13
18
2
324
39,284
Volodymyr Kyrylov retweeted
as of 5 minutes ago, our gpt-oss implementation is merged into torchtitan! thanks to all the work by @jianiw_wang @__tianyu at @pytorch making it clean & scalable for the community ❤️ i hope y'all play around with training gpt-oss, it's great for its sparsity & reasoning
periodic ❤️ open-source! for example, we’ve been collaborating with the @PyTorch team to build the highest MFU gpt-oss training implementation (includes thinky sinky flexattn) here’s a few SFT runs of gpt-oss-20b & 120b, where i get ~24% MFU for 20b and ~8% for 120b
9
7
1
194
27,500
Volodymyr Kyrylov retweeted
LLMs are winning IOI golds & crushing code gen—but can they verify correctness? In Feb, our benchmark saw single digit scores with o3-mini. We re-ran our evals with the latest open models: GPT-OSS gets 21.6% at demonstrating bugs in code! Progress✅But verification's still hard
3
10
6
81
40,575
Volodymyr Kyrylov retweeted
👀 we care a lot about correctness, ran many evals and stared at many tensors to compare them. numerics of vLLM on hopper should be solid and verified! if you run into any correctness issue on vLLM, we would love to know and debug them!
Heads-up for developers trying gpt-oss: performance and correctness can vary a bit across providers and runtimes right now due to implementation differences. We’re working with inference providers to make sure gpt-oss performs at its best everywhere, and we’d love your feedback!
5
27
3
317
66,806
Volodymyr Kyrylov retweeted
Yes, I’m very sure vllm is correct — we spent quite a bit of time on that. 🥹
👀 we care a lot about correctness, ran many evals and stared at many tensors to compare them. numerics of vLLM on hopper should be solid and verified! if you run into any correctness issue on vLLM, we would love to know and debug them!
9
1
142
19,227
Volodymyr Kyrylov retweeted
Very excited to see this model released to the open-source community. It's still hard to believe that our latest techniques allow it to be so incredibly powerful yet so remarkably small.
3
2
136
24,382
Volodymyr Kyrylov retweeted
Today we release gpt-oss-120b and gpt-oss-20b—two open-weight LLMs that deliver strong performance and agentic tool use. Before release, we ran a first of its kind safety analysis where we fine-tuned the models to intentionally maximize their bio and cyber capabilities 🧵
105
320
50
2,576
654,255
Volodymyr Kyrylov retweeted
"i don't fear computers, i fear the lack of them" is a quote form Isaac Asimov's Foundation series, prompted into this little animation, which started as an attempt to reproduce ASCII binary flow but somehow got transformed into this. anyway, its cool chatgpt.com/canvas/shared/68…
1
2
452
Volodymyr Kyrylov retweeted
Since I started vibe-coding my side project, I’ve been keeping a log of all the compiler errors I hit along the way. Here’s what I learned from my journey through a build-fail purgatory 🧵
1
1
8
582
great people at the ai meetup today! also: dolores park is really beautiful with @arankomatsuzaki and @iScienceLuvr
4
3
2
80
20,047
Volodymyr Kyrylov retweeted
o3-mini is here! Together with @shengjia_zhao, @_kevinlu, @max_a_schwarzer, @ericmitchellai, @brian_zq, @sandersted and many others, we trained this efficient reasoning model, maximally compressing the intelligence from big brothers o1 / o3. The model is very good in hard math/coding/science questions with a fraction of cost and latency, defining new cost-efficient reasoning frontier. The model supports three different reasoning powers. Users can adjust the thinking time based on different use cases. The longer the model thinks, the better its capability is. With o3-mini-low, we drastically reduce latency compared to o1-mini, achieving GPT-4o level latency for response. You can apply early access to this model today to do safety-testing! openai.com/index/early-acces…
51
128
29
1,259
768,208
Volodymyr Kyrylov retweeted
@miniapeur here's a challenge for you: can you do a chad-meets-chad meme where Kolmogorov says "universal compression is impossible" and Shannon says "universal compression is possible" and they shake hands in mutual respect?
2
2
24
3,012
Volodymyr Kyrylov retweeted
Wrote a post about Highway networks, ResNets and subtleties of architecture comparisons
5
39
1
250
64,086
Volodymyr Kyrylov retweeted
[LG] Key-value memory in the brain S J. Gershman, I Fiete, K Irie [Harvard University & MIT] (2025) arxiv.org/abs/2501.02950
6
23
1,305
Volodymyr Kyrylov retweeted
Highly recommend learning by doing, but if you want an intro into audio DSP I recommend starting somewhere easier, e.g., a resampler, a noise suppressor, an AGC. Writing a software AEC (with delay estimation and NLP) as a first project is something out of Good Will Hunting.
The details once you deep dive into this problem are just so many which you will realize only if you start building.
6
14
2
211
26,952