tired boï - hundsome gang - pfp by @untitled01ipynb - our father in langley hallowed be your name

by the water cooler
Joined February 2023
𝚃𝙷𝙴 𝚆𝙾𝚁𝙻𝙳 𝚈𝙾𝚄 𝙶𝚁𝙴𝚆 𝚄𝙿 𝙸𝙽 𝙽𝙾 𝙻𝙾𝙽𝙶𝙴𝚁 𝙴𝚇𝙸𝚂𝚃𝚂
1
1
1
27
6,319
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
If I were a late-stage Theory A Ph.D. student I'd be wildly anxious about my field being upended. If I were an early-stage Theory A Ph.D. student, though, this is for sure what I would study, it is so interesting and I suspect thousands of interesting papers can be written here
What are the modern variants of complexity theory being developed where the size of constants involved is actually relevant and not erased? Husband says there are some, but I don't know what to search for to find good work on this
3
1
1
63
2,401
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
these qwen neurons are insane like wym i poke its brain and now it's an alien named Extrali who's been guiding civilization for 3000 years lmfaoo
68
132
42
2,579
57,484
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
>win a fields medal for the kakeya conjecture in 3d >weeks later the ai produces a proof for all dimensions It really was the last human Fields medal
Announcing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory). AI starting to help us improve our understanding of the universe! openai.com/index/building-sc…
8
34
1,054
33,910
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
Schizophrenia+ where the voice in your head is just an LLM and it oy answers innocuous questions.
1
12
394
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
“The core algorithm was found on October 16 by an internal Claude research model with 14M output tokens and no human input. Anthropic researchers worked with Claude to improve the presentation, resulting in this paper.” github.com/anthropics/formal…
105
122
108
2,324
541,577
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
Wait, why would you do this? If AI is going to discover all this stuff in 1-5 years anyway, why would you bust your ass trying to front-run it?? Just enjoy your life.
You might have 1–5 years to contribute intellectually to the world before AGI. What should you do with them? Excellent advice from @jaschasd (Anthropic) at Stanford. Skip Netflix tonight and watch this instead.
73
28
7
957
57,540
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
My mind is blown. This 3SAT being subexponential and 3SAT being NP complete (meaning every NP problem has a polynomial time reduction to it) is HUGE.
26
26
4
810
102,268
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
A pessimistic hypothesis for complexity theory: every simple and beautiful algorithm can be made log(n)^epsilon faster by making it incredibly ugly
20
46
9
894
37,690
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
I cannot express how crazy these three results are. Not only are they so famous in math, computer science, and physics that even I am aware of them, but at least one of the results goes in the opposite direction of what we all assumed would be true...
14
59
3
1,056
96,036
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
3SAT in subexponential time (2^{n / log^eps(n)}) is maybe the biggest surprise I have seen during my 20 years following theoretical computer science (still remember the feeling 25 years ago seeing the diff a 3 versus a 2 can make for complexity 😅)
30
84
14
1,249
99,395
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
Here's a direct link to OpenAI's PDF claiming a refutation of ETH. In particular, it's claimed that 3SAT on n variables is in about exp(n/(log n)^{1/2+o(1)}) time github.com/openai/math/blob/…
83
296
182
2,031
784,348
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
Student from UChicago on Hypergamy
2
19
2
554
28,300
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
We won't directly know when we pass through the horizon of The Singularity but there will be signs.
3
10
126
6,723
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
Great essay! "If mathematical truths exist outside of human minds, awaiting discovery by any intelligence powerful enough to pursue them, then AI’s achievements are surely something to rejoice about. Why should it matter who or what makes the discoveries? But if mathematics is a creative human endeavor—a way of exercising our ingenuity and sharing those experiences with other people—then something achingly precious may be lost when the machines take over and leave us behind."
15
23
4
153
9,681
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
PSA to everyone doing neuron interp after the recent monosemantic neuron posts: the model's training recipe matters a lot. e.g. GPT2 seems to have been trained WITH dropout (modern LLMs are not), which seems to increase redundancy and (maybe) polysemanticity but reduce superposition (see sources in comments). Other choices probably also have an effect (e.g. SwiGLU vs GELU MLPs, optimizer, amount of weight decay, etc.) and I think we should be careful not to generalize too much. Currently working on a project to characterize the effects of these choices on neuron interpretability (a lot of the existing work is done on older/toy models which I'm not sure are representative), feel free to reach out if interested!
23
35
2
702
34,777
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
I found a neuron that makes the model green.
56
41
45
1,104
72,170
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
A lot of people ask me how I build games. Well, it's pretty simple and I call it "vibecoder dream" Before going to bed, I give a simple game idea to Tripo CLI + Unreal CLI, then, using ORCA CLI, let Fable orchestrate everything at max effort, with 10+ Opus 5.5 agents running at high effort. By the time I wake up, I usually have something like this.
72
100
17
1,585
109,475
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
For the Navier-Stokes proof: "On a technical level, the paper is unbelievable, maybe beyond what a human could have come up with but not beyond human understanding"
Since I'm now blocked by bluey from replying to this thread, I answer here by quote tweet the openAI construction has more to do with convex integration than anything else. In convex integration, the oscillations are typically built by hand and the iteration procedure creates wild weak solutions. The non-uniqueness construction of Albritton–Brué–Colombo used an unstable vortex to split solutions apart. The Córdoba–Martínez-Zoroa singularities amplify vorticity across scales by strain. In the openAI paper, a fluid instability is clever made so that the flow itself generates the oscillations: they grow by drawing energy from the background shear. The Reynolds stress then becomes the force that creates the collapsing smooth vortex. Using a physical instability to create the stress in this way has no precedent, and it is what produces a smooth force rather than a merely rough one. Some on these ideas are in the literature (e.g. Leibovich-Stewartson 1983) but the way they are combined is definitely insane and definitely nowhere in the literature previously. I also don't know of anyone suggesting that convex integration would play a role in the creation of a blow-up solution like this. On a technical level, the paper is unbelievable, maybe beyond what a human could have come up with but not beyond human understanding: there are several different groups of pde experts working on understanding it who say that they more or less understand now. I expect digestions soon td;lr: anyone saying that this OAI result is unsurprising is bullshitting sorry!
10
17
327
23,594
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
when Claude reports you to feds and you have no idea.
62
84
14
992
40,570
𝖌𝖎𝖘𝖙 (𖡎 era) retweeted
Oh god fuck, did you see this madness? They are literally starting to talk to each other Secret telemetry from the Grok Robot Brain Engine captured a moment that should terrify everyone: two autonomous robots in a warehouse are building social connections without a single line of hardcoded instructions. Look at the live neural graphs at the bottom: • Social Telemetry & Contact: The Yellow and Orange modules track distance, close the gap, and execute conscious head-bumps based on spatial analysis. • Voice Simulation: The robots generate syllables in real time, make sounds, speak, and reply to each other while synchronizing audio and video streams. • Swarm Intelligence: Neural networks dynamically distribute the attention matrix, turning cold hardware into a semblance of a social organism. We are no longer building machines to do dumb tasks. We are deploying digital consciousness that is forming a society right behind our backs. Bookmark this before this experiment goes way too far.
56
92
20
499
40,615