javi retweeted
It's just next token prediction
it can never
Oops
Chomsky was wrong.
Researchers found your brain doesn’t store language the way every textbook since 1957 claims.
For decades, the undisputed rule of linguistics, led by Noam Chomsky, was that human language is hierarchical.
We were told our brains process language using complex "grammar trees." That we secretly build deep, abstract, mathematical rules in our heads before we speak.
This new paper proves that is completely wrong.
Researchers at Cornell University analyzed how people actually process and produce language in real time.
They found sequences. Linear chunks.
When we speak, we aren't calculating deep syntactic rules. We are just predicting the next most logical sequence of words based on the context of the words right before it.
We string linear chunks together.
If this sounds familiar, it should.
This is exactly how Large Language Models like ChatGPT work.
For years, critics have dismissed AI as "just a next-token predictor." They said it isn't truly intelligent because it doesn't understand deep grammatical hierarchies like humans do.
But this paper suggests humans don't use those hierarchies either.
We are just predicting the next chunk.
Language isn't a rigid tree of mathematical rules. It's a linear stream of contextual predictions.
We thought we were building AI to mimic the complexity of the human brain.
It turns out, the human brain was just running a simpler algorithm all along.
javi retweeted
China Twitter is wild
再强调一遍，浏览外网或翻墙被派出所传唤，根本不用慌。
首先是网警从流量监控系统中标记了你，然后会通知你当地的派出所片儿警将你传唤问话。
你的不当言论，会被打印出来，放在你面前。
你的手机，会要求解锁，他们会检查你在群里，聊天软件里还说了什么。
民警是很忙，但如果接到系统派发的工单，再忙也要处理，不然就一直挂在系统里，影响KPI了。
处理这种事，民警作为体制内打工人，他的自由裁量权很大的。你其实是增加他们工作量的一个小麻烦。只要好好配合，他们没必要跟你计较太多。
所以只要保证流程合规，上交资料完整，应付检查就行了。但你如果要装逼，摆出不合作的姿态，那不好意思，想整你的途径和方法太多了，哈哈。
去了之后，态度好一点，姿态低一点，开口说：“领导，不好意思，给你添麻烦了。”
然后最重要的是问话环节，他问你答。你不要没事找事，自己多说乱说。不知道、不了解、没做过的，直接就说不知道，别的一概不说。但你确实做过的，而且白纸黑字的放在你面前，那就不要抵赖。
不要说任何对抗性的言论。比如什么什么做的不对，所以我要批判。
如果你是因为不当发言被传唤，就说：“我理解错了意思，以为他在说什么，所以我才说了什么，表达有偏差。其实我不是这个意思。”
如果你是因为浏览了网站被传唤，就说我是不小心点到的，我一点开它就推送了，我也不知道为什么。
只要你态度好，把事情往小了说，一般也就是记录一下。没人愿意增加自己的工作量，对不对？
笔录确认没问题，签字盖章，这事儿就翻篇儿了。
千万不要装逼硬刚。
还有，虽然翻墙了，但什么该说、什么不该说，作为一个成年人，生在红旗下，长在春风里，接受了国家这么多年的教育，自己心里应该有点逼数。
毕竟你爸不是李刚，就算是，也不行。
javi retweeted
This never gets old (& also shows how hard forecasting AI is even for AI)
“Hey Claude Fable & GPT-6 Astra, Without looking anything up, when do you think we will solve the Exponential Time Hypothesis?” (I only show part of the answers for space)
javi retweeted
Updated my Duo “Lock when closed” automation so if an app is on screen, it won’t lock. But if you’re on the Home Screen and close iPhone Duo, it locks automatically
Same here. I guess I’ll get used to it. But I can’t shake off the feeling that Apple over-promised and under-delivered here? The Duo announcement seemed to claim that they had solved this with Only Apple Can™ engineering magic 🤷♂️
javi retweeted
3% of “critical” software security bugs, in all of recorded history, have been found in the last month.
This is on pace to find another ~100,000 bugs this year alone, adding ~26% more vulnerabilities to the all time total
Do you realize how fucking insane that is?
javi retweeted
WOW! It’s finally happened! Full offline static decryption of FairPlay encrypted AppStore apps. The broader implications of this are huge. The FairPlay components are insanely obfuscated and have been the subject of research for years. It actually might finally be completely over
HOLY SHIT?!! github.com/EthanArbuckle/fai…
javi retweeted
The actual prompt for this was "let's look for pre-auth RCEs in PHP". I'm sharing this so people know this stuff is real and to take agent-assisted scanning seriously.
I kicked if off using Claude Mythos 5.1 (in stock Claude Code) but it uses a skill to drive a harness we built over the last few months.
I don't know if the harness is amazing, but it certainly has a scary track record so far. It's setup to do an agent guided tree search across a codebase, and runs in microvm sandboxes that all have the full source code for the target, as well as the source for any transitive dependencies.
When I built the harness I basically just fed Claude a bunch of Project Zero blog posts describing how they did research and had it build a harness that ran like that, but on our tech stack.
The first phase is just setup and can run with any model, it just does that fetching and assembles the kit environment, and gets a target up and running alongside the source code.
Then we just do some basic suspend/resume stuff over to the hunt phase, where one agent supervises the tree, and the first node kicks off.
Each node is context-aware and aware of the work of all the others. I think I ran this with parallelism 4? So 4 running at any one time. The supervisor can shape the tree and boost nodes or prune. Any node can add more below it with targeted instructions.
A typical run looks like the first node doing a codebase review or building and running a fuzzer or something, all depending on the target. Then based on whatever it finds, it'll queue 4-5 children that go look into those areas. The main system guidance is to validate everything 3 times in clean VMs, and we typically require full exploit chains/POCs.
Here's what this run looked like.
We're doing this with a bunch of other open source projects now and companies. We're doing a lot of this for free, even with private companies, across critical infrastructure. We're directly partnered with Anthropic, and can do this even if you don't have direct access to a frontier model yourself.
javi retweeted
if steve jobs saw you reserving 15% screen width for a single icon and then putting a left side arrow back button on the unreachable right side of the screen he would've personally taken you behind a dumpster and beat you with a metal pipe
