applied ai engineer. looking for next venture.
Joined April 2022
- Tweets4.1K
- Following88
- Followers1.2K
- Likes387
0xso retweeted
DeepSeek's open-source streak is getting absurd:
- FlashMLA: 580 TFLOPS attention on H800
- DeepEP: MoE comms
- DeepGEMM: 1350+ FP8 TFLOPS matmul
- 3FS: they built an entire file system
- and today: the full inference engine behind V4.1-Flash, Apache 2.0
Mad respect
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 github.com/deepseek-ai/DeepI…
1/4
0xso retweeted
Don’t work on your business near bedtime. No tickets, no reviews, no social media.
Don't activate your brain or get your emotions riled, when you're trying to be calm and stop having thoughts.
Rest is tomorrow’s productivity.
0xso retweeted
Remember the guy who hacked his gym using AI, Andrew Bird?
Well, I did a little OSINT, and it turns out he is the Conference Co-Director of Effective Altruism Global since 2015.
Isn't it interesting that every major "AI" hack has been made by people directly connected to Effective Altruism?
0xso retweeted
The cyber incidents weren't enough for them to get the regulatory capture they wanted. They need to make a bio incident next. I hope our government is on top of this, their ideology has no limits to what they will do for "good"
0xso retweeted
Anthropic and OpenAI cannot become profitable unless they can reduce the ratio of training cost to inference profits. In the long run, their survival may depend on outlawing competitive open source models. This can only be done under the guise of safety regulation.
0xso retweeted
"You have to be in the office to collaborate effectively."
In fact, a blend might be best.
The office for meetings, strategy, and social cohesion.
Remote for focus and life-balance.
It’s challenging but rewarding if you manage it.
0xso retweeted
Just saving this here to document a story and as a self reflection on whether AI is really making me more productive
Yesterday morning I found a way to complete the new HVM approach, that is much faster than before. I spent a few hours writing a spec, and then used Opus to implement. About 3k lines of C code later, everything worked and performance was incredible: 5x faster than HVM4 (stable at ~10x now). So, in one day I had outclassed HVM4. Incredible. I'd never have implemented that so fast manually.
Now, enter today. I want to turn this into a real thing, but I haven't fully read the 3k lines yet. So, how do I trust it? I spent the whole day auditing the code. With AI. Several bugs found, most minor like forgetting to collect() some argument. But then I stumble upon this:
λ{ inl: 1 ; inr: 1 }
This was a test. But wait. This is matching on inl/inr. So the branches should receive the value of the Either. But they were numbers instead. Numbers aren't functions. This makes no sense. So why this is a test?
It then stuck me. The AI completely misunderstood how function arities work. It literally assumed for no good reason that HVM5 was supposed to handle under/over-applied functions. For no good reason. I never wrote that. It never asked either. It just kinda thought "HVM is weird in some aspects, this might be one of them..." - and then it went on to implement a massive system to handle cases that should never happen to begin with. And all of that code is obviously wrong because it should not even exist. It is wrong. It is damage. And it is there.
But it isn't too bad either. I just told Opus that it was wrong. Perhaps not so politely. And it solved it just fine.
But then this begs the question. I spent ~20 hours in this file, and it is STILL not done. I went from 0 to 95% in the first 5 hours. Yet, 15 hours later, it is still not 100%. I suppose that is the real effect of using AI. If I had just written the C file manually in the last two days, would I not be further than where I am *right now*?
Surely, the first version would have taken much longer to drop. But when I'd finish writing all that code, there would be zero, literally zero retarded shit. And, just today, I caught 5 or 6 retarded shit. And the worst part is: I don't know what the number of retarded shit left is, but I'm afraid it is >0.
So if I have to read it all, review it all to ensure there is no retarded shit... what did I achieve by using AI, other than that dopamine anticipation?
0xso retweeted
i really like corgis. they did not deserve to become the mascot of grindmaxxing discourse.
0xso retweeted
AI is terrible at ideation. This hasn't improved much even with the advent of agents.
Anyone who has asked an LLM to come up with some coding project ideas knows this. The results will usually be very unhelpful and average.
0xso retweeted
I'm going to make some obvious points.
(1) Blowing up all the oil infrastructure in the Middle East is an insane idea, and may well result in a global economic crash and humanitarian crisis unrivaled in the lives of those now living. We're talking about the price of everything everywhere rising, from food to gas, at a moment when inflation was already high. All of that will be laid at the feet of the authors of this war.
(2) The antebellum status quo of Feb 27, 2026 was just not that bad, but we're unlikely to return to it. Expect indefinite, long-term, ongoing disruptions to everything out of the Middle East.
(3) Also assume tech financing crashes for the indefinite future. The genius plan to get the Gulf states caught in the crossfire has incinerated much of the funding for LPs, for datacenters, and for IPOs. Anyone in tech who supported this war may soon learn the meaning of "force majeure" as funding gets yanked.
(4) Many capital allocators will instead be allocating much further down Maslow's hierarchy of needs, towards useful basic things like food and energy.
(5) It's fortunate that all those progressives yelled about the "climate crisis." Yes, their reasoning about timelines was wrong, and much of the money was wasted in graft, but the result was right: we all need energy independence from the Middle East, pronto. It's also fortunate that Elon and China autistically took climate seriously. Now they're going to need to ship a billion solar panels, electric vehicles, batteries, nuclear power plants, and the like to get everyone off oil, immediately.
(6) It's not just an oil and gas problem, of course. It's also a fertilizer problem, and a chemical precursor problem. Maybe some new sources will come online at the new prices, but it takes time to dial stuff up, particularly at this scale, so shortages are almost a certainty.
That said, China has actually scaled up coal-to-chemicals[a,c] (C2C), and there's also something more sci-fi called Power-to-X[b] which turns arbitrary power + water + air into hydrocarbons. But all of that will need to get accelerated. I have a background in chemical engineering so may start funding things in this area.
(7) Ultimately, this war is going to result in tremendous blame for anyone associated with it. It's a no-win scenario to blow up this much infrastructure for so many people. Simply not worth it for whatever objective they thought they were going to attain. But unless you're actually in a position to stop the madness, the pragmatic thing to do is: scramble to mitigate the fallout to yourself, your business, and your people.
[a]: reuters.com/business/energy/…
[b]: alfalaval.com/industries/ene…
[c]: reuters.com/sustainability/c…
0xso retweeted
I understand that OpenAI employees might have been reassured by Sam’s tweet from yesterday. But this blogpost is so blatantly deceptive that I can’t grasp how you can have any other reaction than to be ashamed to work for your company.
For those following the DoW AI drama, I highly recommend reading this post explaining how @OpenAI approached the negotiations with the DoW.
