devilwalk09 retweeted
I am proud of the work my team did in Munich in 1991, when compute was millions of times more expensive. We published the roots of today's trillion-dollar AI boom:
★ 3/1991: the first kind of Transformer (see the T in ChatGPT) - now called the unnormalized linear Transformer: the predecessor of the normalized quadratic Transformer
★ 4/1991: Pre-Training (the P in ChatGPT) & Neural Net Distillation (see DeepSeek and many other LLMs)
★ 6/1991: Deep Residual Learning, basis of LSTM & Highway Net / ResNet (most-cited AIs of their centuries)
★ 8/1991: conference paper on GANs for World Models trained by Artificial Curiosity
★ Around the same time, Munich also was the origin of the first self-driving cars in traffic (Ernst Dickmanns et al.), going up to 175 km/h. The city was truly the epicenter of AI.
Read the timeline with links to the original references, featuring a preface by @hardmaru:
people.idsia.ch/~juergen/ai-…
devilwalk09 retweeted
Programming Massively Parallel Processors is one of those books that fundamentally changes how you think about computation.
One of the best free courses on low-level performance programming - Aalto University's Programming Parallel Computers covers SIMD, pipelining, cache optimization, and more.
If you care about squeezing CPU cycles, this is definitely worth taking up.
ppc.cs.aalto.fi
devilwalk09 retweeted
No prob youtube.com/watch?v=ZUtdAtSA…
devilwalk09 retweeted
We have wasted an uncountable amount of money in our industry trying to deny the underlying reality: the best software is made by small teams of people where each person is well trained, trusted, and not easily replaceable.
devilwalk09 retweeted
Time in front of the computer/books: ingest knowledge
Time walking and meditating later: build understanding
devilwalk09 retweeted
The uncomfortable truth: genius-level output is often a lifestyle design problem more than a raw talent problem.
devilwalk09 retweeted
Women who are truly in love with a man they admire often desire him with overwhelming intensity. They want to touch him constantly, think about him constantly, merge their life and body with his existence in ways that feel instinctual. Attraction starts feeling existential.
You cannot stop thinking about him sexually and emotionally. You dream about building a life with him, having children with him, existing beside him permanently.
The desire becomes so deep that distance itself begins to feel painful. Being unable to touch him or be near him and being unable to experience his presence starts registering almost physically within the body.
That is why reducing all intimacy to “sex work” feels so spiritually empty to me. Real love transforms desire into something far more profound than transaction. It becomes devotion, longing, attachment, admiration, and an almost unbearable need for closeness.
Emotionally deprived women are usually the ones who reduce love between men and women to mere transaction.
If you genuinely believe that all relationships with men are merely sex work, then perhaps you have simply never experienced what it means to deeply love and respect a man.
devilwalk09 retweeted
I vibe coded a new plane of existance so I no longer need to communicate to lower life forms
devilwalk09 retweeted
Sad reality of salary dynamics - unless you're in Nvidia or something, the only way to not fall behind the market is to hop jobs every 2-ish years. And the entire overall industry is built around this :/
devilwalk09 retweeted
Amazing series on memory allocation strategies by @TheGingerBill
gingerbill.org/series/memory…
devilwalk09 retweeted
Deleting code is the best kind of engineering. Period.
Simplicity > Lines of code.
While the whole world of vibe coders brags about pushing tens of thousands of LOC a day, I'm actually happier when my codebase shrinks every now and then, usually when I spot repeating patterns and extract reusable code into a better architecture.
File Pilot is only a little above 100k LOC right now, which I already consider a lot. And I've been working on it for 4 years straight. So when I see people here talking about how they push thousands of LOC a day, I'm like... there is no way in the world you understand that code and all the implications of all the pieces that have to communicate with each other.
You're gonna lock yourself so fast, into a place of such complexity that not even AI will be able to help. And for what? Speed? In generating mediocre junk code.
You only value your time. I value my users time.
We're not the same.
devilwalk09 retweeted
I prefer working with self-motivated colleagues who can work autonomously over highly skilled persons who need constant supervision and motivation.
Empower self-motivated colleague with the freedom to make decisions in the area he is interested to work in - and you'll get 10x value from happy colleague.
devilwalk09 retweeted
A lot of people say that vibe coding burns them out more than a regular programming. It's because of the toxic anti-zone that you get into by constantly pulling the lever. You get in a state similar to that of gambling addicts. It fries your brain.
Real flow state is energizing and rewarding, because it makes you truly deeply understand the system you're working on. You have real control, and your brain feels safe.
