Ernir Erlingsson (@ernire) header
Ernir Erlingsson (@ernire) profile picture

Fluctuat Nec Mergitur

Reykjavík, Iceland
Joined July 2012
Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)Photo by Ernir Erlingsson (@ernire)
Ernir Erlingsson retweeted
What happens if your CPU gets something wrong? If it wakes up one day and decides 2+2=5? Well, most of us will never have to worry about that. But if you work at a company the size of Google, you do, which is why this paper on "mercurial cores" is so fascinating. What the authors report--and supposedly this is common knowledge at the hyperscalers--is that a couple cores per several thousand machines are "mercurial." Due to subtle manufacturing defects or old age, they give wrong answers for certain instructions. These can cause all sorts of impossible-to-diagnose issues. Some rare problems at Google that were traced back to bad CPUs include: - Mutexes not working, causing application crashes - Silent data corruption - Garbage collectors targeting live memory, causing application crashes - Kernel state corruption causing kernel panics What makes CPUs go bad? It's very hard to tell. The authors posit that issues are becoming more frequent as CPUs get more complex, but there aren't solid numbers behind that. There are certainly strong relationships between frequency, temperature, voltage, and bad CPU behavior--most mercurial CPUs only cause problems under very specific conditions, but those conditions vary from CPU to CPU. Age is another source of problems, as older CPUs are more likely to exhibit problems. Bad CPUs are an especially serious problem because they're very hard to detect. If cosmic rays flip bits in storage or on the network, that can be detected through error coding. But there's no analogy for a CPU that allows cheap online verification of its correctness. Instead, the best detection techniques involve monitoring for symptoms. If a core exhibits exceptionally high rates of process crashes or kernel panics relative to its fellows, that's a strong indication something is wrong with it. For the most critical applications, the authors propose triple modular redundancy--redoing each of its computations on three cores and majority-voting a reliable result. More than anything, this paper is a call to action--letting everyone know that CPUs can fail. So now, if you ever find a bug you can't diagnose, you can blame the CPU! 🙂
155
1,277
154
8,432
760,425
Ernir Erlingsson retweeted
This will be the first Presidential election since 1976 to not have a Biden, Bush, or Clinton on the ticket.
1,926
16,174
3,240
207,804
12,436,865
Ernir Erlingsson retweeted
Solar eclipse from plane
143
16,038
898
75,340
5,985,963
Ernir Erlingsson retweeted
The most radicalizing thing about the modern world is that a lot of people with money and power have decided that they’d rather render the planet uninhabitable for future generations than make less money
We are witnessing the collapse of our ecosystem and no one seems to care
151
16,502
170
63,506
2,279,627
Ernir Erlingsson retweeted
We are proud to host JUPITER, the first European Exascale system by @EuroHPC_JU! The contract is awarded to a consortium of @Evidenlive and @ParTec_AG. JUPITER will consist of a Booster (NVIDIA technology) and a Cluster (SiPearl Rhea). #HPC #exa_jupiter fz-juelich.de/en/news/archiv…
2
10
2
34
4,333
Ernir Erlingsson retweeted
Our planet is burning. Millions are under heat warnings as world shatters temperature record after temperature record. This is only the beginning. The longer we delay. The worse it will be. No time to wait. Dump fossil fuels. #ActOnClimate
354
782
81
1,546
131,292
This is huge. Recent academic paper shows that GPT-4 lost significant capability in code skills over a few months. I love GPT-4 but it would be nice to have OpenAI address this. They've been insisting that users are "imagining it," basically.
199
426
164
2,648
2,197,467
Ernir Erlingsson retweeted
Norway just found more high grade phosphorus rock than the rest of the world put together!!!???? 70 billion tonnes of proven reserves! 1.25X more than Morocco 20X more than China. euractiv.com/section/energy-…
70
531
277
3,449
1,528,676
Ernir Erlingsson retweeted
RIP CPU-based AI supercomputers? NVIDIA just announced DGX GH200, an AI supercomputer that combines whooping 256 Grace CPUs & Hopper GPUs in the same package with 144 Terabytes of shared memory! Here's the breakdown
87
535
156
2,641
769,332
Ernir Erlingsson retweeted
Eight years ago, Google mislabeled Black people in photos as “gorillas.” Google apologized, promised to fix it, and turned off Photos’ ability to label *anything* a gorilla. Despite AI advancement, Google still can’t “see” most primates. Same for Apple. nytimes.com/2023/05/22/techn…
4
145
23
399
134,724
Ernir Erlingsson retweeted
The most powerful debugging tool: walking away from your computer.
67
330
54
2,522
187,118
Ernir Erlingsson retweeted
Percentage of the population that can hold a conversation in Icelandic
406
1,919
402
64,890
5,160,046
Ernir Erlingsson retweeted
Scientists deliver ‘final warning’ on climate crisis: act now or it’s too late theguardian.com/environment/…
1
3
148
Ernir Erlingsson retweeted
2
6
34
3,842
Ernir Erlingsson retweeted
If Google doesn’t get their act together and start shipping, they will go down in history as the company who nurtured and trained an entire generation of machine learning researchers and engineers who went on to deploy the technology at other companies… The modern day Bell Labs.
Replying to @hardmaru
What exactly is google going to do with its AI research outcome is the biggest secret in the field 🤣
57
173
33
1,792
569,535
Shortest day of the year. Sunrise at 11:21. Sunset 15:30.
5
7
1
115
15,181
Ernir Erlingsson retweeted
I have discovered the best possible use of ChatGPT
54
481
104
4,133
631,829
Cloning and installing #ChatGPT inside of itself and then running the experimental concious_chat.py script. 😂
23
44
14
350
Ernir Erlingsson retweeted
I can't compete with this
75
648
163
7,046
Ernir Erlingsson retweeted
today we launched ChatGPT. try talking with it here: chat.openai.com
4,961
13,784
13,219
114,586