Without human activity it would have taken a thousand years for ice to start creeping in. Now it is warming much faster than it would have cooled down.
More greenery is good as long as the pace of warming is kept in check.
We won't solve aging by simulating everything in precise detail. We will do various experiments, mapping of problems space, and iterations. So, heavy use of reality.
People who don't have good use for the tools, and only ask it questions, think the tools are not good. People who do serious interactive work with real problems disagree.
Sure, AI keeps on making basic mistakes. These will continue to be fixed. The world is big but we are slowly mapping it all.
The problem here is damning a whole industry because some spending is being recalibrated.
AI is on a good track, but the ramp up has been way too fast.
AI going beyond language and using tools and exploring its environment has been the case for a few years now.
Replying to @pmddomingos
The smarter AI gets. The smarter it will get. But it will have to beyond just language to get even smarter. It needs to integrate ideas with math and simulations. And the results will in turn make it smarter than before. The ultimate improvement comes from real world experimentation when ideas are validated.
Language generates possibilities. Mathematics establishes logical and quantitative relationships. Simulations explore the consequences of interacting mechanisms. Real-world experimentation determines whether the models actually correspond to reality.
No. Plenty of folks have consistently assuming AI will go far, but it is complex automation rather than some wild thing. Doomers have the wrong ideas for how to handle this.
AI as a Normal Technology
The current normie mainstream consensus on AI risk has switched from "AI isn't real and never will be" to "AI is real and it is a normal technology"
The implications of thinking about AI risk as the risks of a normal technology are:
- AI risk can be dealt with using existing institutions
- AIs are tools that are used by people, so people are legally liable. Like a hammer.
- AI won't do anything out of the ordinary, so it will cause human-like risks which we already know how to deal with.
- We can test out AI in a controlled environment and patch it up a bit and release it and everything will be fine. It will not significantly change its safety-relevant behaviour between testing and deployment
- The AI risk community are weirdos and hypochondriacs
"AI as a normal technology" will last until AI does something that is obviously not normal, i.e. overwhelm human institutions and controls enough that everyone notices.
And on the current path, that will probably happen this decade, likely if/when AI is put in charge of its own development by labs pursuing RSI, or failing that when robots are widely deployed in civilian or military use.
The problem is, at that point the hour will be very late.
It is like Pandora's box. The slop escapes first. The tools will keep on getting better and we will figure what to do with the side effects.
But AI is here to stay. We are not powerless but for most folks is just automation. Good luck going back to horses.
This quoted post is unavailable.
Airplanes don't truly fly! They cheat by blowing air from rear.
Tesla Roadster is cute. Let them have fun. That won't save Tesla from its current slump, and humanoid robots won't come soon enough to do that either.
Interpretability will not be solved. The world never conforms to any provable logic.
This will be empirical work, and will go better than doomers think.
Solving interpretability is not enough, and I am not goalpost-moving. The project of creating superintelligence is so reckless, unprecedented, and audacious that they expect a parade if AI does not cause human extinction.
First of all, interpretability is not solved, the author just thinks it might be in time.
Second, even if interpretability were solved, there can still be catastrophic accidents! Civil engineering is solved, bridges still collapse. Even a fully-interpretable AI could make a mistake, which could still lead to a catastrophe if the mistake is in a bio lab.
Third, is interpretability strictly safe-only? Okay, a "good" actor can take out the bad stuff. Could a different actor keep it, or add to it? A lot of AI research is dual-use.
Fourth, short of malicious extinction at the hands of an AI, this does not address any of the problems inherent to AGI! Everything in our society, from democracy, to free markets, to fundamental freedoms like free speech, are predicated on the fact that people have leverage over each other. If you don't like your boss, you can quit your job and the boss will lose out on your labor. The military and the police are people with families and moral compasses. What happens in a world where humans are economically worthless and only owning AI chips and robots means anything? I don't think this will be a utopia. I think the vast majority of people will be disempowered and at the whims of the ruling class. I do not want a UBI that can be taken away, and I have no recourse and no power.
The AI companies are embarking on a project so crazy that "we won't definitely kill you all intentionally" is seen as good news. It's a good start, but we're nowhere close to safe from them.
This is correct with a caveat that AI agents in technical areas can dutifully ground their work as they progress with tools, and can adapt and fix problems.
If you can measure someting, AI will get good at it.
Replying to @gmkurtzer
In reply to your question, I would answer that contemporary frontier models are complex stateful reactive stochastic software-intensive systems with certain degrees of self-referential reflection, capable of coherent albeit unreliable outputs. Their behaviors are for the most part taught, not learned.
But I would not use the phrase “machine consciousness” because the word consciousness is a suitcase word, full of flame and fury and emotion and historical baggage, a word that distracts from computational reality.
People who don't use the tools tell the people who use them that the tools are a scam.
No. This is a speculation. We all know that the AI is not doing faithful work, but has nothing to do with quantum mechanics or floating point.
Our brain is fancier, more adaptable, has better world models.
AI alignment is a badly posed problem. This is not pessimism, but other way around.
This industrial machinery to be fixed empirically, not something to prove or guarantee.
This is correct. It's one of the many obvious problems with AI doomer theory.
Quite parallel with the concept of revealed preferences in economics. In fact, now that I think about it, the impossibility of pre-constructing an "alignment" function is formally identical to the impossibility of pre-constructing a preference function.
TIL
This is a legitimate point. It is not a show-stopper. I have seen AI tools (I use Claude) get remarkably good with time, and a lot of the work becomes in-distribution.
Use AI for simpler things first. Augment yourself. With time, it gets better and cheaper.
I spent the better part of 5 hours last night trying to get Gemini Pro to map atoms of a crystal between two thermodynamic states (ended up staying up until 2 AM pulling the AI slot machine lever). I asked it every way I could imagine. Fed it inputs and results, even gave it hints. No matter how convincing the solution sounded, the results were complete slop. I'm now creating the map myself.
I installed every python package it asked for to help it find a solution. While it wrote decent code to implement the strategies it proposed, it just couldn't wrap it's head around how the crystal unit cell repeats, even though it knew what the structures inside should look like. It couldn't look across one boundary and see the other and connect the dots.
What it helped with:
1. Finding existing workflows for solving similar problems to what I am working on (created by humans).
2. Writing boilerplate code for those existing workflows (written and heavily reinforced by humans).
What it failed miserably at:
1. Symbolic reasoning. Even though it knew the exact sub-structure of the chemical groups in the lattice, it could not identify those groups from coordinate data. Trivial for a human to do instantly. It immediately resorted to statistical methods and existing algorithms to try and identify the groups and failed because the algorithms were not written to handle my specific case.
2. Spatial Reasoning. Even though a simple crystal visualization tool can immediately pick out covalent bonds and group them in distinct groups (albeit without wrapping across unit cell symmetry), the AI was helpless to recreate even this. Even when it was telling me that a group was cut in half on a specific plane of the unit cell, it couldn't stitch those two together. The words sounded right but the mental understanding did not exist.
3. Context and logical reasoning. The context was all over the place. I told it multiple times what the ultimate goal was, and it never could make very good decisions about what corners I could cut to make the approach more doable and elegant without throwing out crucial details. Again, it just regurgitated what others have done in its training data for problems of the same class.
This is a great example of what I mean when I say that these things are still stochastic parrots. The things it vomits up are now processes instead of just words, but the underlying statistical methods have not changed over nearly a century.
This is so clearly not intelligence. It is just better, MUCH More expensive, search. Yes, the search blows away existing html metadata indexes, but at what cost, and is the cost justified if it's just really good search?



















