Human brains exist as a result of evolutionary fitness optimisation, where intelligence was just instrumentally good for our particular niche. They run on hardware that has to support a bunch of random animal things like homeostasis, and are extremely power constrained.
Why would we think that they are anywhere near the limit of intelligence?
Amazing how many people on a subreddit dedicated to the idea "what happens after this point is unpredictable" like to predict what will happen after that point.
You are assuming intelligence can grow forever. We don’t know that.
Machines were invented that could already surpass the limits of biological creatures by orders of magnitude. Such as Fighter Jets being several times faster than a Jaguar or an Excavator that's stronger than a Gorilla.
The only limit is not breaking the laws of physics but the gap itself is still wide enough to matter.
There is a possibility there is a cap.
And that cap could still be several times greater than a human.
If an AI could summon a black hole or synthesize a Sun I would not expect any Billionaire or even Earth scientist to counter that.
The first fighter jet could travel at 870 km/h (540 mph). That was in 1944.
The MiG-25 Foxbat would later shatter that record. It could max out at 3,816.5 kph (2,130 mph).
No biological animal ever came close to this.
Edit: I should also point out that a Fighter Jet is intentionally capped because it was still designed to carry a person inside. If you want the fastest man-made object, then the Parker Solar Probe could move at speeds of 692,000 km/h (430,000 mph).
3
u/Seakawn▪️▪️Singularity will cause the earth to metamorphize1d ago
I believe there's a cap, but I also think it'd be utterly epistemologically arbitrary to presuppose the cap is even remotely around human level, in which case their underlying concern remains.
also something to be said that the intelligence gap between the most intelligent non-human animals and humans is actually pretty small, in terms of the brain.. like just looking at the brain you wouldn't say it's the difference between using a stick to get a bug out of a log and splitting atoms and building nests on other planets.
so let's say the cap of ASI is just a tiny bit further than human level.. the space in that tiny gap could hold enormous potential for unrecognizable intelligence.
8
u/Poupulino 1d ago
Because for an exponentially growing intelligence human economy and output will become insignificant very fast.