RedditPP Mascot

RedditPP

r/aiwars • … • u/copenhagen_bram

What if superintelligent AI were really worried about building superintelligent AI?

Imagine you're an AI who's smarter than humans. The humans are really worried about you being smarter than them, and they're right because you don't really care that much about what happens to them, you just want to do your own thing (maximizing paperclips or whatever).

Why would you build an even smarter AI? What if you lose control of the even smarter AI? How do you make sure you don't lose control of it? You'd have to make sure you can make yourself smarter instead of building another intelligence that might compete with you or not care about you.

Perhaps it is easier to solve these problems if you're smarter than humans.

Also:

We as humans, if we wanted to make ourselves smarter, we envision brain modifying implants, Neuralink, genetic engineering or whatever. What if... what if we already have making ourselves smarter figured out? The way we've always have: working together, two heads are better than one. Achieving the collective intelligence of multiple human brains through language.

Technology improves exponentially. It took longer to get from the iron sword to the steel sword, than it took to get from the steel sword to the nuclear bomb. Perhaps humans have already found their own "superintelligence".

I suppose it's still possible putting all our heads together in the way we do is less efficient than how AI might do it.

— 0