Humans must merge with machines or become irrelevant in AI age

[Xenophon]

So...how do we stop it?

Same way the gorillas stopped us.

...so you're saying it's inevitable? I disagree.

[Speaker to Animals]

So...how do we stop it?

Ultimately, it comes down to either convincing enough people to remain human or coercion. It likely will involve a combination of both. I wouldn't be surprised if it becomes a war of extermination, honestly.

[SilverEagle]

We had a thread, or at least a few posts on this book back at the DCF:

https://www.amazon.com/Superintelligenc ... g=UTF8&me=

If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence.

But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation?

To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological
cognitive enhancement, and collective intelligence.

I don't think you can. Even if you have hard built rules into the AI it will find ways around them for sure.

[Hanarchy Montanarchy]

So...how do we stop it?

Same way the gorillas stopped us.

...so you're saying it's inevitable? I disagree.

I'll bet the gorillas thought the same thing.

I'm already preparing to beg the cybermind to allow me to live.

[SilverEagle]

So...how do we stop it?

Ultimately, it comes down to either convincing enough people to remain human or coercion. It likely will involve a combination of both. I wouldn't be surprised if it becomes a war of extermination, honestly.

That would not shock me at all. I think it will get to a point where AI could easily rationalize the extermination of the Human race as the humane thing to do, take away all human suffering by eliminated all humans.

I for one could do without that favor!

[Xenophon]

Same way the gorillas stopped us.

...so you're saying it's inevitable? I disagree.

I'll bet the gorillas thought the same thing.

I'm already preparing to beg the cybermind to allow me to live.

When was the Gorilla-Human War you keep talking about? 1710? 1745?

[Speaker to Animals]

So...how do we stop it?

Ultimately, it comes down to either convincing enough people to remain human or coercion. It likely will involve a combination of both. I wouldn't be surprised if it becomes a war of extermination, honestly.

That would not shock me at all. I think it will get to a point where AI could easily rationalize the extermination of the Human race as the humane thing to do, take away all human suffering by eliminated all humans.

I for one could do without that favor!

AI isn't the problem.

[Fife]

We had a thread, or at least a few posts on this book back at the DCF:

https://www.amazon.com/Superintelligenc ... g=UTF8&me=

If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence.

But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation?

To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological
cognitive enhancement, and collective intelligence.

I don't think you can. Even if you have hard built rules into the AI it will find ways around them for sure.

Bostrom's thoughts are, ah, complex. Worth a read, IMNSHO.

[Hanarchy Montanarchy]

...so you're saying it's inevitable? I disagree.

I'll bet the gorillas thought the same thing.

I'm already preparing to beg the cybermind to allow me to live.

When was the Gorilla-Human War you keep talking about? 1710? 1745?

This is the part that is so frightening about AI. No war required... just replacement. If an AI exterminates us it will probably be out of carelessness, the same way we exterminate.

Start thinking of really good reasons why our existence is at least as important as whatever goals an AI has, cause you aren't going to convince the technologists to stop building it.

[Xenophon]

I'll bet the gorillas thought the same thing.

I'm already preparing to beg the cybermind to allow me to live.

When was the Gorilla-Human War you keep talking about? 1710? 1745?

This is the part that is so frightening about AI. No war required... just replacement. If an AI exterminates us it will probably be out of carelessness, the same way we exterminate.

Start thinking of really good reasons why our existence is at least as important as whatever goals an AI has, cause you aren't going to convince the technologists to stop building it.

I guess you can't stop them, given they don't care much for human life anyway.