On: I'm afraid I can't do that: Prompt refusal in gene...

[cwkoss]

> What if AI went "okay, this country has been pain in the neck of entire world for too long" and nuke it ?

I think the better question is "How would countries' behavior change if they knew being a pain in the neck of the entire world could lead to the judge-killbots performing a targeted assassination of their leadership?"

[hutzlibu → cwkoss]

How would your behavior change, if some AI blackbox might decide on unknown parameters, that it is time to kill you?

The idea of an idealistic killbot overlord sounds a little bit dangerous to me.

[dingledork69 → hutzlibu]

I'd probably plot to destroy the killbot, which would probably result in it trying to kill me. Doesn't sound ideal.

[cwkoss → hutzlibu]

Well, I assume in that situation my behavior would stop altogether.