Oh noes - the robot army is here! Those submarines with the power to end life as we know it (basically post 19th century life), we've forgotten about them, let's all get worried about the robot army!
What I mean is, it's not autonomy that you should worry about, it's actuators. The biggest actuators are nuclear weapons - a trident sub can slap 200 warheads that are 50* bigger than Hiroshima's onto a given continent, and the fires would blot the sun from the sky for two years. There are 7 billion agents with autonomy knocking around, and the type that they are derived from has a bad record about doing dumb evil things!
Cool AI would probably be a safer arbiter of our extinction.
What I mean is, it's not autonomy that you should worry about, it's actuators. The biggest actuators are nuclear weapons - a trident sub can slap 200 warheads that are 50* bigger than Hiroshima's onto a given continent, and the fires would blot the sun from the sky for two years. There are 7 billion agents with autonomy knocking around, and the type that they are derived from has a bad record about doing dumb evil things!
Cool AI would probably be a safer arbiter of our extinction.