On: Why Conscious AI Is a Bad, Bad Idea

[goatlover]

Or as George Hinton puts it, when you give AIs the ability to create their own subgoals to accomplish some goal, they're likely to quickly realize that having more control will help them accomplish their goal.