One good way of staying to a prudent course / halting haphazard - winner takes all progress is to use social tech for it. In particular, there is an interesting possibility: the top researchers who drive the AI scenario all kind of know each other, and can self-organize in an international union, with pooled resources for strikes. AI revolution is dependent on simultaneous progress and cross capitalization of good ideas: a well timed strike of a good portion of research worldwide can stop things from moving on pretty effectively.
> the top researchers who drive the AI scenario all kind of know each other, and can self-organize in an international union, with pooled resources for strikes.
This is skipping to the end in the same way that "governments should just agree to work together" is. The hard part is building an effective coordination mechanism in the first place, not using it.
Laughably naive. International groups of autoworkers won’t work together but you think a group of the highest paid people on the planet, with incentive to compete against each other for national interest, will.
