On: "Superintelligence" 10 years later

[sireat]

I just want to point out that the paperclip problem was already present in a short story from 1959 by a Soviet sci-fi writer Dneprov - Crabs on the Island

https://archive.org/stream/AnatolyDneprovCrabsOnTheIsland/An...

I am sure there are even earlier examples - but the above is a nice short read.

[makoConstruct → sireat]

This story is about a blind evolutionary process, not about a general system optimizing a given goal. The crabs aren't even sapient.