On: Addressing Recent Claims of “Manipulated” Blog Pos...

[rocqua]

Why allow retroactive suppression at all?

It seems to make the most sense to only have a robots.txt affect pages archived when that specific version of robots.txt is in effect.

[cheschire → rocqua]

Perhaps this article[0] may provide you with insight into the motivations of those who may prefer to suppress historical data.

0: https://en.wikipedia.org/wiki/Right_to_be_forgotten