Hacker News new | past | comments | ask | show | jobs | submit login

There may be one slight (and practically irrelevant) difference: the blog posts are still archived by the wayback machine, but it refused to serve them due to the robots.txt file.

If that file were to be removed, presumably the archive would again be served up upon request.

The lawyers were asking for the archive store itself to be wiped.




Yeah, I've come to appreciate that their frustrating robot.txt policy is actually a wise way for them to avoid chipping away at the complete archive. Obviously they have a mission that stretches far beyond the lifespan of todays internet users and the relevance of robot.txt files.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: