I also have a personal gripe with the Wayback Machine; there is absolutely no way to get something removed once they archive it (despite the data including accidentally leaked PII for example - which can cause actual harm to someone).
Not only do they ignore robots.txt, they ignored all emails sent to info@archive.org from the actual domain in question which I owned, with a link to a URL on the domain asking them to remove it.
I can understand wanting to preserve some large website's article that is of public interest but this is just malicious / dangerous. It took me 2 years and working with a lawyer friend to draft a DMCA request to finally have them remove the content.
Not only do they ignore robots.txt, they ignored all emails sent to info@archive.org from the actual domain in question which I owned, with a link to a URL on the domain asking them to remove it.
I can understand wanting to preserve some large website's article that is of public interest but this is just malicious / dangerous. It took me 2 years and working with a lawyer friend to draft a DMCA request to finally have them remove the content.