For PDF you can use X-Robots-Tag HTTP header [0]. Nofollow is a good suggestion ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

hdhzy on April 21, 2017 | parent | context | favorite | on: Robots.txt meant for search engines don’t work wel...

For PDF you can use X-Robots-Tag HTTP header [0].

Nofollow is a good suggestion of you control links to the resource, robots of you don't.

[0]: https://developers.google.com/webmasters/control-crawl-index...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact