Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
tomjen3
on April 21, 2017
|
parent
|
context
|
favorite
| on:
Robots.txt meant for search engines don’t work wel...
They also make the content available to the public, which is directly competing with the site owners.
Thats inviting lawsuits they can't win and expecting people to pay the bandwidth for it too.
Join us for
AI Startup School
this June 16-17 in San Francisco!
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Thats inviting lawsuits they can't win and expecting people to pay the bandwidth for it too.