Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
acchow
on June 14, 2023
|
parent
|
context
|
favorite
| on:
The Reddit blackout has left Google barren and ful...
> Perhaps Google also needs to learn to search those closed gardens better.
There's a hard limit at what is allowed by robots.txt since Google abides by this standard.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
There's a hard limit at what is allowed by robots.txt since Google abides by this standard.