Hacker News new | past | comments | ask | show | jobs | submit login

Every time you use Google you benefit from scraping. Scraping is how the world works for the last 25+ years.

You are trying to draw a distinction between data that is pushed and data that is pulled, and maybe there is some economic argument there in terms of resource usage, but that is very context-dependent.

In UK listening to public radio broadcasts is illegal. I think this law is idiotic and ignore it. It seems you do too since there appear to be streams from UK on your site :)




Google benefits from legal scraping - ban them from robots.txt and they'll stop.

Please don't mix consensual and non-consensual scraping, the difference is huge.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: