Hacker News new | past | comments | ask | show | jobs | submit login

Google does eliminate more than 90% of scrapers. It's just really easy to create scrapers; they can outnumber the original content by more than 1000-1. So you need many, many systems to remove scrapers.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: