Hacker News new | past | comments | ask | show | jobs | submit login

The argument hinges on Google getting access to Craigslist listings while others are denied. However, that doesn't seem to be true:

http://www.craigslist.org/robots.txt

https://www.google.com/search?q=site%3Aseattle.craigslist.co...

Update: The comment you quoted is a year old and Craigslist only recently blocked Google. http://www.seomoz.org/blog/craigslist-blocks-search-engines Perhaps they decided to block everyone to bolster a legal case against aggregators like Padmapper.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: