On: AI crawlers need to be more respectful

[PaulHoule]

There was a paper about webcrawlers circa 2000 that pointed out that the vast majority of academics who ran webcrawlers never published a paper based on their work.

[morkalork → PaulHoule]

Sounds like all the kids who want to make a video-game and start with building a game engine.