Hacker News new | past | comments | ask | show | jobs | submit login

It was not common crawl. I applied for access at one time. I ended up dropping the ball because I got distracted by other projects, and never got approved.

As far as any relation to common crawl, I imagine there are good reasons on both sides, pro and con, for them possibly to have donated some data to common crawl maybe, but that's just speculation. My guess is they've got too much on their plate to swing yet another project like that.

You could try reaching out.. maybe they have a quiet research program still. Or maybe for donors, if that's an option.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: