Hacker News new | past | comments | ask | show | jobs | submit login

Cool library, Jeremy...another Ruby scraping framework you might want to check out and improve upon is Artsy's Spidey:

https://github.com/joeyAghion/spidey

Has a similar approach but also leaves storage (and caching) up to the end-user.




Thanks, Dan. I'll check that out, especially for good ideas on how to solve things I haven't solved yet. Spidering and scraping seem to be very related, but not quite the same -- and I admittedly know nothing about spidering.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: