Hacker News new | past | comments | ask | show | jobs | submit login

Thanks! More interested in the scraper.. is it open-source? If yes, where can we download it? If not, can you write about your experience in building it?



Writing a Twitter scraper is pretty trivial and you can find several good examples on Github. I'd put mine online, but the commands I was using in 2009/2010 are changed/deprecated largely and my code wouldn't run.

In either case, as Sethish said, distributing dumps like this is against the new ToS.


I will blog about how I did it in a few days...


Where do you Blog so I can add to my RSS?


I dont have a blog, sorry. I will open one soon...

Feel free to follow me http://twitter.com/calufa.


if you are interested in crawling FB, check this out http://www.zubha-labs.com/oauth-trick-for-facebook-desktop-a...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: