Hacker News new | past | comments | ask | show | jobs | submit login
Yahoo to open source s4, their real-time mapreduce project (qr.ae)
43 points by ajessup on Nov 3, 2010 | hide | past | favorite | 4 comments




As pointed out in the question link, the git repo would be available at http://github.com/s4 in the near future.


will this supersede hadoop ?


No. This is complementary to Hadoop. Google's Percolator is a similar system and they say that it's much less efficient. If you don't need continuously updated data then Hadoop is a better choice.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: