Hacker News new | past | comments | ask | show | jobs | submit login
A peek at memcached's implementation (amix.dk)
16 points by theoneill on Oct 22, 2008 | hide | past | favorite | 2 comments



I more concern about the key-value mechanism of memcached. As I remembered, memcached used crc32 to generate integer key from string which only takes 32bit-length. By scaling to terabytes as Facebook does, there must be some magic to play around with.


The hashing that is used within a single memcached server is different than the hashing used to determine which server to communicate with. The memcached server does the former, which only needs to ensure low hash collisions for the keys itself is storing, the client software does the latter. You couldn't have a single memcached instance that is terabytes anyway -- can you even get a machine that would take a terabyte of RAM? -- which is why you scale memcached by adding more memcached instances.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: