Hacker News new | past | comments | ask | show | jobs | submit login

Actually, it's not exactly exposing the partition underneath. The ordering key is the only unit a user has to deal with: think user ID or database row primary key. Throughput is limited to 1MB/s per ordering key, but the number of ordering keys is limited only by what can be represented in a 1KB string. One can have millions of keys if desired and they don't need to be known in advance.

The system scales automatically as needed, so there is no need to think in terms of partitions or worry about repartitioning when load increases. Order is preserved through this scaling without the user having to do anything.

Disclaimer: I work on Cloud Pub/Sub and am the primary engineer on the ordering feature.




It's hashing the ordering key to map to a partition right?

That's what I meant, access to ordering via partitions but without the full addressing of named partitions like Kafka.


There is a mapping from ordering key to internal storage structures, yes. The goal is that users are abstracted away from any notion of partition and the system handles scaling and ordering on its own, e.g., when there are hot shards.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: