On: New LLM optimization technique slashes memory cost...

[aziaziazi]

Does lossy means you may see previous inputs change ?!

[TkTech → aziaziazi]

Lossy doesn't necessarily imply that it is non-deterministic, just irreversible.

[lxgr → aziaziazi]

Only the model’s view, doesn’t have to be yours, just like you can participate in a long conversation without perfect memory that might in retrospect slightly differ from a recording.