Hacker News new | past | comments | ask | show | jobs | submit login

It’s stateful in the web demo. But they do so by prepending chat history to new requests and automatically summarizing history once the model’s context window is exceeded.



I don't think they are doing summaries actually. Just cutting off the oldest parts of the conversation.


Summarizing would make sense however.


True




Consider applying for YC's W25 batch! Applications are open till Nov 12.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: