This is so neat. I been wanting to build something for HN and can't believe I didn't think of this. It was also cool too hear the update with a mention of HN Update as well considering it's treanding! :)
OP's cofounder here. Yes, we started with what we perceived as highest quality (OpenAI embeddings + Claude autocompletions), but will definitely make our way to local/OSS. The code is super modular so hopefully the community will help as well.