Honestly just loading all vectors in-memory (and stuff like sqlite, pgvector) is totally fine when you're dealing with O(100k) vectors, but beyond that all the workable options like pinecone get gnarly, slow, and ridiculously expensive.
The best option by far I know of is turbopuffer.com , which is like 100x cheaper than pinecone and seems to actually scale.
Since it's not listed in the suggested vector dbs section of the slides, wanted to lob it in as a solid suggestion :)
Sort of off topic, but for diagrams like the author seems to want (well, maybe a little lower fidelity, but good enough for any software system mapping I do), I love using Kinopio (kinopio.club)
Does anyone have a good idea of when OPFS will be broadly available in all major browsers? And what's best to use as a pseudo-polyfill in the mean time?
Something relevant is absurd-sql, but unfortunately that's not even close to production ready :/
Hey! Totally understand this concern with the browser extension. I mentioned this in another comment, but there was no way to build the full functionality without these permissions, though we do hope to make a lighter version of the extension in the future for more privacy-conscious folks.
However, completely understand the request, and we do value privacy/security super highly. All extension data stays local on your device unless you actively press the extension button to save a page/content. You'd have to read our source code and network requests to confirm this right now, of course.
Another commenter also mentioned, we do indeed have a super light bookmarklet that can serve this purpose in the mean time as well
Unfortunately, there was no way to make the _full_ extension work with only activeTab, as we have some functionality that is incompatible (one such example: if you open up a page you've previously saved and highlighted in Reader, we show your highlights overlaid on it seamlessly).
That being said, we do want to make another version of the extension that works for more privacy conscious folks, and will defs use activeTab for that! Just requires a little more engineering effort.
I totally understand the request though, privacy is super important. All extension data stays local on your device unless you actively press the extension button to save a page/content. You'd have to read our source code and network requests to confirm this right now, of course.
Thanks! Yeah, part of the motivation for Reader was that our original readwise app was integrated with a bunch of these apps like Pocket and Instapaper... and we saw them completely fall by the wayside.
Our users were constantly asking us to fix things with Pocket/Instapaper that were out of our control, so they kind of pulled this app out of us :)
1. Yes, absolutely. Ex-Pocket users are some of the most common folks using Reader right now.
2. We don't really have a bookmark import yet... we strangely haven't really had enough requests (yet) to build it, but not against it!
3. You can always export all of your saved links+metadata to a CSV file, and all your highlights/notes to markdown (as well as various note-taking app integrations we have). We also have a nascent api which right now only lets you export your highlights/notes, but will be adding support for all of your links and such as well!
Heyo! Yeah, our parser doesn't work great with HN threads (yet! i'd love to get it working...)
But in the mean time the Reader browser extension also acts as a web highlighter. So after activating it, you can highlight any text directly on the web page, and then add tags/notes to those as well. Those highlights will sync back into Reader.
The best option by far I know of is turbopuffer.com , which is like 100x cheaper than pinecone and seems to actually scale.
Since it's not listed in the suggested vector dbs section of the slides, wanted to lob it in as a solid suggestion :)