Looks like this is similar to GitHub Copilot Chat [0], just open source right? I like that you're supporting open models as well rather than just ChatGPT. Is there a way for your extension to read the file you're in as input before you ask any questions, so that it has the context of what you want to do?
Right now we are similar, but the open-source part is really key. We think that the ability to write custom plugins will make for a completely different kind of product.
And yes, by default Continue sees your open file, but you can also highlight multiple code snippets or type '@' to include context from outside your codebase, like GitHub issues.
I've been using Copilot and Copilot chat for a while now, and I really struggle to see why I should use any of these ChatGPT wrappers over it. I know some support local inference with open models, but they're just not that good in July 2023.
Sure, it's M$, sure it's not open source (IIRC), but all you get with these alternatives is a wrapper around the ChatGPT API, or in some cases a lesser model. No one's solved the whole directory context problem yet, no one seems to be doing much the Copilot suite can't.
Copilot is currently reasonably priced, and pretty much guaranteed support and development going forward. There's pull requests and cli in the pipeline [0].
I'd need directory context inference on a quality open model to be convinced to use anything else, and we're just not there yet.
I use both Copilot and ChatGPT, they're entirely different things. Copilot works best for one line autocomplete, ChatGPT works for writing entire functions, if needed. This is to be expected as Copilot currently uses a much older LLM, and it is due to be upgraded to GPT 4 soon.
[0] https://github.blog/2023-07-20-github-copilot-chat-beta-now-...