On: Replit's new Code LLM: Open Source, 77% smaller th...

[fswd]

I can barely keep up with this stuff, but quick question. Is there a way to simply change the URL setting of copilot to point to this model? Obviously it needs an endpoint, I could hack something up, but asking if somebody has already done this? Would be nice to cancel my copilot.

[execveat → fswd]

It's nowhere close to Codex/Copilot. Try the demo: https://huggingface.co/spaces/replit/replit-code-v1-3b-demo

[tarruda → execveat]

So they are lying on this tweet? https://twitter.com/Replit/status/1651344186715803648

[sanxiyn → tarruda]

They are probably not lying, but good performance on benchmarks does not imply good performance on your use cases.

[naillo → tarruda]

Yep

[circuit10 → fswd]

There's https://github.com/fauxpilot/fauxpilot but it doesn't use this model

[jacobrussell → fswd]

I don't think it's possible to point Copilot to other models. I don't think Microsoft would benefit much from that feature. You could use existing tools [0] to host your own model which in theory could be used by an extension your IDE uses. But I'm not sure if an extension like that exists.

[0] https://github.com/oobabooga/text-generation-webui

[circuit10 → jacobrussell]

Of course it's possible, just not officially

See https://github.com/fauxpilot/fauxpilot/blob/main/documentati...