I agree if this trend continues even inferior local models are going to have value just because the public apis are so limited.
> Conspiracy shenanigans aside, I've decided to cancel my "premium" membership and am exploring open/DIY models.
The crazy thing is that this is an application that really benefits from being in the cloud because the high vram gpus are so expensive that it makes sense to batch requests from many users to maximize utilization.
> Conspiracy shenanigans aside, I've decided to cancel my "premium" membership and am exploring open/DIY models.
The crazy thing is that this is an application that really benefits from being in the cloud because the high vram gpus are so expensive that it makes sense to batch requests from many users to maximize utilization.