On: GPT-4o

[disconcision]

why does this imply theyve moved beyond next token? is it a throughput issue?

[valine → disconcision]

I assume so, you can’t really tokenize audio, at least not high fidelity audio. Audio models like Bark don’t output logits from what I understand. For true multimodal output you’d need a model that can output both logits and audio embeddings.