I think this could be fake. He says it’s an MoE model, but then explains that it... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

donkeyboy on June 21, 2023 | parent | context | favorite | on: GPT4 is 8 x 220B params = 1.7T params

I think this could be fake. He says it’s an MoE model, but then explains that it’s actually a blended ensemble. Anyone else have thoughts on that?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact