If 8-bit training methods take off, I think the calculus is going to change rapi...

inciampati on March 31, 2023 | parent | context | favorite | on: Could you train a ChatGPT-beating model for $85k a...

If 8-bit training methods take off, I think the calculus is going to change rapidly, with newer cards that have decent amounts of memory and 8-bit acceleration starting to become dramatically more cost and time effective than the venerable A100s.