Hacker News new | past | comments | ask | show | jobs | submit login

Can Reflection:70b work on them?



Pretty sure it'll work where any 70b model would, but it's probably not noticably better than Llama 3.1 70b if the reports I'm reading now are correct.[1]

[1]https://x.com/JJitsev/status/1832758733866222011


Maybe you meant to reply to a different comment? Work on what?

Edit: I guess to directly answer your question, I don’t see why you couldn’t run a 70b model at full quality on either a M2 192GB machine or on an 8x 3090 setup.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: