Hacker News new | past | comments | ask | show | jobs | submit login

NVlink + two 3090 gives 48GB relatively easy (appears as unified memory). I only skimmed the article briefly, was it considered?



NVlink does not appear as unified memory. But NVlink + two 3090 does work great with FSDP/QLoRA (I have just such a machine at home!)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: