I have an AI chemistry project that appears to work on my test data, but I had to put it on the backburner because I simply can't (couldn't) find a 3070/80 anywhere! I stopped looking 6 months ago, does anybody know a reliable place where I can snag one?
If you don't mind having a gaming PC (stupid RGB lights and fans) then Build Redux [1] is not price gouging. You can basically just think of the GPU markup as a builder fee. They are incredibly slow to ship but the lead time is something like a month which beats your 6 months. At this point, it would take bitcoin dropping below 10k for the market not to be silly.
You know what, this might actually be the guy. Good tip. It's a bummer to pay for a Windows license I don't want, but the fee for that is less than the markup I'd pay to some scalper just to get the card.
I wonder why you've not teamed up with some uni-lab, they usually have some hardware and also some free labor if you share credits. A single GPU also means, whatever your idea, it probably would have finished already on a CPU ;).
If you're willing to pay scalper prices, there's a relatively consistent availability. If you're looking for closer to MSRP, they're in short supply and your choices are either waiting lists or racing other people for online restocks. I got a 3080 a month ago only after waiting on EVGA's wait list for just over a year.
Why do you need a 3070/3080 specifically? If it's to run something like Tensorflow or CUDA code more generally, could you do it with an older card, or the more available 3060s?
This is a little disingenuous, that is like saying scarcity doesn't exist since you can buy almost anything at any price. There is always an implied "in a reasonable budget".
Yeah, I guess I could go down that route, I've used the AWS Gx instances for projects before, but this dataset would justttt fit in memory for a 3080, which really simplified the rest of the code, and the speed of iteration, and, at the end of the day, quite frankly I just want one. I'll do more weird stuff if I don't have the meter of how much I'm paying to Jeff Bezos running in my head every time I run an experiment.
The price is great, the downside is that you do not know whether the server owner reads your data. The "jobs" run in a Docker container on somebody's machine.
