Hacker News new | past | comments | ask | show | jobs | submit login

Money? Time? Uploading hundreds of gigabytes of a dataset?



Cost for AWS GPU instances is not that high (relative to purchasing a GPU).

The amount of time to transfer hundreds of gigabytes will be dwarfed by the time savings from using GPU compute.

Was there a concrete reason you didn't go that route?


> The amount of time to transfer hundreds of gigabytes will be dwarfed by the time savings from using GPU compute.

For me, it wasn’t about time savings – I had a limited timeframe, and wanted to get the models as accurate as possible within the time.

Transferring the data would have taken longer than the time I had to run the training, and I while the model would have been a lot more accurate, this wasn’t too important for my paper.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: