Hacker News new | past | comments | ask | show | jobs | submit login

Hi this is a very cool project, and I love that it's geared towards self-hosting. I'm about inherit some hardware so I'm actually looking at clustered network storage options right now.

In my setup, I don't care about redundancy. I much prefer to maximize storage capacity. Can Garage be configured without replication?

If not, maybe someone else can point me in the right direction. Something like a glusterfs distributed volume. At first glance, SeaweedFS has a "no replication" option, but their docs make it seem like they're geared towards handling billions of tiny files. I have about 24TB of 1Gb to 20GB files.




You probably want at least some redundancy otherwise you're at risk of losing data as soon as a single one of your hard drive fails. However if you're interested in maximizing capacity, you probably need erasure coding, which Garage does not provide. Gluster, Ceph and Minio might all be good candidates for your use case. Or if you have the possibility of putting all your drives in a single box, just do that and make a ZFS pool.


> You probably want at least some redundancy otherwise you're at risk of losing data as soon as a single one of your hard drive fails.

If by "fails" you mean the network connection drops out. Then yes, that would be a huge problem. I was hoping some project had a built-in solution to this. Currently, I'm using MergerFS to effectively create 1 disk out of 3 external USB drives and it handles accidental drive disconnects with no problems (I can't gush enough over how great mergerfs is).

But, if by "fails" you mean actual hardware failure. Then, I don't really care. I keep 1 to 1 backups. A few days of downtime to restore the data isn't a big deal; this is just my home network.

> Or if you have the possibility of putting all your drives in a single box...

Unfortunately, I've maxed out the drive bays on my TS140 server. Buying new, larger drives to replace existing drives seems wasteful. Also, I've just been gifted another TS140, which is a good platform to start building another file server.

You've given me something to think about, thanks. I appreciate you taking the time to respond!


MooseFS is designed for large files and can have a global goal of 1 copy (no replication)

https://moosefs.com/


Thanks! I skipped over this one but looked at LizardFS, which was forked from Moose in 2013. The comments I found online about lizard weren't too great. I'll give moose a look. 2013 was a long time ago.


useful:

Reviews of distributed filesystems https://web.archive.org/web/20210120160555/http://www.regres...

edit: add article title




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: