Hacker News new | past | comments | ask | show | jobs | submit login

I'm planning a few encrypted long-term backups (ie. stick it in a temperature controlled safe for a few years).

What's the best medium for this? SSD or HDD?




LTO tape (specifically that which is rated for 15-30 years of archival storage) with the drive. The tape is usually rated for a couple hundred full passes, which should more than meet your needs if you're writing once and sticking them somewhere safe.

SSDs don't have this archival longevity yet, and hard drives are better when powered up and the data is always hot for scrubbing and migrating when indicators of drive failure present.


I believe it's 15-30 years for archival storage, if you regularly unspool and respool them to avoid print through.


Don't LTO tape drives cost about a zillion dollars each?


I recommend acquiring them second hand (but validated) for personal use.


SSD's are not as bad as they used to be, but still not rated for long term unpowered storage. HDD would be better for that.

But HDD isn't your only other option. How important is the data, How often will you need to access it, and will you need to rewrite to the storage medium? You might want to consider Blu Ray. Or both, stored in different locations. Also look into LTO tape drives. LTO 6 drives should be cheaper than 7/8 (though still not cheap) and have a capacity around 6TB.


>Also look into LTO tape drives. LTO 6 drives should be cheaper than 7/8 (though still not cheap) and have a capacity around 6TB.

AFAIK a post on /r/datahoarders says that the breakeven point for tapes vs shucked hard drives from a pure storage perspective is around 50TB. Given the hassle associated with dealing with tapes, it's probably only really worth it if you have 100+TB of data to store.


What do you think the availability of LTO 6 drives will be in 10 years? The major benefit of SATA, and even Bluray, is the interface and drive will likely still exist in 10 years.


I'm still able to interface with an LTO 1 tape drive. It's all SCSI or SAS. Secondary markets like Ebay have made this surprisingly affordable (used drive, unopened older media).

LTO is nice in that they mandate backwards compatibility by two revisions, which come out once every 3 years or so. So that gives you time to roll forward to new media onto a new drive without breaking the bank, and giving time for the secondary market to settle.

Adding: This was a deliberate decision by the LTO Consortium; they wanted users to perceive LTO as the safest option for data retention standards.


Given that you can buy LTO-1 (commercialized in 2000) drives and tapes today, and given the size of the market, I suspect they'll be around.


LTO 6 is like 10 years old, so the availability in 10 years will probably be limited. That being said, LTO 7 drives are able to read LTO 6 so that might increase your chances.


I can vouch for the 50TB figure, it’s around there.

The amount of hassle depends on your workflow. If you create a backup every day and then bring the media off-site, tape is easier. Easy enough to put a tape in your drive, make the backup, and eject. Tape is not sensitive to shock and you can just chuck the tapes in your care or shove them in your backpack.


> Tape is not sensitive to shock and you can just chuck the tapes in your car

Apocryphal story from university - somebody did this and reckons electro-magnetic leakage from their heated seats wrecked their info


Modern media is much more resistant to this kind of stuff.


Depends on your archival needs. Consensus seems to be that tapes have a longer unpowered shelf life. In terms of speed it really is cold storage though. You can't just bring the tape over to a user's system and copy a file. And seek times for retrieval of arbitrary files are very slow compared to HDD.

If you really need it to last and re-writability isn't an issue, M Disc claims 1,000 years.


> SSD's are not as bad as they used to be

Those extra bits they squeeze into QLC etc literally do make SSDs worse at power off retention


Why not b2 or glacier since you're encrypting anyway? If you don't have that much data then maybe M-DISC?

Personally I think safe is.. unnecessary. What is it protecting you from when your data is encrypted? If you put it in a safe then you probably care enough about the data not to have it in a single location no matter how secure it seemingly is.


> What is it protecting you from when your data is encrypted?

various forms of physical damage, including fire and accidental crushing

where do you think they ought to store their drives?

a little safe that will hold easily 100TB costs $50 and can hold your passport and such too.


Ignoring for a moment how insecure most cheap locks are (including locks on safes), little safes are rarely effective vs a prybar + carrying them away to be cut into at the attacker's leisure. Larger safes have some of the same issues w.r.t. cutting, but you can make it less convenient for an adversary to do it (and make them spend more time where they might be caught).


All true, but I think the threat model here really is fire, flooding, etc


The $50 safes are not fire-rated... and hardly break-in rated. For fire-safety you need something big, and mostly heavy, which will be costly (shipping/moving it alone)


Honeywell and First Alert sell small fire safes for around $100 that actually hold up to fire and water damage.

https://www.nytimes.com/wirecutter/reviews/best-fireproof-do...

Break-ins are not in my threat model for a document safe. If they were, I'd get a deposit box at a bank. I just want some of my personal mementos and documents to survive a fire.


Probably writable blu ray.


Check out M Disc: https://mdisc.com/


AFAIK, M Disc really only matters for DVDs due to their organic materials. (Non-LTH) BDs on the other hand have inorganic materials and last pretty well.

I think there was a French study that compared DVDs, M Discs and BDs and the HTL BDs fared very well. Can't find the document though.



I think it was a separate one.


this is the weirdest website


What about tape? I suppose the cost of the drive is prohibitive but I was under the assumption that was used for a lot of long-term storage.


I would imagine previous generation tape drives (used) can be economical. Just need to find a reliable place that handles testing / refurbishing (cleaning, alignment, belts, etc) used drives. Also the other bit item is needing the appropriate controller and cabling.


Tape drives are open about both their condition and the condition of tapes. It’s all there in the scsi log pages, more detailed than SMART on hard drives.

Mechanically and electrically, everything is rated to last several times longer than the head

In other words, you just need to buy two used drives (one as spare) and verify they can write a full tape and their head hours and other error counters are sane. There is no reasonable need to refurbish a tape drive other than a head replacement, which is easy to do at home but so expensive (for older generations) that you might as well buy a new drive. All the testing you could hope for is done in POST and by LTT/equivalent (writing a tape and reading logs is good enough)


You (more or less) just need a fiber channel card, they’re pretty mundane otherwise.


This is what I'd recommend.

1. Backup to external SSD or NAS. This is the backup you will rely on if your PC loses all data. It will be fast to replicate to.

2. Mirror the external backup to a second external SSD. And sync it every week or month. Sync more often if your data is changing a lot.

3. The third layer is an external HDD mirror for the long term off-site backups. HDD are cheaper and more suited for being switched off long term.

4. If you can afford the expense of a forth step, every year buy another external HDD and put the previous one aside as an archive to be brought into service if the current one fails to boot.

I recommend separating your data into some short of hierarchy and choose what needs to be backed up to what level. So if you have some software ISOs that you could repurchase/redownload, then have a separate drive for junk like that and don't have it go all the way through the backup steps listed above.


Figure out what you really need and print it on good paper. Put that in a safe place, away from direct light and dampness.

Save the rest on two of Google Drive, OneDrive, iCloud, some other cloud storage, a backup service or copy to a computer in your home. Make your selection based on things that you will "touch" in some way at least every 12-24 months. Everything else will fail in a few years.

Don’t save crap you don’t need. Don't futz around with optical media, tape or other nonsense. Don't buy safes or safe deposit boxes unless that's going to be part of your routine in some way.


>Don’t save crap you don’t need.

I tend to agree with this although it can be hard to determine what you won't want/need in advance and it probably takes at least some effort to winnow things down.

That said, I'm in the middle of going through my photos right now and deleting a bunch of stuff. (Which is a big job.) It's not so much for the storage space as I'll "only" be deleting a few hundred GB. But it's a lot easier to look for stuff and manage it when you don't have reams of near-identical or just lousy pics. One of my takeaways from this exercise is that I should really be better at pruning when I ingest a new batch.


It is!

I think that effort is worth it. As it stands, we've all become digital hoarders as the up-front cost to accumulate stuff like photos and documents goes to zero. The problem is you're dumping LOTS of cost into the future.

Photos are a big thing for me.

Initially, I used applications (Picasa and later iPhoto) to tag photos with metadata to indicate importance, etc. Applications tend to have zero respect for to commitment to preserving metadata. So by the time my kids are going to college, my family is going to have 200,000+ photos alone. What's the point? Am I getting pleasure (or to borrow from the Netflix organizational guru "Does it bring joy?") from this data?

Personally, my new strategy, having been burned by the tools is a pyramid:

1. Print and Frame/preserve important or significant pictures (Say 20-30/year)

2. Curate others that we care about. (Say 500/year or 5-8%)

3. Purge stuff of no value. (Say 2500/year or ~25%)

Based on my "performance" today, if I keep at it, I'll be able to reduce the rate of growth.


Tape. But that’s probably unrealistic.

Otherwise HDD.

Archiving is not a one-time thing, but a process.

If you care about the data, you should periodically check the media and at some point replace the media as they age.


How long is 'a few years'? Controlled environments shouldn't be necessary for unplugged drives, just keep them at or slightly below room temperature.

I've had three external hard drives for 7 years, and none have stopped working. I have one, and keep two somewhere else (office, family). I connect one for a few hours every week/month to update, then leave alone until needed, or rotated with one elsewhere.


I'd want to verify the existing data and maybe add some data once a year or less.


I've had the impression that just having a HDD sit around doesn't do it good and it might just fail when you replug it the next time.


I'd suggest to save the encryption software along the drive (unencrypted)!

Sounds like a good fit for SMR archive HDD.


Separately storing the encryption software isn't needed if you use LUKS.


Good quality DVD, in tyvek sleeves, with copious amounts of PAR2 data, in multiple places.


Why tyvek sleeves in particular?


It's easier to find tyvek sleeves that are sold as being suitable for archive purposes.


It'd probably be cheaper to stick it in Glacier or GC Archive ($0.0012/GB/month).


It's highly dependent on your budget and access patterns. But not SSD certainly.


I'd argue SSD here... those memory chips should be good for a few years.


A few years isn't archival quality. An HDD will last longer and is cheaper, and speed is much less of an issue for a drive that will be written to and then chucked in a safe.


The HDD lubricants are usually bad after 10 years...


I suspect helium will escape first. Then there is rubber perishing (bump stops) after ~30 years turning into liquid and sticking parts together.


Yes, HDD's should probably be considered medium-term storage. Tapes seem a little more robust, but it seems like M Disc, estimated around 1,000 years, take the crown. Unfortunately 100GB is the limit, so very large files will be difficult.


Not all drives are helium-filled, and theoretically helium just reduces power usage.

Your lubricant drying out will be the biggest threat in my eye as your startup after 10 years may cause a lot of damage on the mechanical bits.


How long is a few years? What would be a good recommendation for decades? Time goes fast!


More like 1 year at best

Modern SSDs not only sacrifice endurance and sustained performance, they also sacrifice power off data retention




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: