Hacker News new | past | comments | ask | show | jobs | submit login
Permanent.org – Nonprofit, secure cloud storage (permanent.org)
353 points by c1c2c3 on April 22, 2020 | hide | past | favorite | 211 comments



Some feedback: it's really unclear what your mission is. Your "what we do" section does not illuminate what you do:

> This is our mission – to preserve and provide perpetual access to the digital legacy of all people for the historical and educational benefit of future generations.

Okay, if that's your mission, how does "secure cloud" come into that? How will future generations benefit from my data if it's secure? Do "future generations" include the present NSA and advertisers? What's your actual use case?

There are a lot of ways this could be good or bad, and without some clarity people are going to (perhaps correctly) assume the worst (as is evident in this thread).


You're defining "secure" as meaning "confidential," which is understandable though not entirely accurate. At its simplest and most abstract, information security also includes integrity and availability. I'm oversimplifying it, but hopefully you see where I'm getting at.

integrity i.e. ensuring that data received, changed, and removed is exactly as expected and accurate per the requirements for the data over the lifecycle of the data.

availability i.e. ensuring that the data is accessible/usable for the use cases intended.

That said, confidentiality could also be relevant for a system of truth such as this one. There may well be certain data elements that one might want to restrict e.g. only to people who share genetic history with an ancestor. (as an example)

---

https://en.wikipedia.org/wiki/Information_security#Key_conce...

if it helps.

---

edit2: security (confidentiality) in permanent.org elaborated: https://www.permanent.org/digital-archives/services/privacy-...


Confidentiality is most of what people are thinking about when they consider the security of cloud storage systems.


Admittedly they've done a poor job talking about it on their front page.

But for what its worth, they talk about security of data in accessible (albeit lacking) lay terms here: https://www.permanent.org/digital-archives/services/privacy-...

Not known to me yet is whether these claims have been validated.


Well, that's just a bunch of bullshit. Your everyday IT user (including me who has worked in the business for a LONG time) doesn't see that difference. No one cares if it's semantically correct when most people think it means something completely different.

My take: As long as they're not crystal clear with what they mean by that, I don't trust them. And to be honest, even then I probably wouldn't trust them with some confidential data. The very first step would be to open up about each point OP mentioned in his post, and we can go from there.


> Well, that's just a bunch of bullshit. Your everyday IT user (including me who has worked in the business for a LONG time) doesn't see that difference.

Regrettably, you're right. That's why we're employed.


Sometimes I really don't wish that were the reason. Sometimes I feel like the money isn't worth it. But then I get my head out of my ass, because really, what else would I do that pays well? But I reserve the right to gripe about users now and then, keeps me sane. :)


> You're defining "secure" as meaning "confidential," which is understandable though not entirely accurate.

I'm not defining it, if you re-read my post you'll see that I'm asking how they define it.


They chose a 1-time payment model (which funds an interest-generating endowment), which seems a lot weirder than a subscription.

This actually makes sense -- if the goal is long-term set-it-and-forget-it, it solves the problem of getting a new credit card every few years & forgetting to change this service. It also eliminates any recurring payment-processing fees.

The back-of-the-napkin math checks out: accounting for storage, data-transfer, and business overhead, if they pay around $0.20 / GB / year, and they charge $10, then with 0 interest they would still have your files for 50 years, which is probably longer than your children will have your password to this service.

I still wouldn't trust it -- I have a pavlovian response to the combination of "permanence" and "give all your data to this new internet service". Maybe it's irrational here, but still, this product is at the wrong layer of abstraction for me personally :)


Flip the script in a different way:

How many people have their Geocities site pulled from them?

I think this foundation's mission is great. I'm not expecting things to be "permanent". I already know that there is no such thing as anything that is permanent, including our lives and our health. If there is no such thing as absolute permanence in anything, then I can throw that idea out and look at the rest of what they are offering. To me, it is irrational to think that just because someone _doesn't_ say their stuff is "permanent" doesn't mean you can trust them as well.

What I see in this foundation is something that supports the internet that is not controlled by Big Tech. I think about my children and where we are going in our society, and I think that is something that I value. I valued it enough to have already pledged a donation for the price of two latte.


Geocities never claimed to be permanent


It's indeed better than that: storage costs decrease over time (probably at an exponential rate), which means that, in theory, you can pay upfront to have your data stored until the end of time (or our civilization). Well, at least if they can protect the money from inflation. (I've played with the numbers a few years ago when I got upset that my bank won't preserve my records nor my statements, at least in an accessible form, for more than 6 months.)


Hmm, if it supports static web hosting this might be a good way to make my blog permanent...

Yes, nothing is forever, but with some luck this could live as long as our civilization..

Assuming some interest on the endowment is one way this could work out, falling costs of cloud storage is another.

Who knows what S3 prices will look like in 50 years?


I'm curious as to what pavlovian means here


I think the idea is to convey that just like a bell has no natural link to food anticipation of which causes salivation, the fact that x has always (at least as far as we remember) come with y which causes z means when we see x, we fear z will happen even though x and y need not necessarily have to come together?

I believe there are people who won’t forgive text drive / Joyent for their dishonesty and sincerely we must never trust the leadership at Joyent with anything as long as they roam the earth.

https://www.chargebee.com/blog/lifetime-plans-its-time-rethi...


Pavlovian conditioning [0]: "a learning procedure in which a biologically potent stimulus (e.g. food) is paired with a previously neutral stimulus (e.g. a bell)."

In my case:

food: losing all my data (or it becoming incredibly difficult to access / control / afford)

bell: uploading all of my data to a new internet product.

----

Most companies have unsustainable business models (grow forever).

For startups, this is especially true (rapid growth forever).

This is a new internet company, but their whole shtick is that they have a sustainable business model. Given that data, maybe my bias is unfair.

[0] https://en.wikipedia.org/wiki/Classical_conditioning


https://www.simplypsychology.org/pavlov.html

The concept of (consumer-grade?) permanent data storage triggers some response from him.


They mean they've been conditioned to question or be suspicious of such a claim, likely through past experience.


This combination of "Nonprofit" and "Permanent" is an oxymoron. And the fact that the people who run this operation don't realize this means this initiative is doomed.

These people use museum endowment as an analogy, but especially judging from that analogy I don't think they have any idea how this thing works. Storing someone else's data forever is completely different from how museum is run. The analogy is so ridiculous that it's not even funny.

Where this analogy may apply is sites like Waybackmachine, because they're at least doing it for the greater good. But I'm pretty sure these guys will throw away some random guy's private file archive the moment they run out of money.

Normally I'm all for silly experiments that come from ignorance, and I'm fine with various consumer startups that come and go along with their user data, because sometimes this ignorance leads to success. But in this case these people are playing with someone else's data AND asking for money, and claiming to store these forever in my view is no different from a scam artist. Intentional or not, this to me is no different from a scam.

I would say the companies who are at least honest about exploiting our data such as Google and Facebook are more ethical.


In today’s world though Google or FB decommissioning that product segment is just as likely. Just because it is Google doesn’t mean they will spend every last penny to keep it running. Once it stop becoming profitable, you better figure out what to do with your data. Hopefully one still has the primary local copy and not wondering how to do bulk download

Apart from that I agree this non-profit competition should only be used to kill industries that charge an exorbitant amount for there services. At least many of the popular cloud storage companies are as “non-outrageous-profit” as it gets. They make money from efficiency/dedup or other management efficiency


Yes, i am just pointing out a simple thing here. At least Google is not lying. They don't claim they will "permanently" store private data forever for free. These guys are. And while doing so, using companies like Google as the devil in order to present themselves as the savior.

It's almost like a conman claiming to have invented a perpetual motion machine and asking people for money, and furthermore, going around criticizing all the other people who build and sell normal machines are the bad guys for selling inferior products.


> They don't claim they will "permanently" store private data forever for free. These guys are.

No, they're not. They're claiming they will permanently store private data for a one-time fee.


Yes you're right. In fact the fact that they are asking for you money is what ticks me off the most.

Let me put it this way instead. They are essentially saying they will pay for the hosting and data access usage and networking costs forever, and you can enjoy all these things for free forever, if you "only" pay an upfront cost. And that's a lie. There's no such thing as forever, especially if it's run by beings that won't be around forever. The scammy people behind this initiative will all die in hundred years. Without an economically viable model, it will all go.

In my eyes, what they are doing is essentially trying to make it big with a one time splash, and don't care what happens next. No different from all the scammy blockchain ICOs that promise "forever immutable storage".


So it's a ponzi scheme for cloud storage dependent on people continuing to pay to store new items in order for them to pay for their current costs.

Although the idea is to create a fund and operate off the interest. Let's look at their prices.

$1000 for 100 Gigabytes or $100 for 10 Gigabytes. Basically it's $10/GB. With like a very safe dividend allocation they can probably get a 2% annual return on their investments, which means they need to only spend $0.20/year on my 1GB of data.

They say their plan is perfect for phone or hard drive backups, and they offer continuous file migration. Let's say I completely replace the contents of my GB every 3 months. We can't use AWS S3 One-zone because they advertise "Redudant backup".

S3 Standard Infrequent access is $0.0125 per GB per month, so that's $0.15/year/GB. Maybe they can use AWS S3 Glacier although I'm not exactly sure how it'd work with the continuous migrations. That would be $0.048/year/GB which is a lot more feasible. Data ingress into AWS is free, but egress isn't. If we download our GB 4 times per year that's $0.04 in egress. There's also some costs for PUT, COPY, POST, LIST, GET, SELECT requests, so let's say that for our 1 GB it'll amount to $0.01 per year.

That means it'll cost us $0.098/year/GB for our storage service that we can only download from 4 times/year and does not give us millisecond-access to our data.

I'm sure they can find a storage solution that's cheaper than using AWS S3 Standard Infrequent Access so they still have a good response time for data, but overall it seems feasible.


if these people actually cared about people owning their own data, they would have released a toolkit or an application that lets each individual do what you've just described. Instead of asking for money.


This is a somewhat ridiculous position. If I hope to preserve data for my children, I'm not going to hand them a box with jerry-rigged software and hardware that they then have to maintain. I want someone to maintain that for them.

If I'm looking for my blog, or my tweets, or a set of family photos and videos to live on forever, I absolutely want them under control of a foundation that outlives me and my relatives interest in maintaining that data.


So you just made the claim this is essentially a scam and the people don't know what they are doing (considering the people on the board that's quite a rich claim). JCharante just showed with a back of the envelope calculation that it seems feasible.

Why don't you refute the argument and tell us why it isn't? You made some pretty bold claims, so I would be nice if you can back them up.


>>> There's no such thing as forever, especially if it's run by beings that won't be around forever. The scammy people behind this initiative will all die in hundred years.

> if these people actually cared about people owning their own data, they would have released a toolkit or an application that lets each individual do what you've just described. Instead of asking for money.

The only way human beings can successfully store data (especially symbolic/digital data) for long terms is by creating institutions to maintain it.

Even granite tablet buried in a cave for 10,000 years will require a continuous series of institutions maintain the knowledge to successfully interpret it, otherwise you'll just end up with something like Linear A.


> they would have released a toolkit or an application that lets each individual do what you've just described

Where is this individual going to store their data? On the unreliable hard drive on their personal computer, which they never back up?

A toolkit or an application isn't hardware. Solving the problem of reliable long-term data storage requires hardware. Hardware costs money. Basically this service is competing with my ISP, my hosting company, etc. to be a long-term data storage provider.


I don't know whether they will be around forever, but if we assume they're not trying to scam people, the math can be done. How much does storage amount X cost per year (=$Y), how much money would you need to continuously generate $Y per year? The one-time fee you'd need is $Y.

Whether their math is sound, I have no idea. Whether it's a good idea I don't know either. I don't need "permanent" storage as in "for ever and ever and ever". But that's not necessarily a scam.


I think people all seek a permanent legacy of some sort. I don't think our digital junk really fits. There are IRL costs to hoarding junk; I'm really not sure any benefits - of keeping _all_ someone's digital miscellany - justify those costs?


> I think people all seek a permanent legacy of some sort. I don't think our digital junk really fits. There are IRL costs to hoarding junk; I'm really not sure any benefits - of keeping _all_ someone's digital miscellany - justify those costs?

I think with a lot of things there's a J shaped value curve. Over long periods of time, things of small value (including literal garbage) become historical and archeological treasure.

Also this doesn't seems like it's really mean to be storage for random "junk":

> Permanent.org isn't just another digital box or drive. It's a digital archive.

> Upload your most important digital materials to your archive and customize the archive profile to represent you. Create multiple archives for other people and organizations. Then establish relationships to share materials between them and create everlasting connections. Collaborate with your community by adding members to any archive to curate a shared history.

That implies there's a certain level of curation that's supposed to go into the archive, so more diaries and important records than your "Downloads" folder.


> I think with a lot of things there's a J shaped value curve. Over long periods of time, things of small value (including literal garbage) become historical and archeological treasure.

Isn't that mostly because of it becoming a rare insight into a time that is long gone? With perfect preservation, would literal scraps of garbage from 10k years ago be individually interesting?


And keep in mind the cost per Gigabyte stored is going to decrease over time.


The math will work out, sure..

The question is if you can trust this non-profit?

Maybe if other credible non-profits were backing it.


Their governing board includes Brewster Kahle (Internet Archive), Mark Surman (Mozilla Foundation), Stephan Wolfram (Wolfram Alpha), and Paul Vixie (Internet Systems Consortium).


they offered me a gigabyte for free


> These people use museum endowment as an analogy, but especially judging from that analogy I don't think they have any idea how this thing works. Storing someone else's data forever is completely different from how museum is run. The analogy is so ridiculous that it's not even funny.

OK, enlighten me. Because to me (an admittedly financial layperson) it makes sense. I give them a one-time payment, they put it in the bank with lots of others' payments and live off the interest. I don't see where the problem lies.

And yeah, I'm sure they will close down the minute they run out of money. That's no different than a for-profit doing the same as soon as it stops being profitable. To me though, this is way easier to understand how it could be around forever unlike the for-profit boys which have a totally different goal.


I give them one time payment, store a gigabyte of video, and share with millions of people. People keep watching and using up all the network costs and hosting costs. How are these guys going to keep going "permanently"?


Okay, your previous post was pretty unclear, but given this explanation, I'm giving you a rare (for me) downvote. You're speaking way too confidently about things that are definitely more ambiguous than you're letting on. It's important to be right, especially when you're crapping on other people's work.

I've also posted some skepticism about what they're doing, but the difference is that I'm asking questions rather than making assumptions.


It says storage, not streaming. I think you're making an unsupported assumption about the nature of the service being offered.


I don't think that is the service they are offering. It simply says storage. The only sharing mentioned is sharing with other user's archives.... not public access.

But regardless, we have no idea what backend they are using. Hell, I can go to S3 right now, put a gig out there, and a million hits only cost me pennies. And in theory, that cost will only continue to shrink.


It looks like some kind of sharing is part of the offer: https://www.permanent.org/digital-archives/services/exclusiv...

I would like to see more details on this. Bandwidth-limited sharing would still be economically feasible up to a point.

If they have run the numbers and are careful to leave a generous safety margin, I can see this working out. Eventually it will fail, as everything does, but it could last a very long time before that happens.

One more thought: if they are successful, they may accumulate a substantial endowment, at which point the primary risk is capture of that endowment by unethical board members. They have a good board right now, but will that always be the case? Time will tell.


We're making a lot of assumptions about a service that should probably be making things a lot more clear before they start taking money. My assumption is that "sharing" means sharing with family, etc. as opposed to publishing.


*> My assumption is that "sharing" means sharing with family, etc. as opposed to publishing.

You don't have to make any assumptions. It's right there on the web page that was linked to:

"You choose what files or folders you want to share, who you want to share them with and what level of access that Archive should have."


> Hell, I can go to S3 right now, put a gig out there, and a million hits only cost me pennies.

A million hits on a 1 gig file would cost you $50,000.


Traffic is as close to free as it's going to get. Sure, AWS/GCP/Azure charge a lot as a lock-in strategy, but for example DigitalOcean charges $5/TB, while Hetzner and OVH don't charge for traffic for dedicated servers at all.


They don't mention anything about hosting or streaming your data - just storing it. I assume the backend will be something similar to glacier or just slow, cold storage.

Why are you making things up at this point?


> Intentional or not, this to me is no different from a scam.

You don't get to redefine a word and then claim it fits the definition. Scam is intentional deception, which is most certainly not what's happenning here.


"I would say the companies who are at least honest about exploiting our data such as Google and Facebook are more ethical."

Luckily, those are not your only two choices - there are cloud storage providers that are simultaneously privacy minded[1], technically sophisticated[2], and honest about their business practices[3].

[1] https://www.rsync.net/resources/notices/canary.txt

[2] https://www.rsync.net/resources/howto/remote_commands.html

[3] https://www.rsync.net/resources/regulatory/pci.html


I understand permanence is hard to achieve, but why do you claim it correlates with for-profit as opposed to nonprofit motivations?

A subjective look at the world suggests that institutions which have preserved artifacts (including digital artifacts) over a long time scale have been likelier to be non-profit than for-profit.


> This combination of "Nonprofit" and "Permanent" is an oxymoron.

"Non profit" has nothing to do with it. Thinking any service is permanent is pretty naive.


Not the original commenter but I agree that no service is permanent. That's why any service marketing themselves as such raises an eyebrow from me.


The word permanent itself is very relative. It always is. Because in the end, nothing is permanent. It just depends on your requirement of permanence.


Nope. Non profit doesn't mean they do it for free. It means that the goal of the organization is not making profit. They'll still pay their employees and they'll still charge for their service (even if they'll call it a tax-deductible donation). At least this is my understanding.


> This combination of "Nonprofit" and "Permanent" is an oxymoron.

Nonprofit mainly means that they're not a company beholden to shareholders, and that they can't be sold or acquired.


What has a profit motive to do with permanent? Why (provided it doesn't work) would it it work it if it was for profit, but not if it wasn't?

It seems you have some political beef with this being a non-profit.


in your opinion, is archive.org permanent? and less ethical than Google or Facebook?


archive.org is a different beast because it deals with publicly available data. This is why the museum endowment analogy may make more sense with archive.org. There will always be people who want to help the "greater good".

But when it comes to private data hosting, for each repository there is exactly one person who wants it to stay alive.

Lastly, archive.org never started out asking people for money promising something the impossible. These guys will hide behind the word "promise" when they want to exit scam or just give up after a couple of months after taking people's money. "Hey we only gave you a promise, we never said we will guarantee and even pay back money if we can't keep the promise", this is what they will say.


You know that the founder of the Internet Archive is on the governing board for the Permanent.org foundation right?


Lol. Read his post history today - he certainly did not know that. He has been firing from the hip left and right making shit up to trash this organization.


tell me, what does that have to do with my argument? nothing changes at all. and all you're doing is making a logical fallacy appealing to authority.


So Backblaze B2 costs $0.005/GB per month for storage. Let's see what are my options here, I could prepay 166 years at an unknown company with an unclear record of operations (I see the governing board is full of rather famous people but still -- that's not ops) and financials. Or I could just keep going with a company which has proven over 13 years it is solid both ops and financials wise.


If you don't need to have your data in the cloud, there's also the option of just buying the drives, backing up your data and then putting them in a box, no need to keep them spinning unless you need frequent access to said data.

B2 is $0.06/GB/year, while a regular HDD would cost ~$0.03/GB/drive-lifespan.


Hard drives should not be left unattended for even a few years with any expectation that they will still function when plugged back in. Sure, many will, but it's a crap shoot: Under ideal conditions an unused hard drive can be expected to retain data for 9 to 20 years. [0]

[0] https://blog.macsales.com/43702-we-bet-you-didnt-know-that-y...


I really wish this blog would have listed some sources for all these statements.


Well yes but I heard that b4. You should just put on your calendar to plug them in (and update the backup) once in a while. I do not think it is about mechanical robustness. It is about the way the data is stored with magnetic tech, it think HDDs should be operated every once in a while to have a better chance of not loosing the data. But 9 days sounds awfully short.


I found the approximate time frame in a few places, but never with any primary source. I also came across the claim that hard drives used to be more mechanically robust, and perhaps failed less often for such reasons. Again, I couldn't source it though.


Well, yeah, the idea of individual drives is great, but in practice I've had a lot of drives die.


This was mostly a cost comparison I wanted to show, as the solutions of rolling your own set up at home vs a cloud set up are definitely very different.

At 10TB, you're paying $600/year on B2, a price at which you could outright buy two 10TB drives and stick them in a larger NAS setup with ZFS or a simpler RAID-1 array.


That's reasonable. Alternatively, I'm using Arq[0] (locally encrypted before upload, uploads to tons of different services, I'm using AWS S3 and Google Storage) so I'm paying ~$7/month for about 40G stored. And I don't have to worry about local drives dying or being stolen. Just another option.

[0] https://www.arqbackup.com


> locally encrypted before upload, uploads to tons of different services

https://www.duplicati.com does that for free being open-source thing, all platforms supported.


Don't forget B2 involves putting that data onto multiple hard-drives and ensuring it isn't lost. What if that single disk were to be lost? You're paying Backblaze to ensure that GB can be accessed in the future


> What if that single disk were to be lost?

This was a cost analysis, mostly for those that can't afford B2. You can buy two drives for the cost of a year at Backblaze and have N+1 redundancy.

> You're paying Backblaze to ensure that GB can be accessed in the future

No doubt, which is why I prefaced this with "If you don't need to have your data in the cloud".


Having tried to keep "permanent" backups of my personal digital data for 35+ years, I should point out that one should not underestimate the problem of technological change.

The "device" you use today will, in all probability, not be usable after a number of years, no matter whether you spin it up regularly and maintain it in a working condition.

I have backups in countless floppies, diskettes, Zip drives, 9-track, QIC, DAT, SCSI, ...


B2 costs more than that, unless you never download anything. (Not taking into account exploits like utilizing Bandwidth Alliance and Cloudfare free tier to get free egress.)


How is that exploiting anything, they encourage it.


It's against the Cloudflare ToS:

> The Service is offered primarily as a platform to cache and serve web pages and websites. Unless explicitly included as a part of a Paid Service purchased by you, you agree to use the Service solely for the purpose of serving web pages as viewed through a web browser or other functionally equivalent applications and rendering Hypertext Markup Language (HTML) or other functional equivalents. Use of the Service for serving video (unless purchased separately as a Paid Service) or a disproportionate percentage of pictures, audio files, or other non-HTML content, is prohibited.


It’s okay at least for serving images (as long as you use workers): https://news.ycombinator.com/item?id=20791660 from CloudFlare CEO. It’s not clear to me if piping terabytes over terabytes of, say, opaque data would violate anything.

This is a clever exploit none the less (not a pejorative).


> then putting them ["a regular HDD"] in a box, no need to keep them spinning

Are you sure about that? I'm no expert, but I thought it was advisable to power up spinning platter disks at least every so often, once a year say?

And where are you keeping this backup, same box?


> but I thought it was advisable to power up spinning platter disks at least every so often, once a year say?

Is there a specific reason why you would need to do that? I'm not really aware of any.

> And where are you keeping this backup, same box?

This is ultimately up to you, depending on what kind of redundancy you deem necessary and whether you have multiple physical locations where you could store the said drives.


These days, hard drives probably scrub themselves periodically, looking for and rewriting sectors with high error correction error rates.

SSD’s definitely do this.

Even if hard disks don’t do this, mean time to repair is a crucial parameter in raid durability calculations. If you spin the drives up once a year, the mean time to repair is 6 months. Most raid systems are likely to lose data if it takes more than a few days to repair.


The ball bearings have lubricant that can shift over time due to gravity. And the metal parts might weld to each other over time if they are not moved.


How likely are these things to actually happen?


I think the welding takes more than a year. The lubricant settling probably depends on the quality of the drive and the ambient temperature. And I guess the ball bearings would be pretty tolerant (since you only have to move them a little to get the lubricant on them again), it's more likely that the heads would stick.

https://en.wikipedia.org/wiki/Stiction#Hard_disk_drives


Not to mention you could have a fund that pays the backblaze bill and as that monthly price dwindles over time the interest on your money would pay it in perpetuity.

If something like permanent.org is setup intelligently they can even have a plan for a backblaze demise (god forbid) and use the fund to migrate to another provider(s) in that case.


> Not to mention you could have a fund that pays the backblaze bill and as that monthly price dwindles over time the interest on your money would pay it in perpetuity.

Assuming we're talking about storage in perpetuity without the need for maintenance, the fund would need someone trusted to administer it.

I personally wish there was an inexpensive, trusted place for me to deposit a large sum of money, and have it automatically paid to service providers to maintain my domain/hosting/online identity in perpetuity, or until my deposit/endowment runs out.

This sounds like what I want, only just for data.


Backblaze B2 also requires a verified mobile phone number in order to use it - even if you've already given them a credit card.

I would love there to be an option available at Backblaze B2 pricing, without a massive invasion of privacy. Right now I'm using Linode's Object storage, which is priced at $0.02/GB per month which is still reasonably priced for my needs.


pvacodes.com


I've never heard of Blackblaze B2 but it seems good according to some reviews and cheaper. Does it have a Desktop app or UI or something like that? I'd love to replace Dropbox with this. If not, someone should do a UI wrapper around B2 and charge for it ;)


There is a basic web UI and command line client. But mainly what it has is an API that many third-party clients support. https://www.backblaze.com/b2/integrations.html


I think your comment just put a lot of people on to Backblaze B2. At least you did for me. I was using S3 but I think I'll consider Backblaze now as an alternative.


One of the downsides of B2, especially for people located outside the US/Europe, is that they only have datacenters in the US west coast, and in Netherlands.


You can put Cloudflare in front the bucket for free egress and a global cdn


What's also interesting about this question is that storage density continues to double every several years. It would be safe to assume that the entire current planetary storage would fit on a thumb drive 166 years from now. Maybe by then it'll be magneto-spintronic-DNA time crystals.


Is Permanent a consumer product or enterprise? B2 is definitely enterprise.


> Termination

> We may terminate or suspend access to our Service immediately, without prior notice or liability, for any reason whatsoever, including without limitation if you breach the Terms.

Is this normal? So I guess this is not a good place to store a copy of my encrypted password file?

Or am I misunderstanding and it means that they can terminate my account only if/when I breach the Terms?


I think that's pretty normal and is meant to stop rules-lawyering when you do ban someone.


> I think that's pretty normal and is meant to stop rules-lawyering when you do ban someone.

Which is fine for a free service, but is going to be a pretty big drag on the number of people willing to "donate" $1000.


People who give money to museum and university endowments typically attach conditions that are very much meant to be litigated if they are ever violated. The recipient expects this. They don't make promises to donors, they sign contracts that force them to use the money the way the donor wants them to.

These terms and conditions are ridiculous if they want to be compared to museums and universities.


If we're going to compare those terms and conditions, then also consider this: the people who normally give those kinds of endowments are donating at orders of magntitude larger amounts. The size of those endowments gives the donors the leverage to attach those terms and conditions. What's ridiculous to me is expecting that a micro-endownment of $10 is going to give the donor the same kind of leverage.


I think that this is a pretty fair rebuttal, but I'm not sure I personally am convinced. First of all, this entity is inviting the comparison and second, they are saying that $10 is all you need to have something stored in perpetuity.


I wrote elsewhere: I know that there is nothing in the universe that is actually permanent. This is one of the insights from my meditation practice, things come and go. That includes my health and my life. So when I throw that idea out, I can see what they are really offering.

This isn't really meant to benefit you. This is meant to benefit our children. If the foundation survives longer than my own life, then I can put files that may be of value to my children and great-grandchildren. It would be up to them to value the preservation of their own digital history and cultural heritage to continue supporting this mission.

Both the founder of the Internet Archive and someone from the geaneology industry are among the board. I can see this idea being cooked up as, "hey, what if we were able to offer regular people their very own micro Internet Archive?" "What if we were able to pass on digital photos to be discovered by our descendants the way we have been able to discover photos from the late 1800s and 1900s?"

When viewed from that lens, about what happens to data after you die, $10 is a cheap gamble. This isn't really a promise made to me. This is a promise made to my kids. It may not be a promise that the foundation can keep, but I value contributing to my kid's heritage enough to risk $10.

I am still going to keep my Google Cloud and Dropbox, and whatever. But the 1 GB I have from this foundation is for a time capsule, stuff I really want to have a shot of passing it down. My kids won't care about my cat memes, or my passwords, or stupid videos. But they may want their baby pictures. They may want their grandpa's and grandma's dissertation.

When I die, my Google Cloud drive will shut down. But if things work out with Permanent.org, those files will continue to be there. I won't have to burden my kids directly with its upkeep. And perhaps, when they are older, they will come to value having access to it.

Maybe they have not sold their vision well enough. But I guess, they only need just enough people who gets it to kick this off. They are already 75% of the way there.


I guess the issue I have is that you have mentioned "cheap gamble" and "if things work out". This is not what they are claiming, except in the fine print.

Institutions that last a long time plan for changes in management. Contracts are part of that. I think I understand their vision, but they need to put themselves out there and be willing to be hauled into court to make "permanent" happen. If that's not what they are saying, then I guess I just don't understand.


> Contracts are part of that. I think I understand their vision, but they need to put themselves out there and be willing to be hauled into court to make "permanent" happen.

In cases of severe data loss or organisational insolvency, I'm thinking that there might not be an organisation to haul to court.

What might work for the end users of such an organisation is transparency of some sort, including the publication of regular financial statements and board minutes.


I'm ok with the level of accountability they have, and you are not. As far as a personal decision goes, that is up each of us individually. I'm ok with your decision not to participate.

Personally, I think the consumer protection and litigation has not done the US much favors, culturally speaking. It's gotten to the point that people think that Kickstarting pre-funded products have the same kind of guarantees. I have seen people get ragingly upset when their $5 kickstarter contribution amounted to nothing. I blew $1000 on a kickstarter project once knowing I may never see it again. (I got to go to a nice party out of it and got to meet Neal Stephenson and other fans; that was enough value for the $1k; they definitely did not deliver everything they promised).

It is why early-stage investment opportunities had been iffy -- unsophisticated investors treat what are essentially investments as if they were consumer products with the same kind of consumer product guarantees. It was why the SEC was founded in the first place, to protect "widows and orphans" and other unsophisticated investors ... and why regular folks get locked out of the better opportunities. Because somehow, our consumer mindset does not include an education on being an investor. There are no guarantees, just balancing risk and rewards.

With permanent.org, I'm investing into a future, not buying a product. I've thought through the risks and I made the decision for myself. I mean hell, during this pandemic, I have seen people want guarantees on even things like that their health. Get this treatment, save your life, or your money back? Demand service and sanitization supplies from hospitals, because the customer is always right? And now, I see this bizzare reaction of fear, derision, and ridicule on this non-profit vision. I'm not saying you are ridiculing this, mind; there's already enough of it from other commenters.

Don't get me wrong, I know there are plenty of scams around. It isn't as if I have not been conned before. However, it is often my pride, not my wallet, that has been hurt. I've seen much bigger cons, some even legitimized, with clear public harm. ... Enron causing brownouts to manipulate energy prices. Residential real estate valuation bubble ponzi scheme that is somehow normalized. The travesty called "No Child Left Behind Act" that shifted education further away from educating kids and teaching them to critically think while being emotionally intelligent. I can go on. Permanent.org's flaws in its marketing and messaging, its ambition to try to fund this through an endowment, is such a tiny blip when compared against the much bigger systemic problems and legitimized scams. If someone doesn't want to donate to permanent.org, then don't donate. Why are people getting so upset over this promise of "permanency"?


What does an art museum's art receipt 'termination clause' look like?

When one lodges their collection with a museum "in perpetuity" I'd expect the museum to have a disposal clause that lets them dump non-profitable works?

Works gifted to nations seem to get sold off occasionally, I'd guess that's by virtue of renovation clauses that allow the receiver a veritable carte blanch?


The term that I think you are looking for is called "deaccessioning" and Wikipedia has what I believe is a good page about it. Sometimes there are conditions, and the museum may have to go to court to be allowed to move forward (and a judge may not allow it).

https://en.wikipedia.org/wiki/Deaccessioning_(museum)


> We may terminate or suspend access to our Service immediately, without prior notice or liability, for any reason whatsoever

Pretty clear cut, any reason whatsoever.


It's still a perfectly fine place to store a copy of your important stuff. It just can't be the only copy.


Good catch.

If they can remove my files for any reason, how can I trust them not to delete my files? This clause does not make any sense for a service like this.


I love the idea of a not-for-profit tech company... I don't _yet_ trust _this_ company: fancy, connected, rich people's faces on the website may inspire trust in some, but for me, I see that they only paid for the domain name for one year, and haven't registered the two common misspellings listed on wikipedia. I'll wait 50-100 years and then judge them.

If they don't have confidence in their own plan beyond the one year of their DNS, why should I?

Are they just fishing for $100K and then they'll possibly make some real plans?

https://en.wikipedia.org/wiki/Wikipedia:Lists_of_common_miss...

From: https://lookup.icann.org/lookup

Name: permanent.org Registry Expiration: 2020-06-11 18:55:23 UTC (First post on news.ycombinator.com)


Who do you plan to trust for the intervening 50-100 years?


Or, who from 50 years ago is still around to be trusted? The list to choose from is short. IBM, HP, GE, TI...


What's to say that the new CEO of one of these companies wouldn't pull a Google Reader and axe the service, for the sake of consolidating product lines?

Or that the companies themselves wouldn't be merged?


> Or, who from 50 years ago is still around to be trusted? The list to choose from is short. IBM, HP, GE, TI...

Pretty sure there's no shareholder value in paying to preserve data for someone who's not paying fees and is not going to sue because they're dead. Those companies (or any for-profit entity) absolutely cannot be trusted to provide a service like this; their profit motive means they'll cheat, sooner or later.


Paying for DNS registration one year at a time is actually a good thing, it makes sure your renewal method is put into test every year. Way better than realizing your DNS contact is gone and you can’t renew your domain ten years later.


True. However, you can buy up 10 years in advance and still add one year of renewal every year.


"Permanent" and "free tier" sounds like a particularly terrible combination.

The market failure here is the classic "market for lemons" problem. Too many people have been burned by "forever" pricing that turned out to mean "a few years", or the bankruptcy or acquishutdown of a company. So any new entrant will face intense skepticism, no matter how sincerely they are trying.

So far the only permanent pricing that's worked for me is my grandfathered permanent Pinboard account, and that has a bus factor of one and a bit.


Storage is suited for it though. Most data, and especially photos, stops being accessed after some time and could stop consume bandwidth and electricity given properly designed infrastructure. Not that there is even a need to keep it forever, removing data not accessed in say five years or a decade is likely to still meet realistic durability guarantees any organization could provide, if it ever comes to that, which might be the case once they run out of physical space. Because of that such service can be offered as a "forever" service as long as the rate of new payments is enough for running it. But this is also where it gets tricky, the price they are shooting for right now is crazy unrealistic, it's at least an order of magnitude higher than competitive range, so they won't have many customers who can multiply and won't be able to attract enough customers to sustain it.


> removing data not accessed in say five years or a decade is likely to still meet realistic durability guarantees any organization could provide

This is exactly the sort of policy that a "permanent" storage facility must promise never to enact. The whole point of something like this is for stuff you don't need regularly but want to keep forever.

Every year or so I log into the dropbox account that has a copy of my wedding photos in. I don't need to look at them, but I want to keep them.


I'm not a huge fan of their "What We Do" page if I'm honest.

Aside from the title the first thing you read is "The Democratization of Permanence" - from my probably dumb, mostly mainstream with a bit of tech self this just screams "You're gonna need your thinking cap on for this one"

Can't you just say "we host files and it costs like 50 bucks a year" or whatever you actually do? Once you've done that you can whip out your thesaurus and put whatever you want on the page, just answer the question first.


Reading about this I was reminded of this blog post by Backblaze when they announced they were raising their prices.

https://www.backblaze.com/blog/backblaze-computer-backup-pri...

Backblaze does do more than "just store data" but that is their core business and operational concern. Just glancing through this it's easy to see that just retaining data at scale is difficult and expensive.

> By making this decision [to raise prices] now, we are ensuring we can continue to offer unlimited backup and keep improving our Computer Backup service.

I'm doubtful that this organization could generate enough passive income through an endowment to sustain itself. They do have a chart on endowment growth relative to storage growth. I wonder if they've hit the point where the endowment return is greater than their total expenses yet.

A one-time-payment like this would seem more possible if there were any restrictions on who's data to back up and how much. You can't just look at the interest of a one-time payment and say "yup that pays for storage on those bytes indefinitely" because for every byte of storage someone paid for there might be many more that are used for free.


> Our goal is permanence

Nothing is ever permanent. I've seen so many services come and go, that I'm quite sceptical about relying on cloud services for my data. My 25+ years of data is on a local NAS and on an offline copy at a trusted location.


> I'm quite sceptical about relying on cloud services for my data.

I'm quite skeptical about relying on VC-funded or publicly-traded cloud services. An actual non-profit could be a lot more reliable: as long as expenses are less than income, there's no pressure to grow, and it could go on forever.

The big thing I'm skeptical about is growth in data needs. 5GiB free iCloud was more than enough 5 years ago; when I upgraded my iPhone, suddenly all my videos take 8x as much space. $10 for 1GiB forever storage sounds OK now, but what happens in 20 years when a single photo is 500MiB?


If you need more storage, buy some more when you need it. The endowment price should be correspondingly lower.

An interesting side effect is that people are calculating the endowment interest in this thread (a hard thing to do when rates are near-zero and there is a real risk of negative rates in the next 50 years), while the big factor is that storage prices drop dramatically over time.

Imagine if this service had launched 20 years ago. $10 would have bought you .. maybe 20MB? Pretty cheap to store that "forever" now.


I am personally a supporter of this foundation's mission -- more because it gives our civilization an alternative to cloud storage that is not controlled by Big Tech.

However, realistically, I don't think we can assume that storage prices will drop forever. That depends upon continued advances and breakthroughs in science, engineering, and commercialization efforts. I recognize that, ironically, Big Tech help drive storage prices down. It may be a generation, or five, or ten, but the tech advance boom won't go on forever.

I don't know if the foundation will be around at that point. It is pretty ambitious, and perhaps, they may have to change their charter. The founder of the Internet Archive is on the governing board of this foundation, and I can easily see this idea cooked up as, "hey, what if every Joe and Mary can have their own micro Internet Archive?" "People have photos of their great great grandmothers 100 years ago, but everyone's stuff is no digital; what if they could have saved that for their kids? Would they have a place to stash it even after they die? ('cause, you know, no subscription fees) Can you depend on Facebook to memorialize that?" (One of the people on their board is involved in a geaneological company)

I think it is a good vision, although their plan is not without risk. (But what isn't?) We're also depending on our descendants to value these personal, mini vaults of data to keep donating to preserve it (if the endownment model does not work). But you know: we would be dead and it would not be up to us to value and preserve our own history.

I am really surprised at the amount of backlash I see on this forum for it.


> Imagine if this service had launched 20 years ago. $10 would have bought you .. maybe 20MB? Pretty cheap to store that "forever" now.

That's a good point, but I don't think in their favor. At the rate that they're charging, you could prepay for 36 years of storage on S3 (neglecting bandwidth charges, which I know are substantial).

Compounded with your point that data storage costs are tanking, I would actually expect $10 to go even further. Which is also not to mention that they're planning on paying for their costs on interest from their endowment. Turns out I can also put my money in something that generates a profit.

I just don't see the point. They seem like they're trying to build S3 but without any profits, which at best makes them a marginally cheaper option, and at worst, a more expensive and less well featured S3.


They aren't building anything. They are storing data to S3, B2, and Internet Archive [1]. The fact that they are storing to multiple providers means that the costs should be higher than yourself just storing on one provider. That is before taking into consideration that the dividends on the trust need to meet the cost. The return on $10 needs to cover the costs of storing in S3 and B2.

https://www.permanent.org/digital-archives/maintaining-acces...


> $10 would have bought you .. maybe 20MB? Pretty cheap to store that "forever" now.

On a macro scale, 20MB is still pretty difficult to store "forever", especially if you need to involve a significant number of trusted people, over a long enough period of time (basically forever), to ensure that it's around.


Format conversion, re-encoding, resizing, ... all kinds of possibilities, if the prices of storage will not fall too.


> Nothing is ever permanent.

Nothing in our throw-away society is. It could be with some radical changes. But that's another story


They don't seem to mention anything about egress/bandwidth costs. Is that unlimited or is there some sort of vague "fair use" policy?


From their Manifesto[1]:

> While the endowment model of the Permanent Legacy Foundation is designed to keep yourmaterials into perpetuity, it is not designed to be a high-traffic heavy-bandwidth hosting site.With the exception of approved nonprofit partners, we do not allow references of embedded15Permanent Legacy Foundation Manifesto materials on external sites for, and we must reserve the right to throttle or block abusive traffic

[1] https://www.permanent.org/wp-content/uploads/2019/05/Permane...


> Our promise to you.

> We will never mine your data, claim your copyright or invade your privacy.

That sounds great and all, but I don't want your word, I want cryptographic guarantees. Are there any?

EDIT: https://www.permanent.org/digital-archives/services/privacy-... doesn't mention anything, so I guess not.


I guess you'd have to do E2EE yourself. (Which _in my opinion_ is the only viable E2EE anyways because I always found it kinda fishy if the party you're trying to protect against also provides the tools you use to protect yourself. But like i said, that's just my opinion.)


>I always found it kinda fishy if the party you're trying to protect against also provides the tools you use to protect yourself.

It actually makes perfect sense the company would want to provide the tools that protect you from them. Take Signal for example, it's a messaging app that does beautiful integration of E2EE into the message transfer product. It's much better than e.g. OTR-plugin developed by Goldberg, Borisov et. al. for Pidgin etc.

What matters is transparency: Does the company allow you to verify their native client does proper client-side encryption, and does that FOSS code have reproducible builds. If yes, then it's much better the company spends some of the revenue from sold space into developing and auditing the client and its cryptographic implementations.


I agree, it's not impossible for a storage provider to also provide trustworthy E2EE. I trust some of these providers as well.

It's just kind of a gut feeling that centralization of power (i.e. possession of the data and knowledge about and control of the encryption mechanism) makes such a service a more attractive target to compromise.

Of course, if you really wanted to get the data of a specific person all you'd have to compromise is the encryption funnel regardless of where the data is stored. But I'm thinking, distributing control over the storage and the encryption is gonna make it a lot harder to do that because there's no single party that knows about both other than you.


Based on who is on their governing board, I think one of the use-cases here is to preserve files you would want to pass on to your descendents. You wouldn't necessarily want to have it cryptographically secured with E2EE.

I have old 5.25" and 3.5" floppies, full of software written by my father during the course of developing his dissertation. He died several years ago.

My original plan was to take whole disk images of it and stash it in the commercial cloud, ... but I'm probably going to stash a copy on permanent.org instead. I have no idea if my descendents would care about it. However, it is a memorial that (if the foundation does what it promises to do), not something I would have to do upkeep after I die.


If this is that important to you, encrypt your data locally first then just upload the encrypted data. For an example see Rclone [1].

[1]: https://rclone.org/crypt/


even cryptographic guarantee doesn't mean shit, the "cryptographic guarantee" is exactly what all the scammy blockchain crypto ICO scammers provided.

At the end of the day, these people can just take all that money, keep some for themselves, and say "ok we tried our best but didn't work out, it was an incredible journey!" and be done with it. and nobody can hold them accountable.

If they really want to do their best to "guarantee" permanence, they should guarantee the debt relationship, so if the forever condition doesn't hold after a couple of years, they will be sought out and collected all the money they took.


> If they really want to do their best to "guarantee" permanence, they should guarantee the debt relationship, so if the forever condition doesn't hold after a couple of years, they will be sought out and collected all the money they took.

What's to say that there would still be an organisation left to pay up the debt?

They'll probably need to hold some funds in escrow for it.


Mmmn, it's just a promise... Doesn't mean it cannot be broken. Not sure it will survive a change of management, too. Here's a primer for you ;) [0]

It's in your power to do your own mangling before uploading. The same with redundancy: don't put all your eggs in one basket (fancy promises or not). Good luck!

[0] https://www.youtube.com/watch?v=Nl8IVv4Y4bQ


What’s a cryptographic guarantee?


OK, "guarantee" is a bit strong. But for example, if the keys are generated client-side and they never see the key, like on tarsnap, then I wouldn't have to take them at their word that they totally promise not to look at my files.


Or you could encrypt your data if you're so concerned about it


The problems here are searchability, padding to hide sensitive file size, and having to move large containers back and forth to make small edits. If the remote backup is designed around a proper client-side encrypting product, you can have all this easily. If the encryption is done with a plugin, you might accidentally forget to pipe backups through it, or you might misconfigure something. So yeah there's things like cryptomator, but they'll never be as properly designed service with automatic client-side encryption.


Actually what you want is legally binding abuse-penalizing guarantees when in fact their terms say they can pretty much do whatever.


The abuse penalizing part is rarely proportional to the income of the company. When the penalty, if you get caught, is just a slap on the wrist, it makes sense to just count is as a fee for making business.


The non-profit take on this is new, however, there are for profit cloud services that offer similar one-time payment "lifetime" plans.

Pcloud for example charges a one-time lifetime 0.35 cents per GB, and their marketing language states:

"We have defined a Lifetime account as 99 years or the lifetime of the account holder, whichever is shorter."

Some thoughts on this:

It probably works better at scale if you control the storage infrastructure (to control the costs). If you are reselling Amazon, and 10 years from now they either raise the price significantly, or discontinue the storage you are using, how would you maintain the service without new (renewal) cash flow.

To solve this later in life you would want to / need to migrate the data to newer better more cost efficient storage. There are large scale costs associated with doing this. Dropbox eventually moved away from Amazon for these reasons, which provided balance sheet savings but it gets fuzzy when factoring the real world costs of owning and maintaining large scale storage infrastructure.

Offering 1 GB free and file sharing between accounts is an invitation for nefarious activities, and it seems like the only way they could manage that would involve breaking one of Permanent.org's core tenets ... Someone will have to look at the files to police it. Or the free 1 GB becomes a liability, not a loss leader. How will they do this?

Once they have your money and a few years have passed there might be an incentive for the organization to gradually degrade the service. Make it more and more difficult to use, in an effort to keep costs down.

And 10 years later when they lose interest in the project, what would stop them from selling the whole thing (cashing out) to a for profit firm ..... Looking at you .ORG / ICANN?


FYI PCloud is also half that price ($350) at a 2TB commitment.


Let's see. A non-profit, charging up-front and touting affiliation of famous people in unexplained capacity and showcasing use cases based on human interest stories of finely tuned social relevance. Grift sense intensifies.


Interestingly there was another site with an identical concept posted a number of years ago, which had a very simple website (teal background and virtually unstyled text IIRC). I remember it causing comments to be skeptical partly for the barebones site alone. Looking at Permanent.org's archive.org results it doesn't appear to be the same site though which makes me wonder how many other sites have tried this.


At $10/GB I’d rather get redundant 4-10TB hard drives every five years than trust permenant.org to be around in 50 years.


And that price would be a fraction of the price the previous 5 years each time you did it.


At $10/Gb I’d use some CD-R media


Nah CD-R's only last 10 years at most. Get some LTO tape.


I gather they’re going for an endowment model, and the pricing is reassuringly expensive.

That said, storage is one of those things that feels as though it should be charged on a subscription basis.


I can really like this.

A while ago one of my cards was stolen and I got a new one. It took a month before I realized my contact lens subscription had stopped. Luckily contact lenses are easy to get and I try to keep some extra around as well.

A bigger problem however was 20 or so years ago was that when I was drafted and I suddenly couldn't check my email for a while and after 14 days I lost access to

- my old address that everyone knew

- all my mail

- and most of my contacts mail addresses

Fixing that is a lot harder and I would be happy to pay a premium to be sure that some things stay around even if my house burns down with my NAS inside while I'm in hospital and my CC is cancelled while I'm unable to notice it.

BTW: feel free to post your suggestions. My best ideas are to ship encrypted disks to one of my brothers/sisters and parts of the passwords to two others In case I lose them or in case I die and someone needs wants access to my accounts.


Why the encryption?

If I store data with my family there's two kinds: the kind I encrypt because I don't want anyone else to access it and the kind that I don't encrypt because of I want them to be able to access it. Adding a fallible model with several people holding access might end up leaving your data inaccessible...


Good point.

- What if the disks are stolen?

- Or hidden in a wall and forgotten only to be found by the next owner? Weirder things have happened.

- Or uploaded to the public internet by accident. Warning: (hopefully)[0] wild hyperbole ahead. While I don't have much to hide (today) who knows about the future. I'd rather not want to see my photoalbum indexed to death by clearview and results sold to a future Nazi/Communist/Peta regime who'll use the face database to track down my grandchildren to punish them because their grandfather hated Nazis/wasn't exactly too fond of Communism either/ate meat and owned a rabbit.

- also for anything in the second category I guess the correct solution is an online server + encrypted backups with passwords available for everyone. Or just use backblaze or something and hope I don't become unavailable until some of my kids or their kids are old enough to become sysadmins ;-)

[0]: but who would have thought 100 years ago that lists of people's faith would be used 20 years later to systematically track down people not based on what crimes they had done but rather based on heritage only to round them up and kill them?


> We're bringing permanence to everyone. Your precious digital content is always private until you're ready to make it public

I store private data on my own hard drives, and when I want to make it public in the long-term, I upload it to Archive.org, which for now I have more confidence in than this service. The only time I see needing something like this is when I want something to be public after I die but no sooner, like a diary or secret confession or something.


This would be genuinely interesting to me, as I use cloud backup to store private, but not secret data.

That is, I'm interested in not having my family photos and personal files mined. To make it useful, I'd also want the service to handle encryption in a way that doesn't require me to self-encrypt and upload huge files all the time or anything of that sort.

As entitled as that may sound: If you want my money, you'd have to provide apps that integrate with the usual OS's, encrypting the data locally and seamlessly.

Now, they say they will use amazon for storage. That's a tough sell until I see what's the actual program looks like. I MIGHT be willing to trust a non-profit which existence is linked to ethical behavior. I will certainly not trust amazon without doing my own encryption. And if I feel like I gotta do that, I am not paying for an intermediate.


So, there was an earlier attempt at a preservation storage system with a "pay up front to fund perpetual storage", called the "Digital Preservation Network".

It came out of the library and archive sector, and focused on institutional customers -- libraries and archives with long-term archival/preservation needs. It was also non-profit. It of course seems attractive, if you really want to ensure long-term preservation, to set up a financial model that can somehow do this independent of the risk of the business continuity and budgets of the original depositors. And for cultural heritage institutions -- in the business of preserving incrementally more stuff every year -- it's a big advantage to budgeting if you can budget per GB you add to preservation storage up front, and never have to pay for it again -- so your yearly budget for preservation storage is just based on number of NEW TB's you are adding, instead of constantly going up with total number of TB's preserved, and thus this portion of your budget stays pretty constant instead of ever-increasing.

However, the DPN folded in Dec 2018, after fewer than 5 years of operation. It did not attain financial sustainability. (So all those up-front fees did not end up paying for perpetual storage after all).

You can read more about it's shutdown here:

https://duraspace.org/the-digital-preservation-network-dpn-t...

https://scholarlykitchen.sspnet.org/2018/12/13/digital-prese...

This new attempt is focusing on consumer/retail rather than institutional customers. A different scale of market (and by their suggested pricing tiers, aiming for much less storage per-customer).

And there is at any rate no reason to think just because one effort failed another will have to. Not every try ends up at the same outcome.

But I'd think the story of that effort should hopefully be informative for this new one. I think it's not a trivial thing to succeed with this sort of business model. I'd find it a bit more reassuring if they were like "Here are people who have tried this before, and why we think we will succeed." Although the answer to that might just be "an endowment model".

I think the permanent.org website is engaging in a bit of marketing slight of hand when they say "We are leveraging the same funding models used by museums, libraries and universities for centuries." -- making it seem like this is a solved problem, we're just doing what's worked for centuries for libraries and museums!

There's really nothing specific to libraries, museums, or universities about "endowments". Non-profits of all sorts would love an endowment. (and maybe some for-profits somehow?) I know of few libraries, museums or universities whose entire operating budget is paid out of an endowment. Most institutions even with endowments (and not all do) need to seek ongoing funding or revenue for operations in addition to the endowment.

Only the wealthiest even approach it. Generally there is a correlation between how much of operating budget is endowed and how old the endowment is. "For centuries" indeed -- those institutions with the biggest endowments generally have centuries-old endowments, created by extremely wealthy people long ago. I think there are probably few, if any, examples of recently-created endowments funding all or most of the operating budget of non-tiny institutions. Let alone endowments created by aggregating fees from "customers" paying for service, instead of wealthy benefactors.

And of course, there is the different business here too, the need to be able to predict ongoing operational costs not just of hardware, and things like electricity and space and networking, but of course the staff time that we all know is a non-trivial component of most IT projects. And the need to be doing it competently, with effects on both budget and success at not losing data!

I think it's rather too hand-wavy to imply (and i think that is defintely meant to be the implication) "Oh, this is the model that libraries and museums have used for centuries to do similar stuff, so of course it's proven!"

That said, the model is certainly attractive if it works! It is hard to imagine ensuring very-long-term preservation with a business model that requires the content-donors to keep paying perpetually. (also a non-profit model seems appropriate to me for very-long-term preservation).

(I am a librarian/software engineer whose work includes archival materials and digital preservation).


This is probably the most well-thought-out comment here. It isn't a knee-jerk "it isn't permanent", "the tech won't work", "the funding won't work". I'm not looking at this from the lens of an archivist, though I think that is important too.

What do you think about the role of IPFS and FileCoin in digital preservation? Is there a role?


Thanks!

I don't personally think very much of one, but i'm pretty down on blockchain in general. (Also not an expert at it, only have a surface-level IT guy understanding of it).

I could see some role in using blockchain to keep track of _checksums_ of preserved files (nothing in the chain except the cryptographic digests of files stored elsewhere), as a way to have a hard-to-tamper-with multi-party-decentralized preserved historical record that a particular file was stored at a particular time, and has not changed since (whether from error or mal-intent).

Just a record of what was stored when, not otherwise involved in the storage itself. If you want decentralized multi-party storage (which is cool, but I'm not sure it's necessary), there are protocols for that which don't require, or IMO have any reason to benefit from, blockchain technology.

Again just my own not super well-informed opinion, and I'm hardly a blockchain expert (being pretty suspicious of it).


Awesome, thank you for engaging :-)

Let me see if my quick run-down here might spark something interesting.

IPFS itself is not a blockchain. It is a piece of distributed infrastructure that allows people to share and store content in a distributed way. There are parts of it that are similar to the old torrent protocol. The main thing with IPFS is that the people who care about keeping a particular piece of data alive can "pin" it locally on their servers. Everyone accessing it will query other people who have pieces of that content -- just like with bittorrent.

IPFS has no monetization or blockchain.

FileCoin is the blockchain. It was intended to be the blockchain run on top of IPFS, although it may work on other content storage/transfer schemes. The idea with that blockchain is built around "proof of storage". That is, I can request someone store some bit of data for me, and you can offer to store it in exchange for something of value.

Among one of the immediate things I wanted to apply IPFS to is this archive of digital material that contains a knowledge base for our current technology base. I have since lost track of that knowledge base. It was designed as a CD you can burn, and get all sorts of information. The idea was to preserve this information in case of something catastrophic happening to our civilization.

One thing about IPFS, and perhaps FileCoin, is that it allows for decentralized knowledge bases. Stuff that could be administrated at a local, community level, and yet federated with many communities.

An example: gardening. With the pandemic, there had been a lot of people interested in gardening for the first time. However, how you plant, what you plant, how you manage those things are depended upon local conditions. I live in the low desert, and what I need to do for here is different from my friend who live in the high desert, or in the SE US.


Yeah that all makes sense actually, thanks.

I think the level of technical sophistication of most cultural heritage organizations is such that I don't entirely trust them to get it right with tried-and-true non-novel technology... if I were in charge of relevant efforts (which I so so am not), I'd want to get some basics in place (including clear business models) before doing more than "side project leaning experiment" with such things. And then add in the novel technologies little by little.

One distributed-storage infrastructure that has some uptake in cultural heritage preservation, built on probably much less elegant and exciting protocols, is https://en.wikipedia.org/wiki/LOCKSS


That's a great point about user/organizational sophisitication. Hmm. I'll check out LOCKSS.


Math is roughly $500 for 50GB of storage in perpetuity.

I think you could essentially replicate this by putting the $500 in a high interest savings account paying blackblaze from that and you'd have about ~100GB worth of storage on that setup today. Over time that ratio should get better.


Where is this "high interest" savings account of which you speak?


Take your pick https://www.nerdwallet.com/best/banking/high-yield-online-sa...

I assume that he was running the calculations for the blackblaze B2 service which is $.06/GB/year for storage, so at 1.6% APR on your $500 principal that works out to over 100GB


Yeah that's the number I used.


I guess my biggest question is how do you upload data? Through the web browser? Desktop client? Can I use RClone or rsync or an SSH / SFTP connection?

For people with more than 10 GB of data, using CLI tools will make integrating with your product much easier.


"Can I use RClone or rsync or an SSH / SFTP connection?"

I think there's a cloud storage provider that lets you use any tool you want over SSH ... including rclone and borg ...

It's not coming to me ... on the tip of my tongue ...


Rsync.net?


They compare themselves to museums, libraries and universities, but maybe the better analogy would be a graveyard: you pay once for a small amount of storage that is yours forever (or at least until the nearby airport needs to add a runway.)


Even that is far from adequate analogy if you think about the economics behind these things.

Buying a graveyard is essentially buying a piece of land (and maybe some very little amount of ongoing maintenance cost)

A web storage is not only for storing on a hard drive because unless you can reliably read from it, it means nothing. And THIS costs a lot of money, for maintenance and ongoing innovation to keep the costs down.

If storing someone else's data for free at scale was such an easy problem, none of the web startups would be going down.


> Buying a graveyard is essentially buying a piece of land (and maybe some very little amount of ongoing maintenance cost)

If one thinks further, they'll also want to plan for the possibility of state-enforced exhumation or eminent domain, among other things.


Similar service recently emerged in Russia. An eternal server for $150.

https://vdsina.ru/pricing/eternal-server


That sounds like an eternal server up to 30 months. I don’t think that pricing works out there.


What does the product look like, how does it work, features, etc.?

I see from the live donation list that people are throwing money at it. Am I missing something, has someone trusted/influential tweeted this out?



This seems interesting to me... the one question I have (that others here haven't asked, anyway), is whether 'permanent' means 'imutable', or if I can replace files with newer versions? My use-case is a large shared ebook library where I sometimes replace files with improved conversions (updated cover art, smaller files, improved CSS or standards compliance, etc.).


Anyone want to guess how long it takes for an issue to be made for rclone to support it ;-)

Seriously though I couldn't see a public API - can anyone see it?

(Rclone author)


The Shrine of Ise in Japan is rebuilt every twenty years. A construction company with a family history going back for centuries builds a copy on lot 2, then they tear down lot 1 and wait another twenty years. It’s been preserved like this for over a thousand years. This is the only way to do something “permanently”.


Tell that to the Romans :)


Who runs and manages this service? The board looks good but it doesn't list the management team or any employees.


Their IRS form 990 names three directors, an exec director, a CTO, and an engineer as of 2018. https://apps.irs.gov/pub/epostcard/cor/473017917_201812_990_...

Only one of those people, Dean Drako, is also listed on permanent.org: https://en.wikipedia.org/wiki/Dean_Drako

The address on the permanent.org contact page and the Form 990 matches one of his other companies.


This looks interesting and seems to have some known people on the board of directors such as Stephen Wolfram but I couldn't find pricing or much details as to how it functions. Permanent data storage is a big promise and a non-profit model could work if the people involved are commited.


You pay $10 per Gb but this is a one off payment rather than annual. The money is supposed to go into an endowment that will pay for the storage costs long term.


Aren't one-off payments to cover running costs provably unsustainable? It relies on continuous growth to support old users. I personally would want to rely on a service that might close at any minute because it stopped growing.


Not if you are able to charge enough, and reinvest the funds such that low-risk investment returns will cover the cost.

Combine that with underlying costs (storage, data transfer, computing power) which are trending downward and there’s no reason it shouldn’t work.


The idea is that they'd form an endowment. So they put your $10 in some sort of relatively safe investment, and every year it grows by, say, 1%. So then they have 10¢/year/GB to spend on storage costs.


At 10$/gb they are charging 200 times what you pay for a gb elsewhere for a month. So they are at least getting 200 months worth of money from you upfront. Even aside from what the others mentioned with the endowment.


Money makes money.

Say they raise enough to earn interest on their capital.

Say they make 1% interest per year.

Storing a GB costs $10. 1% of that is 10c.

How much does it cost to store a GB for a year?

Amazon charge ~1c/m for infrequent access and 0.4c/m for Glacier.

So somewhere between 12c and 5c a year.


Nothing is really permanent if there's an organization in control, particularly one subject to U.S. law. we can't predict whether in i.e. ten years, the U.S. won't get a law requiring companies to pass everything through automatic copyright filters. Those tend to be unreliable, so this is just one of the many ways our content may be lost.

The only network that could provide a reasonable guarantee of permanence would be a decentralized one, something like sia, but where the owner can pay for i.e. 100 years and lock the data in, so that no one can actually delete them.


Claiming that any digital service is "permanent" (even in a 10 to 20 year time frame) is quite a bold claim to make.


I feel like everyone is ignoring the obvious elephant in the room. The insane price model.

$10 for a gig? 1 GB?

$1000 for 100GB? Are you insane?

I can buy an 8TB for $120. I could have 70TB of storage for the price of your 100Gb.

If I bought 2 HDDs up front, had a raid with duplication set up, and replaced 1 HDD every 3 years (imagining one failed every 3 years) I would still have almost 30 years of storage which is longer than you'll exist with this insane price model.


It's not that insane if they can really deliver (and I don't see a technical reason why not.)

The real question is whether or not they compete with Archive.org, in the sense of sharing the same ecological niche. Archive.org does a great job but everything there is public, so maybe that's the differentiator?


Manpower costs money too.


Im getting a connection not secure warning on firefox 75.0. Seems like an ssl issue on the site.


What prevents a disgruntled employee from deleting or altering the data?


Off-topic.

There's a typo on some of the marketing copy: "A new paridigm".


Wouldn't that money better spent on archive.com?

This site will only cares to people who know about it and care enough to use it, while archive.org fossilize every site out there, from simplistic 10 line html file to wordpress sites to news websites.


hackernews is the roastme version of digital beings.


"a free Gigabyte" doesn't catch anyone in the US since 1999. Try "10 Terabytes" :). Few people will use all of it at once, anyway.


The pricing scheme is neat but for me irrelevant.

What I want to know if this uses any form of zero-knowledge cryptography features or not.

I guess not - since it can pull data directly from FB.


If you want to encrypt your data before you upload it, surely you have that option? In fact that really the only way it could work, if they did the encryption and have your back the key, you'd have to trust them that they're not keeping it too.

I can understand why they don't want to add a big barrier to entry by requiring that.


I guess it costs me nothing to try this. Lets see how permanent it is after 1-2 years.


I’m bullish on Sia. If there can just be a simple way to obtain the stupid crypto currency...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: