Alex Schroeder 🐝 is a user on octodon.social. You can follow them or interact with them if you have an account anywhere in the fediverse. If you don't, you can sign up here.
Alex Schroeder 🐝 @kensanata

We tell each other to self host in order to escape the big corps. But when we die, all the self hosted stuff is going to get wiped and history will only remember the archives that got stored by the big corps. And you know how history is written by the winners. Do we need a way to automatically hand over our sites to archive.org or similar? Or send them disc images? Nobody expects to get run over by a car but some of us will, today. I made no plans for this.

@bortzmeyer Very cool. And old school. "The Web archives are accessible to authorized users of the BnF, in the reading rooms of the Research Library only. This restriction is the same as that which applies to all legal deposit collections. As of June 22th, 2009, the BnF offers 350 computers to consult its Web archives across all its sites, in Paris and in Avignon." Hehehe!

@kensanata This is simply because of copyright and other IP issues. The law gives the authority to the national library to collect the sites (irrespective of robots.txt) , not to publish them.

@kensanata I've made plans with friends & family to - in case of my untimely demise - continue running my domains, and serve a static snapshot of contents. All the tools to do this are prepared, all passwords in a KeePassXC database, etc. I've written up instructions about what needs to be shut down and how, have a small amount of money set aside for a few years of hosting costs, so my content should be good for a decade or two after I'm gone. We should all be doing something similar.

@algernon @kensanata I should really do that, especially the instructions part. Currently there's no kind of documentation on all the things that need
to be taken care of if I can't anymore.

@algernon @kensanata I'd be very interested in a brief write-up of this process, if you have spare bandwidth. Continuity is something I've been considering, but I don't have a good idea where to start.

@nocko @kensanata I plan to put the skeleton of it up somewhere, likely in the form of a blog post. Sometime in the next few months, whenever time allows. (I've been meaning to do this for a while, now all the more reason to do so.)

@steckerhalter Federation and self hosting: The End of History, but not in the way you imagined!!

@kensanata This is a good point - you pay X per month for a VPS to self-host stuff and that's fine when you're around and solvent to pay that.

But what if you disappear, or your financial situation changes to the point where you can no longer afford a VPS? It all goes down.

@iona @kensanata Perhaps a buddy system. For e.g. I keep 2 vps in different towns. Each backs up the other. I don't really need two otherwise.
If I had a buddy with similar needs we could back each other up and be a redundant node when one of us got hit by a bus or heart attack.

@gemlog @iona @kensanata

on non commercial internet communities with older age profiles (electronics, amateur radio) there increasingly seem to be arrangements to archive/rehost content as people get older and alas, can often become too unwell to regularly update things (or simply and understandably want to spend their remaining time with their families) - eg I've seen useful but abandoned sites reappear on another domain (with permission from the original authors)

@gemlog @iona sadly I don’t have any such buddies that would be able handle all the admin stuff. But perhaps I just need to talk to one or two and see how interested they are in the subject. And perhaps it would make sense to pick a buddy that’s not the same age, too!

@kensanata @iona Yes. I don't know anyone in IRL either. I was thinking more a long-time internet buddy (buddette?). Like the buddy system of diving or hiking. Perhaps I should pick another word.
Anyhow, basically another someone with a public facing server, so you can rsync backups between you, share dns etc.
It does require a lot of trust though. Maybe an escrow system needs to be built on top for the credentials part.

@kensanata Someone should write a Dead-Man's-Switch app for Nextcloud

@bgcarlisle @kensanata I wrote a very basic one (not for Nextcloud though)

@kensanata There's decentralized systems like IPFS, BitTorrent, Zeronet et al. make replication of content easy, as in when you visit content you also help host it. No solution is 100% permanent, look at historical examples. But the more something is replicated the better it has a chance of standing the test of time; Epic of Gilgamesh, Shakespeare, Sanskrit scriptures and so on.

If you want your content to last, release it under a free license, back it up using free formats, or write it down.

@siraben I was thinking about my blog, and source code, and fediverse instances. Free license check. Private backup check. Write it down?! No way. And history is precisely the example I’m thinking off but I want us to do better. But I guess we’re not.

@kensanata Haha, the "write it down" was tongue-in-cheek. The issue with archiving things is that we sometimes archive the wrong things (see time capsules). In digital information you get a lot of storage in a very volatile format. Will your hard drive last a hundred years? Mine won't. The problem is getting worse with higher storage densities.

One active area of research is using crystals to store data, but how funny would it be if our crash reports are more useful to future historians!

@siraben @kensanata
Yes, Norsam Disks and such microscopic laser data storage are a great option, especially when data is stored in human-readable pages.
They still cost an arm and a leg, though. Unless there is a big push to make the tech popular and accessible, we may be living in a dark age of future history.

@kensanata "Save page now" on archive.org/web/

However, they automatically index pretty much everything that's truly public. Meaning no archiving of ANY Facebook posts etc., because of the login wall. So no, the corps will not remember you for the rest of history. The Internet Archive will.

@kensanata That said, I hope they have offsite backups of all their petabytes, because if The Big One hits SF, who knows what's going to happen.

@krozruch @raucao @kensanata They should open up torrents so that people can seed the data forever, this also stops them from erasing the past.

@siraben @kensanata @raucao I have uploaded some community video to archive.org. They have pretty good support for torrents for most things. Make an upload of a video, you can stream it on the website or torrent it. They also seem to automatically translate into open formats. People don't seem to use it so much. It's not a replacement for eg YouTube but for community video and audio content, it's great.

@siraben @krozruch @raucao Or you could create a federal mandate: make them part of the Library of Congress and make it a mandate that they save a copy of everything, including copyright exemption. They can stop publishing contested material but they will keep a copy. And people can at least walk on and make their own copies.

@kensanata @raucao @siraben I can see only one problem with that in the sense that it might then be argued they need federal funding, which could open them to pressures that might challenge their independence. I don't know that that will be the case and I don't know how they are funded now, but it is one potential concern to anticipate.

@krozruch @siraben Somebody posted this, today: «Note there are also backups by public institutions bnf.fr/en/professionals/digita If I die, the nationl library will have a copy of my blog :-)»

@kensanata @krozruch @raucao I don't know what the best compromise is for archiving the internet. Is more always better? Do we really need to remember every version of every single meme in the future? Maybe. Who knows if they'll be useful? But then again, maybe not.

@siraben @raucao @kensanata Also, do we want to maintain every blog post where people are working their way through a nervous breakdown or personal crisis?

@krozruch @raucao @kensanata Exactly. But do we want to have the power to arbitrarily delete content? Who decides what content is kept? Hard questions.

@siraben @krozruch @kensanata They're not that hard, if you accept that anything that is public can be archived by anyone anyway. Learn more about the Internet Archive, and if their FAQ and content aren't enough, ask them questions. This has all been talked about for decades.

@raucao @krozruch @kensanata And yet, by changing your robots.txt you can delete your entire site's history from archive.org look it up, it's happened before.

@siraben @raucao @krozruch Yeah, but they are ignoring robots.txt now, exactly because of this

@raucao @kensanata @siraben No harder, at any rate, that important social and political questions have always been, and must in some ways continue to be if we are to be involved in deciding our own fates. It's always negotiation and renegotiation.

@krozruch @kensanata @siraben That's provably false. Anyway, have fun negotiating your breakfast choice with someone tomorrow. I'll keep living with minimal politics. Thank you.

@siraben @krozruch @raucao somebody will need to write a PhD on early Internet and Memes and politics and all that in 100 years. Just like there are thousands and thousands of students scouring old newspapers counting instances of this and that, trying to figure something out.

@kensanata @siraben @krozruch The only thing that sure as hell does not survive history are current nation states and their institutions. There are many civil organisations, companies, churches, families, who still maintain archives that are vastly larger than any national collection.

@raucao @siraben @kensanata Intellectual property is one of the major barriers, as always, since without it as the default citizens could often cover much of this by keeping copies using something that looks *something* like torrents / IPFS.

@raucao @siraben @krozruch they don’t all have to end in a fire, though – the successor state might take them, after all.

@kensanata @siraben @krozruch How is that relevant? The risk and dependence aren't worth it. We already have decent civil orgs who are literally doing this right now. With zero of the countless drawbacks of handing control to a central bureaucracy, and all of the benefits of aligned incentives with donors and patrons.

@raucao @siraben @kensanata Yeah, states tend to lose stuff they don't find convenient - even if only temporarily - while keeping enough to make it look plausibly completist. That's the danger with handing this stuff over to a centralised state bureaucracy or state-funded body.

@raucao I was under the impression that they had multiple sites, including one in Canada specifically, but Wikipedia says: «The Archive has data centers in three Californian cities: San Francisco, Redwood City, and Richmond. To prevent losing the data in case of e.g. a natural disaster, the Archive attempts to create copies of (parts of) the collection at more distant locations, currently including the Bibliotheca Alexandrina in Egypt and a facility in Amsterdam.»

@raucao @kensanata Anecdotally, I see there are lots of gaps for public-facing websites in IA's crawled coverage, some of them years old. Using the "save page now" function helps not only grab stuff, but seed the crawler.

@raucao @kensanata oh cool. I wonder if there’s a way to trigger this automatically when we publish pages?

@n @kensanata I vaguely remember there being one, but if not, you could just set up a headless browser script.

@raucao @kensanata thanks. This seems like a good feature for any cms.

@kensanata
Short term thinking is a major blind spot, an ideological pit of the zeitgeist. The culture just isn't geared to prioritizing archiving or long term interoperability. This is a shame posterity (if there are any) will not thank us for.

It's good to try to save personal data with some nice .par2 files. On CD-R, supposedly these will last a good while. But archive curation even for a family is a real chore. A movement to prioritize this, I'd support!

@grainloom I would need simple and understandable instructions on how to achieve it. And I have the feeling that if nobody ever requested a copy and then my server dies, it would disappear from the net, too?

@kensanata with ssb you don't have to actually "request" it, eg. if you follow someone then (by default) you also get the posts from the people they follow (this can be configured with the "hop distance" option)
and that content can still propagate, even if the person loses their account

heck, ssb doesn't even need the web, it could work with flash drives and carrier pigeons

of course that limits what you can do with it, but it opens the door for a lot of interesting new things

@kensanata
My wife has got my keepass and I got hers. It's not enough. We need better solutions.

@eladhen @kensanata I like the idea of some kind or foundation to keep these archives. Certainly not a big corp; no need to have anyone profit from one's death or post death.

I'm for the internet archive. One should also think about them now or in your will:

archive.org/donate/