commit ba001c6ac6358e008409068aedf832228d00940f
parent b0299eef32107c8bfcf8c3240d630a19e5a73359
Author: FIGBERT <figbert@figbert.com>
Date: Sun, 27 Jun 2021 22:26:32 -0700
Add post following up on previous post
Diffstat:
3 files changed, 80 insertions(+), 1 deletion(-)
diff --git a/content/log/2021-06-27-backups-update-internet-celebrity.gmi b/content/log/2021-06-27-backups-update-internet-celebrity.gmi
@@ -0,0 +1,71 @@
+# An Update on Bad Backups and Internet Celebrity
+
+My recent post on the Great Alpine Migration Tragedy of 2021 garnered some serious attention! I got a number of emails, a whole host of feedback on Lobste.rs, and over 100 points on Hacker News! As I understand it, that means I'm now a top internet celebrity (and eligible for the 10 KB Club).
+
+Still, I must remain humble even as I catapult toward digital infamy and thus I am here to respond to feedback, answer questions, and talk about what I've done to prevent something like this from happening again.
+
+Before we begin, for those who haven't already, read the story of the Great Alpine Migration Tragedy:
+=> /log/wrong-way-to-switch-server-os.md over Gemini
+=> https://lobste.rs/s/ofcfbq/wrong_way_switch_operating_systems_on on Lobste.rs
+=> https://news.ycombinator.com/item?id=27562613 on Hacker News
+
+## Useful Tips from Strangers
+
+### Ctrl-C is Not a Debugging Tool
+
+That's a good point: I've been advised to update my methods. Several folks pointed me towards strace. Sending the SIGUSR1 or SIGINFO signal to Tarsnap would also work. The -v flag could have been helpful as well.
+
+=> https://jvns.ca/blog/2021/04/03/what-problems-do-people-solve-with-strace/ Also see: What problems do people solve with strace?
+
+### Don't Wipe Prematurely
+
+A number of folks were confused as to why I didn't keep the old machine around during the transition. Others detailed their own migration strategies. In general, it seems that folks agree you should keep around your old machine until you're totally certain everything is up and running in your new setup.
+
+As I mention briefly in the article, I've actually done this in the past myself! This time, however, there was no second server. Everything was done in-place. I cannot change this, as it occurred in the past. In the future I will avoid this kind of migration.
+
+### A Restore System
+
+A number of people took issue with my take-aways from the experience. See:
+
+> Trying to address a lack of confidence by increasing the backup
+> frequency doesn't make sense. The backup frequency is the most trivial
+> thing to adjust and doesn't address deeper issues, like the fact that
+> you need to dump/restore databases properly and shouldn't copy files
+> from a live database.
+=> https://news.ycombinator.com/item?id=27596126 by klodolph
+
+I'll start by saying that that increasing backup frequency from zero to anything greater than zero does, in fact, address a significant issue. I now have backups where there were none before.
+
+Still, the point stands. Without quality backups, and quality restore strategies, the backups are not as useful as they could be.
+
+### A Little Bit of Gold and a Pager
+
+There was some fun memeing in the Hacker News comments in response to me being a teenager:
+
+> I know whom I won't hire for my company IT or devops or whatnot.
+=> https://news.ycombinator.com/item?id=27597216 by wildmanx
+
+Several people have a sense of humour:
+
+> Good idea to let him graduate from highschool before hiring him!
+=> https://news.ycombinator.com/item?id=27597698 by nick__m
+
+I'll add for further memery that in addition to the stress of my entire server infrastructure burning, I had to deal with passing the behind-the-wheel driver's test. I've now been a licensed driver for about a week and a half. Coincidentally, I got my server back running the same day I passed the test.
+
+## How I'm Doing Backups
+
+I moved all the data in my self-hosting setup into a single directory. The files were previously all lying about my home directory, which is what led to the tragic "forgetting about .env amongst all my dotfiles" incident.
+
+I set up a cronjob that runs a script daily, set to back up the self hosting directory. It currently keeps a buffer of 31 daily and 12 monthly backups, and keeps around yearly backups forever. It's been running for a couple days now, and it's all been smooth sailing so far.
+
+=> https://github.com/alexjurkiewicz/acts/ acts: Another Calendar-based Tarsnap Script
+
+## To Infinity and Beyond
+
+I'd also like to say thanks to a number of people who were especially kind, and made this a fun experience:
+
+1. Graham Percival, an employee at Tarsnap Backup Inc., reached out to me directly – we had a fun and interesting email exchange.
+2. hannu was the first to write the later much-echoed sentiment that reflecting on one's mistakes is a useful and laudable thing to do.
+=> https://lobste.rs/s/ofcfbq/wrong_way_switch_operating_systems_on#c_b0zqnt hannu on Lobste.rs
+
+I'm going to continue iterating my self-hosting setup. I've still got a couple new services I might want to throw up there. I also can't forget about the dedicated "self-hosting" page I promised...
diff --git a/content/log/atom.xml b/content/log/atom.xml
@@ -4,7 +4,7 @@
<subtitle>A collection of my ramblings recorded in the annals of the capsule's flight computer.</subtitle>
<link rel='self' href='gemini://figbert.com/log/atom.xml'/>
<link rel='alternate' href='gemini://figbert.com/log/index.gmi'/>
- <updated>2021-06-17T17:32:26-0700</updated>
+ <updated>2021-06-27T22:27:16-0700</updated>
<author>
<name>FIGBERT</name>
<email>figbert@figbert.com</email>
@@ -15,6 +15,13 @@
<rights>© FIGBERT - CC BY 4.0</rights>
<entry>
+ <title>An Update on Bad Backups and Internet Celebrity</title>
+ <id>gemini://figbert.com/log/2021-06-27-backups-update-internet-celebrity.gmi</id>
+ <link rel='alternate' href='gemini://figbert.com/log/2021-06-27-backups-update-internet-celebrity.gmi'/>
+ <updated>2021-06-27T12:00:00-0700</updated>
+ </entry>
+
+ <entry>
<title>The Wrong Way to Switch Operating Systems on Your Server</title>
<id>gemini://figbert.com/log/2021-06-17-wrong-way-to-switch-server-os.gmi</id>
<link rel='alternate' href='gemini://figbert.com/log/2021-06-17-wrong-way-to-switch-server-os.gmi'/>
diff --git a/content/log/index.gmi b/content/log/index.gmi
@@ -22,6 +22,7 @@ d88' d88' `?88P'`88bd88'`?88P'`?888P'd88' `?8b
A collection of my ramblings recorded in the annals of the capsule's flight computer.
+=> 2021-06-27-backups-update-internet-celebrity.gmi 2021-06-27: An Update on Bad Backups and Internet Celebrity
=> 2021-06-17-wrong-way-to-switch-server-os.gmi 2021-06-17: The Wrong Way to Switch Operating Systems on Your Server
=> 2021-03-19-package-in-the-bush.gmi 2021-03-19: A Package in the Bush
=> 2021-02-10-some-quality-shitposting.gmi 2021-02-10: Some Quality Shitposting
