🚧 Work in progress.

My data are probably my most valuable possessions as they are the only things I can't replace. Ever since I learned of the possibility of cloud backup solutions I've been set on using them but always found good consumer solutions for personal backups lacking.

CrashPlan

This feeling was reinforced when my provider CrashPlan discontinued their personal product offering in order to double-down on their enterprise product.

Spideroak

After CrashPlan I spent a while Googling alternative solutions and settled on Spideroak. I found the product to be clunky and unreliable and stopped using it after a while.

Restic

Feeling somewhat disillusioned, I discovered an excellent command-line tool called Restic. It would require more of my own effort to get something usable with this but by this point I was OK with that.

I have a desktop PC running Windows that I also use as a Plex Media Server and the 'master' place to store all my precious data. I used Task Manager and a Powershell script to setup a scheduled task to backup my files to a Restic repo in Google Cloud storage and email me the resulting logs every morning.

Egress fees

I felt very smug that I had managed to roll my own simple but reliable personal backup system that also seemed very cheap - I was paying about 0.69/monthtostore300GBincoldlinestoragebucketscomparedtoabout0.69/month to store 300GB in coldline storage buckets compared to about 8/month with commercial offerings.

However I'd foolishly overlooked how much it would cost me to download my backup in the case of a disaster. I don't mean the read fees for using a coldline bucket instead of a standard bucket. I mean the general egress fees for all data transfer out of Google Cloud Storage.

It was going to cost me about $100 to download those 300GB if I ever needed to. I thought I must be calculating the costs wrong but I learned that cloud providers aggressively lower their ingress fees to drive adoption whilst simultaneously charging hard for egress to discourage leaving and because egress generally means you are serving data to customers and making money.

In retrospect this makes complete sense and I don't blame cloud providers for doing this - in fact its smart. But it did make GCP entirely unsuitable for personal backups in my opinion.

Sia

Now my entirely unpractical and convoluted plan is to use this as an excuse to explore the world of decentralised apps & crypto by renting some storage on the Sia network and updating my using that as the backend for Restic instead.

I already discovered a gotcha with this as the minimum 'block' size on the Sia network is 40MB which means that you end up being charged significantly for lots of small files you're likely to find in a personal backup.

However they're just on the cusp of releasing new components which include 'packing' features which automatically pack files into 40MB blocks for you.

More updates to come as I work on this.