Backblaze Wasabi

by



It depends on the volume of data. Running a second Synology unit at another site and mirroring changes (using something approaching the efficiency of rsync) will easily be the most economical beyond 1tb -- an amount typically included for free with just about every Office 365 subscription. It's not ideal however, unless you plan to perform DR to the cloud; that is, restore a failed local instance to a cloud platform. This is because you will be unable to get one tenth of 1tb of data that stored in the cloud in a timely fashion unless it is being restored to an adjacent platform.

The cool thing about rsync is that the bandwidth use can be near zero as you can do a full mirror once a week but generate a differential file each night and export it to a local drive instead of applying the changes over the internet. That differential file can be used to roll the remote version forward to the time the file was generated. You would only actually apply it to the remote mirror if need be -- testing notwithstanding.

(NOTE:This is the second of a three part series on setting up a cloud-based backup system, and describes how to use the various technologies discussed previously.The first describes criteria and reasoning for the various technologies selected for use, while the third describes setting up the backups to run automatically on schedule.)

MSP360™ honors a storage-agnostic approach with support for all the major public cloud storage providers, including AWS, Microsoft Azure, Backblaze B2, and Wasabi. By decoupling cloud storage from the backup software, MSP360™ puts Managed Service Providers in control of what and how they backup and the price they pay for storage. Restic supports a variety of backends for storing backups, including a local server, SFTP server, HTTP Rest server, and a number of cloud storage providers, including Backblaze B2. Files are uploaded to a B2 bucket as de-duplicated, encrypted chunks. Each time a backup runs, only changed data is backed up. Backblaze B2 is enterprise-grade, S3 compatible storage that companies around the world use to store and serve data while improving their cloud OpEx. Wasabi Hot Cloud Storage Wasabi Hot Storage is cloud object storage with no egress or API fees.

Setting Up “restic”

“restic” is the the backup technology we will use for its performance, deduplication, and native support for writing to various different remote backends.You can install “restic” using the apt package manager:

Backblaze Vs Wasabi Reddit

Backblaze Wasabi

But I think it would be better to pull the latest version off their site, due to numerous little but useful improvements in this version vs. the ones in the Ubuntu repositories.It is Go language application that can be downloaded as a single-file statically-compiled self-contained binary for a variety of platforms.

Setting Up the Cloud Storage Service

  • Wasabi: Create your Wasabi account and set up your buckets following these instructions. Mozilla sunbird calendar download.

  • Backblaze: Set up your Backblaze account and enable B2 following these instructions.

Making Your First Backup with “restic”

Initialization

“restic” can take all its arguments, options, and settings at run time.However, what we are going to do is to create a shell file that defines the values we need in some standard environmental variables, and we will source this file just before running any backup or backup management operations.This makes running restic as simple as, e.g., “restic init” instead of “restic init -r s3:https://url/of/repo” etc., as “restic” will just look to these variables for the information that we need.Note that you do not need to leave all these variables in there if you feel uncomfortable having them around: you can just supply them as needed.The variables you will need to define vary depending on whether you are using Wasabi or Backblaze:

  • Wasabi: Create and obtain your access ID and key pair, following these instructionsThen, create your directive file that populates the appropriate environmental variables, e.g., “~/.backup-configs/restic-wasabi-config.sh”:

  • Backblaze: After [setting up your B2 account](), you need to obtain your B2 account identifier and key.Then, create the directive file to be sourced, e.g., “~/.backup-configs/restic-b2-config.sh”:

Repository Creation

  1. Source the repository directive files to populate the environmental variables with all the information that “restic” needs;

  2. Create the backup repository using the “init” command.As we have exported the environmental variables specifying (1) the access identifier; (2) the access key; (3) the repository URL; and (4) the repository password above, the command is very simple. Otherwise we would have to specify these values as arguments, options, or enter them in when prompted.

    Also note that you could manually create the cloud storage bucket, but “restic” will also automatically create one for you if it does not exist.

  3. Create the first “snapshot” using the “backup” command (note that the “–verbose” flag does not work in the older versions of “restic” available from the Ubuntu repositories as of 2018-10-10), with path(s) to the directories on our local system that we want to backup.

  4. Check the backup using the “snapshots” command:

Making Subsequent Backups with “restic”

  1. Simply re-run the backup command to take another snapshot:

  2. And check to make sure it there:

Backblaze Wasabi

Mounting the Remote Backup

As the saying goes, “amateurs talk about backups, professionals (or the old souls) talk about restoration”.Your backups are useless if you cannot get to them easily.Of course, you can always restore the entire backup (or the latest snapshot) through “restic”, and this is covered in the guide I mentioned above as well as the restic documentation.But what I am going to talk about here is ability the mount the remote backup in a local file system.

Folks, this is really, really, really, really, really COOL!

Reaper 5.965. Instead of downloading the entire backup (which you only really need to do in the event of a full machine/disk loss), you can mount the backup as a local directory, browse through the files and view/copy just the directories/files you need.

I will say, however, that I do prefer Borg’s way of handling mounting.“restic” runs in blocking mode in the shell, requiring you to open up another shell session to get to the files and then return to the first shell and send a Ctrl-C to exit.The Ctrl-C unmounts the drive and cleans up … IF you have no other process using the drive, including a shell session that you forgot about.If the latter is the case, then things get into a dirty state, and you have to force an unmount by one of the following: Imac 2006 latest mac os.

In this respect, Borg seems to do it right: running the mount command mounts the drive and exits right away, freeing the same shell session for you to do other things including browse the files.And unmounting is a lot cleaner as well.

Backblaze Vs Wasabi

More …

  • Part 1: what programs/technologies to use, and why.
  • Part 3: scheduling the system to run for automatic backups.

Links

  • Using “restic” with Backblaze
  • Using “restic” with Wasabi