Gentoo Archives: gentoo-user

From: Joost Roeleveld <joost@××××××××.org>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] Backups and snapshots [Was: Organising btrfs subvolumes]
Date: Wed, 28 May 2014 11:42:20
Message-Id: 5654227.6WGcHXIeG0@eve
In Reply to: Re: [gentoo-user] Backups and snapshots [Was: Organising btrfs subvolumes] by Alan McKinnon
1 On Wednesday 28 May 2014 13:07:49 Alan McKinnon wrote:
2 > On 28/05/2014 11:58, Joost Roeleveld wrote:
3 > > On Tuesday 27 May 2014 23:35:26 Alan McKinnon wrote:
4 > >> On 27/05/2014 17:12, J. Roeleveld wrote:
5 > >>> I have a yearly (full), monthly, weekly and daily. Each incremental is
6 > >>> against the most recent one of itself or longer period.
7 > >>> That means having to keep multiple snapshots active, which I prefer to
8 > >>> avoid.
9 > >>>
10 > >>> But, it is a good idea for backing up desktops and laptops.
11 > >>
12 > >> I'm curious why you have yearly snapshots. I've yet to find any sane
13 > >> production system where a yearly backup had any worth at all. Even
14 > >> monthly is pushing it...
15 > >>
16 > >> Or do you do it to have a decent start point for incrementals?
17 > >
18 > > It's to have a decent start point for incrementals.
19 > > Below are the 2 biggest shares on the NAS:
20 > >
21 > > /dev/xvda17 7.1T 5.9T 1.2T 84% /data/unsorted
22 > > /dev/xvda16 3.0T 2.4T 517G 83% /data/software
23 > >
24 > > It is impossible to do a full backup on a daily or even weekly basis.
25 > >
26 > > Previously, I had 1 full backup and then a daily incremental. This appears
27 > > like a good idea, untill you need to restore the filesystem from backups
28 > > when the crash occured 2 years later.
29 > > That is 1 full backup and over 700 incrementals....
30 > >
31 > > Currently, I do the following:
32 > > Every year, a full backup
33 > > Then, every month, I have an incremental based on either the yearly or
34 > > previous monthly.
35 > > Ditto for the weekly (but then based on monthly or weekly)
36 > > And again for the daily.
37 >
38 > OK, that makes sense.
39 >
40 > It reminds me of an issue my wife had with the data warehouse when she
41 > worked at the bank. In a nutshell, they needed backups but backups were
42 > impossible to achieve because physics says so. They needed to get data
43 > off the disk 4 times faster than data comes off a disk - SCSI limits
44 > being rather hard limits :-) That opinion didn't go down well when I
45 > offered it
46
47 Haha :)
48 I know the feeling.
49 I'd love to know the final solution they came up with.
50
51 > The solution was to do it much like your plan above.
52 > With the benefit that the infrequent full backups would be done on a
53 > fixed schedule in a change window with X hours downtime that was known
54 > well in advance.
55
56 Using snapshots, the downtime is the same couple of minutes each night.
57 The problem is that during the backup, the performance of the server is
58 impacted. For a full backup, that means weeks...
59
60 --
61 Joost

Replies

Subject Author
Re: [gentoo-user] Backups and snapshots [Was: Organising btrfs subvolumes] Alan McKinnon <alan.mckinnon@×××××.com>