Re: [gentoo-user] Backup program that compresses data but only changes new files.

[Dale]

Michael wrote:
> On Monday, 15 August 2022 11:58:14 BST Gerrit Kühn wrote:
>> Am Mon, 15 Aug 2022 12:50:37 +0200
>>
>> schrieb Gerrit Kühn <gerrit.kuehn@×××××××.de>:
>>> Being a happy restic user myself, I'd like to mention that compression is
>>> available meanwhile
>>> (https://restic.readthedocs.io/en/latest/047_tuning_backup_parameters.html
>>> #compression). However, the feature is rather new, I did not use it so
>>> far.
>> https://forum.restic.net/t/compression-support-has-landed-in-master/4997
>>
>> Just adding another link to the official announcement from earlier this
>> year.
>>
>>
>> cu
>>   Gerrit
> I think In Dale's use case compression is a solution seeking to address the
> problem of not enough storage space for backups, but it only makes sense if
> the data can be effectively and efficiently compressed.  He mentioned 99.99%
> of his backup data is video.  Video files are not particularly compressible,
> although small space savings can be achieved.  For example using basic enough
> zst parameters '-19 --rsyncable -z' I got just a 1.6% file reduction:
>
> Frames  Skips  Compressed  Uncompressed  Ratio  Check
>      1      0    88.9 MiB      90.3 MiB  1.016  XXH64
>
> Even if compression delivers some small space saving, given Dale's new faster
> Internet link and local video storage tendencies, compression will only kick
> the can down the road.  If these are not private or rare videos and remain
> available on public streaming platforms, perhaps local storage is no longer
> necessary?


This is correct.  My main reason for compression was to squeeze a little
more mustard in the jar.  I just did a test on a dozen or so videos. 
Uncompressed the videos was 214,931,665.  Compressed it is 200,878,554. 
It's a little saved but other videos may not compress that much.  Just
depends.  Even with that little savings, compression really isn't much
of a solution especially since I do not want any loss in data. 

Given my weird way of doing backups, rsync may be the best option. 
Plus, easier to restore from as well since it just requires a copy
command, any of them will do. 

Looks like bigger hard drives is the best idea for now.  I really need a
proper backup plan tho.  I just wish a NAS would fit in my fire safe.  ;-)

Dale

:-)  :-)