Gentoo Archives: gentoo-user

From: Ciprian Dorin Craciun <ciprian.craciun@×××××.com>
To: gentoo-user@l.g.o
Subject: [gentoo-user] File system meta-data indexer / checker
Date: Sun, 16 Jun 2013 21:15:04
Message-Id: CA+Tk8fzFgKAJB422CKgCHTtXm56_qp8iR1aqte-03b6s-UvtWA@mail.gmail.com
1 Hello all!
2
3 While struggling with managing various old backups --- just
4 imagine 10 or so copies of almost the same content, some with `rsync`,
5 some with `rdiff-backup`, yet some others on plain ISO's, all over a
6 range of a few years --- I stumbled upon the following missing piece
7 in the Linux tools ecosystem: a file-system crawler that records
8 **only** meta-data, like all the info available through `stat`, plus
9 an assortment of hashes of the files (at least MD5 and SHA-1,2
10 family), and optionally ACL's and extended attributes. Thus I was
11 wondering if someone knows a tool that fits this description.
12
13
14 I must say I've tried to do my homework, and below are a few tools
15 that come close, but not quite...
16
17 (A) `rdup` is probably the closest to what I'm searching. However
18 there are a few issues:
19 * it's output format is not very parsable, especially in cases
20 like symlinks, and a few other special cases;
21 * it doesn't escape the file names --- and from some reason I have
22 files containing escape sequences in them...
23 * it records only SHA-1;
24 * it doesn't handle ACL's or extended attributes;
25
26 (B) `mtree` from FreeBSD. I found two ports of it for Linux,
27 however my main concern is how parsable is the output...
28
29 (C) `md5deep` (or `sha*deep`), which only records the checksum not
30 other meta-data.
31
32
33 Thus, are there any other alternatives? (Just to be clear, I
34 don't need a "backup" solution, just something to record file-system
35 meta-data. Maybe a "meta-backup" solution... :) )
36
37 Ciprian.

Replies

Subject Author
Re: [gentoo-user] File system meta-data indexer / checker Florian Philipp <lists@×××××××××××.net>
Re: [gentoo-user] File system meta-data indexer / checker Paul Colquhoun <paulcol@×××××××××××××××××.au>