Gentoo Archives: gentoo-mirrors

From: "Robin H. Johnson" <robbat2@g.o>
To: gentoo-mirrors@l.g.o
Subject: Re: [gentoo-mirrors] mirror fetch jobs and --checksum
Date: Tue, 19 Jan 2016 06:44:41
Message-Id: robbat2-20160119T064342-875690061Z@orbis-terrarum.net
In Reply to: Re: [gentoo-mirrors] mirror fetch jobs and --checksum by Adrian Sandor
1 My primary concern is rsync mirrors, but source mirrors would benefit as
2 well (there was a recent incident with the bash upstream changing a
3 distfile file without modifying the mtime).
4
5 On Mon, Jan 18, 2016 at 12:30:02AM +0000, Adrian Sandor wrote:
6 > Hi, is this for source mirrors or rsync mirrors?
7 > Adrian
8 >
9 > From: Robin H. Johnson <robbat2@g.o>
10 > To: gentoo-mirrors@l.g.o
11 > Sent: Saturday, January 16, 2016 3:08 PM
12 > Subject: [gentoo-mirrors] mirror fetch jobs and --checksum
13 >
14 > Hi mirrors,
15 >
16 > Historically, our CVS-to-rsync process was overly enthusiastic about
17 > updating timestamps on files, even if they hadn't changed.
18 >
19 > With the new Git-to-rsync process, we've run into a few cases where the
20 > mtime is not represented with sufficiently high accuracy to catch all of
21 > the changes, and as a result changes are being missed.
22 >
23 > Can you please alter your rsync cronjobs to include --checksum in the
24 > commandline? All Portage calls will be including --checksum in future as
25 > well.
26 >
27 > A decade ago, we didn't include --checksum in the calls, as the CPU
28 > power available was considerably less; however systems have improved
29 > tremendously since that time.
30 >
31 > I have updated the official mirroring wiki page, and if it's been a long
32 > time since you reviewed your scripts, I encourage you to review it:
33 > https://wiki.gentoo.org/wiki/Project:Infrastructure/Mirrors/Rsync
34 >
35 > --
36 > Robin Hugh Johnson
37 > Gentoo Linux: Developer, Infrastructure Lead, Foundation Trustee
38 > E-Mail    : robbat2@g.o
39 > GnuPG FP  : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
40 >
41 >
42 >
43 >
44
45 --
46 Robin Hugh Johnson
47 Gentoo Linux: Developer, Infrastructure Lead, Foundation Trustee
48 E-Mail : robbat2@g.o
49 GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85

Replies

Subject Author
Re: [gentoo-mirrors] mirror fetch jobs and --checksum Adrian Sandor <aditsu@×××××.com>