| 1 |
Hi, |
| 2 |
|
| 3 |
TL;DR: is your mirror fetching with --hard-link/-H? Would adding it be |
| 4 |
problematic for you? Speak up to save yourself bandwidth! |
| 5 |
|
| 6 |
The infrastructure team is having some discussions [1] about splitting apart |
| 7 |
the very large distfiles directory, as it now contains ~75000 files, and |
| 8 |
this leads some issues on some file-systems. |
| 9 |
|
| 10 |
The distfiles directory is around ~240GB presently, and we would like to |
| 11 |
have a reasonable transition period for users, without temporarily |
| 12 |
doubling the storage requirement on mirrors. |
| 13 |
|
| 14 |
The best means for this is going to be hard-links, but I don't know how |
| 15 |
many mirrors still have that enabled. |
| 16 |
|
| 17 |
None of the rsync setup documentation has ever included it (either right |
| 18 |
now or historically). It was strongly encouraged in this mailing list |
| 19 |
back in 2004/2005, as part of the new release staging process, but the |
| 20 |
most recent mention of hard-linking on the mailing list was Feb 2009. |
| 21 |
|
| 22 |
Ideally, the mirrors that offer rsync service to users for distfiles |
| 23 |
would ALSO offer hard-link fetching to users, but that isn't strictly |
| 24 |
needed at this point. |
| 25 |
|
| 26 |
To this end, I'm like to know |
| 27 |
1. How many mirrors are already fetching from rsync with the |
| 28 |
--hard-link/-H option. |
| 29 |
2. How many mirrors would NOT be able to enable rsync fetching with |
| 30 |
hard-links. |
| 31 |
3. Does your mirror offer or explicitly reject hard-link data to users? |
| 32 |
|
| 33 |
[1] https://bugs.gentoo.org/534528 |
| 34 |
|
| 35 |
-- |
| 36 |
Robin Hugh Johnson |
| 37 |
Gentoo Linux: Dev, Infra Lead, Foundation Treasurer |
| 38 |
E-Mail : robbat2@g.o |
| 39 |
GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 |
| 40 |
GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 |
Archives