| 1 |
On Sun, Jan 28, 2018 at 03:01:11PM +0800, Jason Zaman wrote: |
| 2 |
> Another thing im wondering is if we can just use the same dir layout as |
| 3 |
> the packages themselves. that would fix texlive since it has a whole lot |
| 4 |
> of separate packages. eg /usr/portage/distfiles/app-cat/pkg/pkg-1.0.tgz |
| 5 |
Texlive is worse than that: |
| 6 |
dev-texlive/texlive-latexextra/Manifest contains 8556 DIST entries, ALL |
| 7 |
starting with 'texlive-module-'. |
| 8 |
|
| 9 |
> there is a problem if many packages use the same distfiles (quite |
| 10 |
> extensive for SELinux, every single of the sec-policy/selinux-* packages |
| 11 |
> has identical distfiles) so im not sure how to deal with it. |
| 12 |
The new MetaManifest proposed that common distfiles could be moved to |
| 13 |
the category level Manifest (but needs a long transition period). |
| 14 |
|
| 15 |
> do you have an easy way to calculate how big the distfiles are per |
| 16 |
> category or cat/pkg? i'd be interested to see. |
| 17 |
very quick awk: |
| 18 |
per-package, no-dedupe: |
| 19 |
gawk '/^DIST/{f=gensub("/Manifest","",1,FILENAME); sum[f]+=$3}END{for(f in sum){print f,sum[f]}}' */*/Manifest |
| 20 |
|
| 21 |
(games-board/tablebase-syzygy is NOT a typo, it has ~150GiB of distfiles) |
| 22 |
|
| 23 |
per-category, no-dedupe: |
| 24 |
awk '/^DIST/{f=gensub("/[^/]+/Manifest","",1,FILENAME); sum[f]+=$3}END{for(f in sum){print f,sum[f]}}' */*/Manifest |sort -k +2n |
| 25 |
|
| 26 |
-- |
| 27 |
Robin Hugh Johnson |
| 28 |
Gentoo Linux: Dev, Infra Lead, Foundation Treasurer |
| 29 |
E-Mail : robbat2@g.o |
| 30 |
GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 |
| 31 |
GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 |
Archives