| 1 |
Hello, |
| 2 |
|
| 3 |
As part of my portage-janitor scripts (https://github.com/iksaif/portage-janitor) |
| 4 |
I created a tool that counts URIs prefixes and sort them. |
| 5 |
Here is the result of this script on the gentoo-x86 tree: |
| 6 |
|
| 7 |
$ ./mirrors.py --all --count |
| 8 |
1262 http://dev.gentoo.org |
| 9 |
483 http://oss.tresys.com |
| 10 |
482 http://oss.tresys.com/files |
| 11 |
482 http://oss.tresys.com/files/refpolicy |
| 12 |
473 http://xorg.freedesktop.org |
| 13 |
473 http://xorg.freedesktop.org/releases |
| 14 |
473 http://xorg.freedesktop.org/releases/individual |
| 15 |
313 http://dev.gentoo.org/~swift |
| 16 |
313 http://dev.gentoo.org/~swift/patches |
| 17 |
309 http://dev.gentoo.org/~swift/patches/selinux-base-policy |
| 18 |
297 http://pear.php.net |
| 19 |
297 http://pear.php.net/get |
| 20 |
296 http://hackage.haskell.org/packages |
| 21 |
296 http://hackage.haskell.org/packages/archive |
| 22 |
296 http://hackage.haskell.org |
| 23 |
209 http://launchpad.net |
| 24 |
206 http://ftp.xemacs.org |
| 25 |
197 https://github.com |
| 26 |
196 http://ftp.xemacs.org/pub |
| 27 |
196 http://ftp.xemacs.org/pub/xemacs |
| 28 |
193 http://ftp.xemacs.org/pub/xemacs/packages |
| 29 |
179 http://gstreamer.freedesktop.org |
| 30 |
179 http://gstreamer.freedesktop.org/src |
| 31 |
176 http://github.com |
| 32 |
175 http://linuxgazette.net/ftpfiles |
| 33 |
175 http://linuxgazette.net |
| 34 |
139 http://xorg.freedesktop.org/releases/individual/app |
| 35 |
130 http://pear.horde.org/get |
| 36 |
130 http://pear.horde.org |
| 37 |
126 http://xorg.freedesktop.org/releases/individual/driver |
| 38 |
115 http://dev.gentoo.org/~vapier |
| 39 |
112 http://dev.gentoo.org/~vapier/dist |
| 40 |
96 ftp://sources.redhat.com/pub |
| 41 |
96 ftp://sources.redhat.com |
| 42 |
94 http://savannah.nongnu.org/download |
| 43 |
94 http://savannah.nongnu.org |
| 44 |
92 http://xorg.freedesktop.org/releases/individual/lib |
| 45 |
88 http://pecl.php.net |
| 46 |
88 http://download.gna.org |
| 47 |
88 http://pecl.php.net/get |
| 48 |
84 http://dev.gentoo.org/~caster/distfiles |
| 49 |
84 http://dev.gentoo.org/~caster |
| 50 |
80 https://fedorahosted.org |
| 51 |
74 http://get.qt.nokia.com |
| 52 |
72 http://components.ez.no/get |
| 53 |
72 http://components.ez.no |
| 54 |
71 http://get.qt.nokia.com/qt |
| 55 |
70 http://get.qt.nokia.com/qt/source |
| 56 |
67 http://www.phrack.org/archives |
| 57 |
67 http://www.phrack.org/archives/tgz |
| 58 |
|
| 59 |
And here are some mirrors that can be deduced from that (except freebsd-jp |
| 60 |
which I found reading the linphone ebuild): |
| 61 |
|
| 62 |
freebsd-jp ftp://ports.jp.FreeBSD.org/pub/FreeBSD-jp/ ftp://ftp.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp1.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp2.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp3.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp4.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp5.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp6.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp7.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp8.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp9.jp.freebsd.org/pub/FreeBSD-jp/ ftp://ftp.ics.es.osaka-u.ac.jp/pub/FreeBSD-jp/ ftp://ftp.ics.es.osaka-u.ac.jp/pub/mirrors/FreeBSD-jp/ ftp://ftp.allbsd.org/pub/FreeBSD-jp/ ftp://ftp.nagaokaut.ac.jp/pub/FreeBSD-jp/ ftp://ftp.nara.wide.ad.jp/pub/FreeBSD-jp/ ftp://ftp.jaist.ac.jp/pub/FreeBSD-jp/ |
| 63 |
pear http://pear.php.net/ http://de.pear.php.net/ http://us.pear.php.net/ |
| 64 |
redhat ftp://sources.redhat.com/pub/ ftp://mirrors.kernel.org/sources.redhat.com/ ftp://mirrors.kernel.org/sources.redhat.com/ http://mirrors.kernel.org/sources.redhat.com/ http://sources-redhat.mirrors.airband.net/ ftp://gd.tuwien.ac.at/gnu/sourceware/ http://gd.tuwien.ac.at/gnu/sourceware/ ftp://ftp.gwdg.de/pub/linux/sources.redhat.com/ http://ftp.gwdg.de/pub/linux/sources.redhat.com/ ftp://ftp-stud.fht-esslingen.de/pub/Mirrors/sourceware.org/ http://ftp-stud.fht-esslingen.de/pub/Mirrors/sourceware.org/ http://bo.mirror.garr.it/mirrors/sourceware.org/ ftp://bo.mirror.garr.it/mirrors/sourceware.org/ ftp://ftp.mirrorservice.org/sites/sources.redhat.com/pub/ http://www.mirrorservice.org/sites/sources.redhat.com/pub/ |
| 65 |
xemacs http://ftp.xemacs.org/pub/ ftp://ftp.sa.xemacs.org/pub/ |
| 66 |
xorg http://xorg.freedesktop.org/pub/ http://ftp.x.org/pub/ |
| 67 |
|
| 68 |
That would affect ~1000 URIs. |
| 69 |
Unfortunatly I didn't found any mirror for: |
| 70 |
- pecl.php.net |
| 71 |
- hackage.haskell.org |
| 72 |
- get.qt.nokia.com |
| 73 |
- launchpad |
| 74 |
|
| 75 |
But maybe we should still add them to thirdpartymirrors ? Look at 3dgamers, beyondunreal, bitbucket, github, gnome, kernel, xfce, vdrfiles and vdr-developerorg: they all only have one mirror ! |
| 76 |
|
| 77 |
For those afraid to add these mirrors and patch all affected ebuilds: no worry, mirrors.py can do it for you, and I already generated splitted patches generated from various thirdpartymirrors here: http://xf.iksaif.net/dev/gentoo/ |
| 78 |
|
| 79 |
Note that as part of https://bugs.gentoo.org/show_bug.cgi?id=405533 mgorny already commited a massive amount of patches adding mirror:// when the URI prefix was already present in thirdpartymirrors. |
| 80 |
|
| 81 |
Thanks, |
| 82 |
|
| 83 |
-- |
| 84 |
Corentin Chary |
| 85 |
http://xf.iksaif.net/ |
Archives