Re: [gentoo-dev] Re: Gentoo Janitor scripts

[Mart Raudsepp]

On K, 2012-02-22 at 09:48 +0100, Corentin Chary wrote:
> I did a quick script to count most used prefixes in SRC_URI yesterday
> (https://github.com/iksaif/portage-janitor/blob/master/mirrors.py)
>
> Here is the (filtered) result:
>
> $ eix --only-names | python mirrors.py --count
> 960     http://dev.gentoo.org
> 372     http://xorg.freedesktop.org
> 372     http://xorg.freedesktop.org/releases
> 372     http://xorg.freedesktop.org/releases/individual
> 306     http://pear.php.net
> 306     http://pear.php.net/get
> 256     http://oss.tresys.com
> 255     http://oss.tresys.com/files
> 255     http://oss.tresys.com/files/refpolicy
> 225     http://hackage.haskell.org/packages
> 225     http://hackage.haskell.org/packages/archive
> 225     http://hackage.haskell.org
> 206     http://ftp.xemacs.org
> 201     https://github.com
> 196     http://ftp.xemacs.org/pub
> 196     http://ftp.xemacs.org/pub/xemacs
> 193     http://ftp.xemacs.org/pub/xemacs/packages
> 181     http://gstreamer.freedesktop.org
> 181     http://gstreamer.freedesktop.org/src
> 175     http://launchpad.net
> 175     http://linuxgazette.net
> 143     http://github.com
> 130     http://pear.horde.org
> 130     http://pear.horde.org/get
> 101     http://savannah.nongnu.org/download
> 101     http://savannah.nongnu.org
> 100     http://get.qt.nokia.com
> 97      ftp://sources.redhat.com/pub
> 97      ftp://sources.redhat.com
> 96      http://get.qt.nokia.com/qt
> 95      http://get.qt.nokia.com/qt/source
> 90      http://download.gna.org
> 75      http://pecl.php.net
> 75      http://pecl.php.net/get
> 72      http://components.ez.no/get
> 72      http://components.ez.no
> 69      https://fedorahosted.org
> 67      http://www.phrack.org/archives
> 67      http://www.phrack.org/archives/tgz
> 67      http://www.phrack.org
>
>
> From that output we can easilly find out new entries to
> thirdpartymirrors, for example:
> gentoo-dev    http://dev.gentoo.org
> xorg             http://xorg.freedesktop.org
> gna              http://download.gna.org
> pecl             http://pecl.php.net
> pear             http://pear.php.net
> github          https://github.com http://github.com
> xemacs       http://ftp.xemacs.org/pub/ ftp://ftp.sa.xemacs.org/pub/
> launchpad    http://launchpad.net
> redhat         ftp://sources.redhat.com/pub/ (and probably others !)
> etc...
>
> The good part is that once you've modified thirdpartymirrors with new
> mirrors, running mirrors.py --all will generate a big patch for all
> your ebuilds to use those new mirrors !

If you want this, then you should better figure out actual upstream
mirroring systems and their list of mirrors they would want us to use.
Until such, this seems to be just for shortening SRC_URI addresses when
an upstream tarball domain name or path repeats, and that's definitely
not what thirdpartymirrors is for.


Best,
Mart Raudsepp