Gentoo Archives: gentoo-dev

From: Francesco Riosa <vivo@g.o>
To: gentoo-dev@l.g.o
Subject: Re: [gentoo-dev] mirroring distfiles/patches on patches.gentoo.org
Date: Tue, 24 Oct 2006 07:48:47
Message-Id: 453DC63B.5050807@gentoo.org
In Reply to: [gentoo-dev] mirroring distfiles/patches on patches.gentoo.org by Stefan Schweizer
1 Stefan Schweizer ha scritto:
2 > To my fellow Gentoo Devlopers and Users,
3 >
4 > The Gentoo Infrastructure team proposed this idea in june 2006
5 > * Reduce mirror time for Gentoo specific patches/tarballs
6 > * Offer an official location for Gentoo specific patches/tarballs
7 > (Instead of using dev.g.o, this would be the official place)
8 > * Offer a distributed (3+ servers) mirror rotation for this
9 >
10 > This would be the "official" location for those distfiles when infra makes
11 > it available. I am asking them for status reports on this you will maybe
12 > see some here :)
13 >
14 > But for the meantime I am using http://gentooexperimental.org/~genstef/dist
15 > for this purpose. The reason is that I can remove and add stuff there
16 > myself and can keep control of what gets deleted. I can use my favourite
17 > scripts to create distfiles and keep them ordered. For example I am using
18 > this for firefox-2.0. This workaround I initially had to use when I
19 > discovered a bug in the mirroring script that was annoying me regularly.
20 > The mirroring script does ignore all RESTRICT=mirror SRC_URIs even those at
21 > mirror://gentoo/.
22 > "Bug 121332 ppp patch missing from distfiles"
23 > "Bug 100260 The File foo2zjs-20050319.tar.gz missed on Gentoo-Mirrors"
24 > Those get uploaded and look fine but after 6 months they are suddenly being
25 > removed by the script.
26 >
27 > Initially of course I needed a solution of that bug badly and because the
28 > mirrors kept dropping it I have just uploaded it to dev.gentoo.org in lack
29 > of any other proper place to put it. But using dev.gentoo.org is deprecated
30 > by our infra because the server may not be able to cope with the traffic.
31 > Fortunately later I was able to get an account on Patrick Lauers
32 > development server http://gentooexperimental.org/~genstef/dist to upload my
33 > distfiles there.
34 >
35 > So this is my current practice and I am eagerly waiting for infra to allow
36 > me to use an "official" service instead of my bandaid. Unfortunately some
37 > people are really afraid of what I am doing and want to harass me into
38 > using the mirror://gentoo that I do not want to use. This mail is dedicated
39 > to explain the issue to those people.
40 >
41 > Please, dont argue such discussions that only give you personal satisfaction
42 > of being correct or an excuse to annoy other people. Useless yelling at
43 > each other because of a minority where opinions differ is misplaced in a
44 > project that is driven by volunteers. That is also why I have stopped and
45 > written this mail.
46 >
47 > But I can see that you are a bit frustrated because you did not get your way
48 > through. So here is a guide of what you can do. I will gladly stop using
49 > workarounds when I am allowed to have an equally bugfree and fast workflow
50 > as currently. What you can do:
51 >
52 > 1) write a patch for portage to allow granular mirror restrictions for the
53 > SRC_URI and work with infra on improving the mirroring script to not ignore
54 > mirror://gentoo in mirror-restricted ebuilds. Also for this solution the
55 > time for a distfile in /space/distfiles-local to hit the first mirror
56 > should be equal to the time for ebuilds to get into the rsync rotation so
57 > that problems for users who are too early.
58 >
59 > 2) get infra to provide patches.gentoo.org as a permanent solution that I
60 > have asked for since march 2005 and it sometimes even looked close to
61 > getting it on bug 85098.
62 >
63 2) ++ , has I told you before genstef I like very much this second one.
64
65 Take it also on a mirror point of view, the number of files in distfiles
66 is already huge, this has been discussed in the past.
67 To put all our patches.tbz on mirror would increment the number of files
68 considerably and there will be people whining or stopping mirror for this.
69 With reiserfs 3 becoming obsolete and reiser 4 with an uncertain future
70 this may become un-acceptable.
71
72 Also I'm offering again, some space and bandwidth in germany
73 , the box is already controlled by two devs (one being me)
74
75 regards,
76 Francesco Riosa
77 --
78 gentoo-dev@g.o mailing list

Replies

Subject Author
[gentoo-dev] Re: mirroring distfiles/patches on patches.gentoo.org Markus Ullmann <jokey@g.o>