Gentoo Archives: gentoo-dev

From: james <garftd@×××××××.net>
To: gentoo-dev@l.g.o
Subject: Re: [gentoo-dev] Repo mirror & CI project news: 'stable' gentoo branch, new repo stats, faster CI
Date: Sun, 05 Jun 2016 20:08:58
Message-Id: 5754941F.4010101@verizon.net
In Reply to: Re: [gentoo-dev] Repo mirror & CI project news: 'stable' gentoo branch, new repo stats, faster CI by "Daniel Campbell (zlg)"
1 On 06/05/2016 12:15 PM, Daniel Campbell (zlg) wrote:
2 > -----BEGIN PGP SIGNED MESSAGE-----
3 > Hash: SHA512
4 >
5 > On June 5, 2016 9:04:26 AM PDT, "Michał Górny" <mgorny@g.o> wrote:
6 >> Hello, everyone.
7 >>
8 >> I have the pleasure to announce that a few improvements have been
9 >> deployed by the Repository mirror & CI project today.
10 >>
11 >>
12 >> 1. The mirror for 'gentoo' repository [1] now has a default 'stable'
13 >> branch. It is updated automatically by the gentoo-ci checker,
14 >> and therefore always contains the latest repository state that has been
15 >> confirmed 'green' by CI. While this is far from perfect, it's the first
16 >> step towards preventing major issues from being deployed on our users.
17 >>
18 >> If you are already using the mirror, you will need to either switch
19 >> branch manually, or re-add it.
20 >>
21 >>
22 >> 2. The repository QA report [2] has been extended with some repository
23 >> statistics. In particular, the timestamp of the newest commit
24 >> and the number of valid (that is, those not dying in global scope)
25 >> ebuilds are reported. Additionally, the homepage link is now included
26 >> as well.
27 >>
28 >> This enables the Overlays team members to easily check which
29 >> repositories
30 >> are unmaintained and/or empty, and handle the issues more efficiently.
31 >> It can also be useful to users who want to figure out whether there's
32 >> a point in using a particular repository.
33 >>
34 >>
35 >> 3. I've tried to optimize the logic used to run QA checks on
36 >> repositories, and I think I was able to even the load better.
37 >> Additionally, I've repacked the git repositories to get rid of huge
38 >> number of loose objects.
39 >>
40 >> As a result, CI now runs faster. The gentoo-ci runs are down from 10-12
41 >> minutes to 7-8 minutes, and pull requests from 16-18 minutes to 9-14
42 >> minutes. However, I don't have exact results yet as the server is still
43 >> busy removing old files ;-).
44 >>
45 >>
46 >> 4. Finally, the mirroring code has been updated to correctly handle git
47 >> repositories for which 'master' is not the default branch.
48 >>
49 >>
50 >> Enjoy!
51 >>
52 >>
53 >> [1]:https://github.com/gentoo-mirror/gentoo
54 >> [2]:https://qa-reports.gentoo.org/output/repos/
55 >
56 > Sounds like a big improvement. I'm not too familiar with CI, so forgive me if this is obvious: should overlays now use the 'stable' branch as their primary remote, so they can ensure that any breakage introduced is caused by their own overlay instead of a flub by us? If so, then I wonder if this will help indirectly improve overlay quality.
57 >
58 > Being able to say "as of X commit, the tree is in good shape" is a big deal imo. Thanks for working to make that happen. Is there anything other devs can do to assist your development, or do we stick to the usual 'if in doubt talk to QA'?
59 > - --
60 > Sent from my Android device with K-9 Mail. Please excuse my brevity.
61
62
63 Well, my question is very basic. In the past, I've used euscan, the site
64 on gentooexperimental.org, or app-portage/euscan the software to
65 determine freshness of a package, for a variety of reasons. Is euscan
66 going to be tied-in or at least coordinated with CI for consistency?
67
68
69 James

Replies