Re: [gentoo-dev] A feedback about the CI bug reporting system

[Robin H. Johnson]

On Fri, Nov 06, 2020 at 08:21:39AM +0100, Agostino Sarubbo wrote:
> Hello all,
>
> 6 months have been passed after the CI system started to file bug reports.
> ~ 4700 bugs have been submitted
>
> We _know_ that atm is not possible to set a specific summary, instead a
> generic summary is used in case of compile failures and test failures.
> There are also some documented limitations.
>
> If there aren't much commits, usually you get the bug after 30 minutes after
> the commit and this looks to be nice.
I value the quantitative knowledge of "there is some problem", but I
absolutely want process improvement to tell me "there is XYZ specific
problem" (quantitative).

Can you please tell us what you need to let others contribute to
improving the quality of the reports from your CI system?
I will happily submit patches to help improve things that matter to me
(recently, I've been repeatedly bitten by packages where DEPEND needs to
specify a newer min version; the current min version in the tree is
fine, but since I have an older version installed, and the DEPEND
statement wasn't updated, I get a failure until I re-order the updates).

Examples:
- It needs $ABC added
- If it could use $SOMETHING, it could run on a large build farm results
  in 2 minutes instead of 30 minutes.
- Compile fails on XYZ arch

No single CI system will ever continue to be successful with a growing
ecosystem if it's limited to a single build system. Sooner or later they
all need to be able to build on a farm.

>
> Since there are conflicting opinions I would like to know if you find it
> useful or not.
>
> More info about the project here:
> https://blogs.gentoo.org/ago/2020/07/04/gentoo-tinderbox/
>
> Please keep me CC'ed
>
> Thank you
> Agostino
>
>
>

-- 
Robin Hugh Johnson
Gentoo Linux: Dev, Infra Lead, Foundation Treasurer
E-Mail   : robbat2@g.o
GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136