| 1 |
2 other classes of tests you may want to consider : |
| 2 |
|
| 3 |
- network/internet accessibility required tests |
| 4 |
- markers for tests that are known/expected to fail under many conditions |
| 5 |
and are not worth end-user-testing, but end-users can force-running any way |
| 6 |
if they really want to see the individual failures. |
| 7 |
|
| 8 |
|
| 9 |
On 2 May 2013 13:18, Ryan Hill <dirtyepic@g.o> wrote: |
| 10 |
|
| 11 |
> On Wed, 1 May 2013 10:14:02 +0200 |
| 12 |
> Ralph Sennhauser <sera@g.o> wrote: |
| 13 |
> |
| 14 |
> > On Tue, 30 Apr 2013 21:25:40 -0600 |
| 15 |
> > Ryan Hill <dirtyepic@g.o> wrote: |
| 16 |
> > |
| 17 |
> > > I'm also going to rename the "test" flag to "regression-test" or |
| 18 |
> > > something similar to get it out of FEATURES="test" control. The |
| 19 |
> > > testsuite is a huge time-suck and only useful to developers IMO |
| 20 |
> > > (always expected to fail and primarily meant to be used to check for |
| 21 |
> > > regressions between patchsets). I'm a big supporter of |
| 22 |
> > > FEATURES="test" by default and I think this is a small step towards |
| 23 |
> > > that. |
| 24 |
> > |
| 25 |
> > This step is so tiny that we wont ever reach the goal like this. |
| 26 |
> |
| 27 |
> I was hoping it would set a precedent and then people would start thinking |
| 28 |
> of |
| 29 |
> splitting up test into categories, maybe even start a thread about it ;). |
| 30 |
> |
| 31 |
> > Let's |
| 32 |
> > start to properly classify test into categories, like for instance |
| 33 |
> > |
| 34 |
> > - expected to be run (cheap, no silly deps) |
| 35 |
> > - good thing if run (still reasonable wrt resources) (current src_test) |
| 36 |
> > - if you are the maintainer or simply curious. (boost, jtreg and |
| 37 |
> > friends) |
| 38 |
> |
| 39 |
> Something like "dev-test" or "qa-test"? I can think of a couple packages.. |
| 40 |
> |
| 41 |
> > ... and improve on how to configure Portage whether to run tests of any |
| 42 |
> > given category. |
| 43 |
> |
| 44 |
> Yeah I'd love to be able to do something like emerge TESTS="dev qa |
| 45 |
> system -extradeps -expensive" @world. |
| 46 |
> |
| 47 |
> |
| 48 |
> -- |
| 49 |
> gcc-porting |
| 50 |
> toolchain, wxwidgets |
| 51 |
> @ gentoo.org |
| 52 |
> |
| 53 |
|
| 54 |
|
| 55 |
|
| 56 |
-- |
| 57 |
Kent |
| 58 |
|
| 59 |
perl -e "print substr( \"edrgmaM SPA NOcomil.ic\\@tfrken\", \$_ * 3, 3 ) |
| 60 |
for ( 9,8,0,7,1,6,5,4,3,2 );" |
| 61 |
|
| 62 |
http://kent-fredric.fox.geek.nz |
Archives