[gentoo-alt] bootstrap-prefix.sh: Parallel make error with bison?

[Wolfram Kahl]

Hello,

  I just started an attempt at installing a Gentoo prefix with bootstrap-prefix.sh,
and hit a problem that looks like inadmissible make parallelisation:
It recognised the 8 cores, and I accepted the proposed 5 for -j;
the following four log fragments (separated by ``[...]'')
look like three parallel make subprocesses are trying to use and remove
the same stamp file at almost the same time, triggering a race condition:

==========================================================================
config.status: creating po/Makefile
config.status: executing tests/atconfig commands
>>> Source configured.
>>> Compiling source in /nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2 ...
make -j5 
rm -f examples/extracted.stamp examples/extracted.stamp.tmp
rm -f lib/alloca.h-t lib/alloca.h && \
        { echo '/* DO NOT EDIT! GENERATED AUTOMATICALLY! */'; \
          cat ./lib/alloca.in.h; \
        } > lib/alloca.h-t && \
        mv -f lib/alloca.h-t lib/alloca.h
rm -f lib/configmake.h-t && \
        { echo '/* DO NOT EDIT! GENERATED AUTOMATICALLY! */'; \
          echo '#define PREFIX "/nfs/u30/kahl/GentooPrefix2014/usr"'; \
[...]
        mv lib/spawn.h-t lib/spawn.h
make[1]: Entering directory `/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
rm -f examples/extracted.stamp examples/extracted.stamp.tmp
make[1]: Entering directory `/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
rm -f examples/extracted.stamp examples/extracted.stamp.tmp
make[1]: Entering directory `/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
rm -f examples/extracted.stamp examples/extracted.stamp.tmp
touch examples/extracted.stamp.tmp
touch examples/extracted.stamp.tmp
touch examples/extracted.stamp.tmp
VERSION="3.0.2" /bin/true ./examples/extexi ./doc/bison.texi -- examples/calc++/calc++-driver.cc examples/calc++/calc++-driver.hh examples/calc++/calc++-scanner.ll examples
/calc++/calc++.cc examples/calc++/calc++-parser.yy examples/mfcalc/calc.h examples/mfcalc/mfcalc.y examples/rpcalc/rpcalc.y
VERSION="3.0.2" /bin/true ./examples/extexi ./doc/bison.texi -- examples/calc++/calc++-driver.cc examples/calc++/calc++-driver.hh examples/calc++/calc++-scanner.ll examples
/calc++/calc++.cc examples/calc++/calc++-parser.yy examples/mfcalc/calc.h examples/mfcalc/mfcalc.y examples/rpcalc/rpcalc.y
VERSION="3.0.2" /bin/true ./examples/extexi ./doc/bison.texi -- examples/calc++/calc++-driver.cc examples/calc++/calc++-driver.hh examples/calc++/calc++-scanner.ll examples
/calc++/calc++.cc examples/calc++/calc++-parser.yy examples/mfcalc/calc.h examples/mfcalc/mfcalc.y examples/rpcalc/rpcalc.y
mv examples/extracted.stamp.tmp examples/extracted.stamp
mv examples/extracted.stamp.tmp examples/extracted.stamp
mv examples/extracted.stamp.tmp examples/extracted.stamp
make[1]: Leaving directory `/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
mv: cannot stat `examples/extracted.stamp.tmp': No such file or directory
make[1]: *** [examples/extracted.stamp] Error 1
make[1]: Leaving directory `/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
rm -f lib/stdio.h-t lib/stdio.h && \
        { echo '/* DO NOT EDIT! GENERATED AUTOMATICALLY! */' && \
          sed -e 's|@''GUARD_PREFIX''@|GL|g' \
              -e 's|@''INCLUDE_NEXT''@|include_next|g' \
[...]
              -e '/definition of _GL_ARG_NONNULL/r lib/arg-nonnull.h' \
              -e '/definition of _GL_WARN_ON_USE/r lib/warn-on-use.h'; \
        } > lib/stdio.h-t && \
        mv lib/stdio.h-t lib/stdio.h
mv: cannot stat `examples/extracted.stamp.tmp': No such file or directory
make[1]: *** [examples/extracted.stamp] Error 1
make[1]: Leaving directory `/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
make: *** [examples/mfcalc/mfcalc.y] Error 2
make: *** Waiting for unfinished jobs....
make: *** [examples/rpcalc/rpcalc.y] Error 2
 * ERROR: sys-devel/bison-3.0.2::gentoo_prefix failed (compile phase):
 *   emake failed
 * 
 * If you need support, post the output of `emerge --info '=sys-devel/bison-3.0.2::gentoo_prefix'`,
 * the complete build log and the output of `emerge -pqv '=sys-devel/bison-3.0.2::gentoo_prefix'`.
 * The complete build log is located at '/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/temp/build.log'.
 * The ebuild environment file is located at '/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/temp/environment'.
 * Working directory: '/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'
 * S: '/nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/work/bison-3.0.2'

>>> Failed to emerge sys-devel/bison-3.0.2, Log file:
[...]
Hmmmm, I was already afraid of this to happen.  Running
  /nfs/u30/kahl/GentooPrefix2014/bin/bash ./bootstrap-prefix.sh "/nfs/u30/kahl/GentooPrefix2014" stage3
somewhere failed :(  Details might be found in the build log:
  /nfs/u30/kahl/GentooPrefix2014/var/tmp/portage/sys-devel/bison-3.0.2/temp/build.log
I have no clue, really.  Please find friendly folks in #gentoo-prefix on
irc.gentoo.org, gentoo-alt@l.g.o mailing list, or file a bug
at bugs.gentoo.org under Gentoo/Alt, Prefix Support.  This is most
inconvenient, and it crushed my ego.  Sorry, I give up.


==========================================================================

Is my impression right that ``make -j1'' would likely fix this?
If yes, how can I get it into the ``General Bootstrap Process''
only for bison?
And is there any way of restarting it from bison?

(I know I am working over NFS --- a year ago
 (apparently before the ``General Bootstrap Process'' existed?)
 I tried a more manual installation with /var/tmp/kahl/gentoo
 symbolically linked as $PREFIX/var/tmp :
 This was quite a hassle, and on the machine where I am trying this now,
 they are apparently cleaning out old files from /var/tmp,
 so I would have to do some trickery to make this safe.
 In any case it would still be nice if the ``General Bootstrap Process''
 supported such ``virtual mounts'' for /tmp and /var/tmp.
)


Thanks!

Wolfram