Re: [gentoo-portage-dev] EbuildProcess logs poll-error to already removed $T (on AIX)

[Fabian Groffen]

On 25-03-2011 09:21:27 +0100, Michael Haubenwallner wrote:
> Hi Zac (et al),
>
> while this problem occurs on AIX only (for now?), I doubt this problem is
> introduced in prefix-portage.
>
> With recent prefix-portage-2.2.01.18125 (Fabian, how do you calculate the
> version numbers since moving to git?), the "EbuildProcess" spits this

see http://prefix.gentooexperimental.org:8000/portage-prefix/graph/

> every now and then during "emerge mime-types" fex:
>
>  * EbuildProcess received strange poll event: 16384
>
> While I don't understand (yet) why this is there on AIX at all, it does
> trigger an IOError when trying to log this message to $T/build.log after
> $WORKDIR has been cleaned up. When I avoid the logging of this message,
> everything (seems to) work fine.
>
> For the attached logfile, I've added these two lines to usr/lib/portage/bin/ebuild.sh:
> @@ -1,3 +1,5 @@
>  #!/big5tk/local/gprefix/bin/bash
>  # Copyright 1999-2011 Gentoo Foundation
>  # Distributed under the terms of the GNU General Public License v2
> +echo "ebuild.sh: $0 $@" >&2
> +echo "ebuild.sh: WORKDIR: ${WORKDIR}" >&2
> @@
>
> Any idea?
>
> Thank you!
> /haubi/
> --
> Michael Haubenwallner
> Gentoo on a different level

> WARNING: One or more repositories have missing repo_name entries:
>
> 	/big5tk/local/prefix-overlay/profiles/repo_name
> 	/big5tk/local/gentoo-x86/profiles/repo_name
>
> NOTE: Each repo_name entry should be a plain text file containing a
> unique name for the repository on the first line.
>
>
>
>  * IMPORTANT: 1 news items need reading for repository 'gentoo_prefix'.
>  * Use eselect news to read news items.
>
> Calculating dependencies  ... done!
>
> >>> Verifying ebuild manifests
>
> >>> Emerging (1 of 1) app-misc/mime-types-8
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh clean
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
>  * mime-types-8.tar.bz2 RMD160 SHA1 SHA256 size ;-) ...                  [ ok ]
>  * Package:    app-misc/mime-types-8
>  * Repository: gentoo_prefix
>  * Maintainer: djc@g.o net-mail@g.o
>  * USE:        elibc_AIX kernel_AIX ppc-aix prefix userland_GNU
>  * FEATURES:   nostrip preserve-libs
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh setup
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh unpack
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
> >>> Unpacking source...
> >>> Unpacking mime-types-8.tar.bz2 to /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
> >>> Source unpacked in /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh compile
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
> >>> Compiling source in /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work/mime-types-8 ...
> >>> Source compiled.
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh test
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
> >>> Test phase [not enabled]: app-misc/mime-types-8
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh install
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>
> >>> Install mime-types-8 into /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/image/big5tk/local/gprefix/ category app-misc
> >>> Completed installing mime-types-8 into /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/image/big5tk/local/gprefix/
>
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/misc-functions.sh
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>  * MiscFunctionsProcess received strange poll event: 16384
>
>
> >>> Installing (1 of 1) app-misc/mime-types-8
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh preinst
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/misc-functions.sh
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/app-misc/mime-types-8/work
>  * MiscFunctionsProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh prerm
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/._unmerge_/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh postrm
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/._unmerge_/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
> ebuild.sh: /big5tk/local/gprefix/usr/lib/portage/bin/ebuild.sh clean
> ebuild.sh: WORKDIR: /big5tk/tmp/gprefix/portage/._unmerge_/app-misc/mime-types-8/work
>  * EbuildProcess received strange poll event: 16384
>
>
>  * Messages for package app-misc/mime-types-8:
>  * EbuildProcess received strange poll event: 16384
>  * EbuildProcess received strange poll event: 16384
>
>
>  * Messages for package app-misc/mime-types-8:
>  * EbuildProcess received strange poll event: 16384
>  * EbuildProcess received strange poll event: 16384
>  * EbuildProcess received strange poll event: 16384
>  * EbuildProcess received strange poll event: 16384
>  * EbuildProcess received strange poll event: 16384
>  * MiscFunctionsProcess received strange poll event: 16384
>  * EbuildProcess received strange poll event: 16384
>  * MiscFunctionsProcess received strange poll event: 16384
> Traceback (most recent call last):
>   File "/big5tk/local/gprefix/usr/bin/emerge", line 44, in <module>
>     retval = emerge_main()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/main.py", line 1756, in emerge_main
>     myopts, myaction, myfiles, spinner)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/actions.py", line 439, in action_build
>     retval = mergetask.merge()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/Scheduler.py", line 1200, in merge
>     rval = self._merge()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/Scheduler.py", line 1544, in _merge
>     self._main_loop()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/Scheduler.py", line 1692, in _main_loop
>     self._poll_loop()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/PollScheduler.py", line 192, in _poll_loop
>     handler(f, event)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/SpawnProcess.py", line 205, in _output_handler
>     self._unregister_if_appropriate(event)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AbstractPollTask.py", line 58, in _unregister_if_appropriate
>     self.cancel()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 51, in cancel
>     self.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 41, in wait
>     self._wait_hook()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 123, in _wait_hook
>     self._exit_listener_stack.pop()(self)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/EbuildPhase.py", line 220, in _post_phase_exit
>     self.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 41, in wait
>     self._wait_hook()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 123, in _wait_hook
>     self._exit_listener_stack.pop()(self)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/TaskSequence.py", line 42, in _task_exit_handler
>     self.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 41, in wait
>     self._wait_hook()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 123, in _wait_hook
>     self._exit_listener_stack.pop()(self)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/CompositeTask.py", line 121, in _default_final_exit
>     return self.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 41, in wait
>     self._wait_hook()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 123, in _wait_hook
>     self._exit_listener_stack.pop()(self)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/EbuildBuild.py", line 260, in _build_exit
>     self.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 41, in wait
>     self._wait_hook()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 123, in _wait_hook
>     self._exit_listener_stack.pop()(self)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/CompositeTask.py", line 121, in _default_final_exit
>     return self.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 41, in wait
>     self._wait_hook()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 123, in _wait_hook
>     self._exit_listener_stack.pop()(self)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/Scheduler.py", line 1523, in _build_exit
>     self._schedule()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/PollScheduler.py", line 103, in _schedule
>     return self._schedule_tasks()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/Scheduler.py", line 1719, in _schedule_tasks
>     if q.schedule():
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/SequentialTaskQueue.py", line 55, in schedule
>     task.start()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 23, in start
>     self._start()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/PackageMerge.py", line 43, in _start
>     self.returncode = self.merge.merge()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/MergeListItem.py", line 147, in merge
>     retval = self._install_task.install()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/EbuildBuild.py", line 348, in install
>     rval = merge.execute()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/EbuildMerge.py", line 26, in execute
>     blockers=self.find_blockers)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/portage/dbapi/vartree.py", line 4064, in merge
>     mydbapi=mydbapi, prev_mtimes=prev_mtimes)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/portage/dbapi/vartree.py", line 3915, in merge
>     mydbapi=mydbapi, prev_mtimes=prev_mtimes)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/portage/dbapi/vartree.py", line 3936, in _merge
>     cleanup=cleanup, mydbapi=mydbapi, prev_mtimes=prev_mtimes)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/portage/dbapi/vartree.py", line 3341, in treewalk
>     others_in_slot=others_in_slot)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/portage/dbapi/vartree.py", line 1700, in unmerge
>     myebuildpath, "cleanrm")
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/Scheduler.py", line 737, in _dblink_ebuild_phase
>     ebuild_phase.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 40, in wait
>     self._wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/CompositeTask.py", line 72, in _wait
>     task.wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AsynchronousTask.py", line 40, in wait
>     self._wait()
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/SubProcess.py", line 76, in _wait
>     self.scheduler.schedule(self._reg_id)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/PollScheduler.py", line 286, in _schedule_wait
>     handler(f, event)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/SpawnProcess.py", line 224, in _dummy_handler
>     self._unregister_if_appropriate(event)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AbstractPollTask.py", line 56, in _unregister_if_appropriate
>     self._log_poll_exception(event)
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AbstractEbuildProcess.py", line 234, in _log_poll_exception
>     (self.__class__.__name__, event,)])
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/AbstractEbuildProcess.py", line 229, in _elog
>     log_path=self.settings.get("PORTAGE_LOG_FILE"))
>   File "/big5tk/local/gprefix/usr/lib/portage/pym/_emerge/PollScheduler.py", line 327, in _task_output
>     mode='ab')
> IOError: [Errno 2] No such file or directory: '/big5tk/tmp/gprefix/portage/._unmerge_/app-misc/mime-types-8/temp/build.log'
>


-- 
Fabian Groffen
Gentoo on a different level