emerge app-emulation/xen-tools bails out with error

[Atom2]

Hi guys,
I am unable to emerge app-emulation/xen-tools on my system. The process fails with the full error message as follows:https://paste.pound-python.org/show/1Xf ... loth3q5lI/
The short story/summary is as follows: The build process appears not able to open an output file for no apparent reason - the messages start at line 803 in the full output linked above:

Code: Select all

make[6]: Entering directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware/rombios'
x86_64-pc-linux-gnu-gcc -o biossums biossums.c
x86_64-pc-linux-gnu-gcc -DBX_SMP_PROCESSORS=1 -E -P rombios.c > _rombios_.c
bcc -o rombios.s -C-c -D__i86__ -0 -S _rombios_.c
_rombios_.c:1: CPP-FATAL error: Cannot open output file
make[6]: *** [Makefile:24: BIOS-bochs-latest] Error 1
make[6]: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware/rombios'
make[5]: *** [Makefile:9: all] Error 2
make[5]: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware/rombios'
make[4]: *** [/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware/../../tools/Rules.mk:216: subdir-all-rombios] Error 2
make[4]: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware'
make[3]: *** [/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware/../../tools/Rules.mk:211: subdirs-all] Error 2
make[3]: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware'
make[2]: *** [Makefile:33: all] Error 2
make[2]: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/firmware'
make[1]: *** [/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/../tools/Rules.mk:216: subdir-all-firmware] Error 2
make[1]: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools'
make: *** [/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools/../tools/Rules.mk:211: subdirs-all] Error 2
make: Leaving directory '/var/tmp/portage/app-emulation/xen-tools-4.7.1-r8/work/xen-4.7.1/tools'

The tmpfs file system is 8GB in size and virtually empty when the build process starts, so I would rule out any lack of space. The file "_rombios_.c" even exists in the tmpfs after the error message pops up. I can't make much sense out of the error message ...

output of `emerge --info '=app-emulation/xen-tools-4.7.1-r8::gentoo'`:

Code: Select all

Portage 2.3.5 (python 2.7.12-final-0, hardened/linux/amd64/no-multilib, gcc-5.4.0, glibc-2.23-r3, 4.8.17-hardened-r2 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-4.8.17-hardened-r2-x86_64-Intel-R-_Xeon-R-_CPU_E5-2620_v2_@_2.10GHz-with-gentoo-2.3
KiB Mem:    16367336 total,  12165552 free
KiB Swap:    1966076 total,   1966076 free
Timestamp of repository gentoo: Sat, 06 May 2017 20:30:01 +0000
sh bash 4.3_p48-r1
ld GNU ld (Gentoo 2.26.1 p1.0) 2.26.1
app-shells/bash:          4.3_p48-r1::gentoo
dev-lang/perl:            5.24.1-r1::gentoo
dev-lang/python:          2.7.12::gentoo
dev-util/cmake:           3.7.2::gentoo
dev-util/pkgconfig:       0.28-r2::gentoo
sys-apps/baselayout:      2.3::gentoo
sys-apps/openrc:          0.24.2::gentoo
sys-apps/sandbox:         2.10-r3::gentoo
sys-devel/autoconf:       2.69::gentoo
sys-devel/automake:       1.15-r2::gentoo
sys-devel/binutils:       2.26.1::gentoo
sys-devel/gcc:            5.4.0-r3::gentoo
sys-devel/gcc-config:     1.7.3::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.2.1::gentoo
sys-kernel/linux-headers: 4.4::gentoo (virtual/os-headers)
sys-libs/glibc:           2.23-r3::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: --quiet --progress

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe -fomit-frame-pointer"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=native -O2 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--jobs=24 --load-average=24 --quiet-build y --buildpkg-exclude sys-kernel/hardened-sources"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs binpkg-multi-instance compress-build-logs config-protect-if-modified distlocks ebuild-locks fail-clean fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms split-elog split-log strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="--jobs=24 --load-average=24"
PKGDIR="/usr/portage/packages"
PORTAGE_COMPRESS=""
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--quiet --progress"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="acl aes amd64 apache2 avx bash-completion berkdb bzip2 cli cracklib crypt cxx gdbm hardened iconv ipv6 justify lm_sensors mmx mmxext modules ncurses nls nptl openmp pam pax_kernel pcre pie popcnt readline seccomp session sse sse2 sse3 sse4_1 sse4_2 ssl ssp ssse3 tcpd unicode urandom vhosts vim-syntax xattr xtpax zlib" ABI_X86="64" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GRUB_PLATFORMS="pc" KERNEL="linux" L10N="en" LINGUAS="en" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7" USERLAND="GNU" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
USE_PYTHON="2.7"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS_FLAGS

=================================================================
                        Package Settings
=================================================================

app-emulation/xen-tools-4.7.1-r8::gentoo was built with the following:
USE="hvm pam qemu qemu-traditional screen system-seabios -api -custom-cflags -debug -doc -flask (-ocaml) -ovmf -pygrub -python -sdl -static-libs -system-qemu" PYTHON_TARGETS="python2_7"
CFLAGS="-fno-strict-overflow"
CXXFLAGS="-march=native -O2 -pipe -fomit-frame-pointer -fno-strict-overflow"
LDFLAGS=""

output of `emerge -pqv '=app-emulation/xen-tools-4.7.1-r8::gentoo'`

Code: Select all

[ebuild   R   ] app-emulation/xen-tools-4.7.1-r8  USE="hvm pam qemu qemu-traditional screen system-seabios -api -custom-cflags -debug -doc -flask (-ocaml) -ovmf -pygrub -python -sdl -static-libs -system-qemu" PYTHON_TARGETS="python2_7" 

Any clues / pointers? Thanks Atom2

[zino]

Check out https://wiki.gentoo.org/wiki/Xen .

It seems that you still need a multilib profile in order to sucessfully compile xen-tools.

I remember that I had to switch from a no-multilib to a multilib profile when playing around with xen the last time (about half a year ago).

But be aware that a no-multilib to multilib transition isn't offically supported!

According to the wiki page I linked above you could also try to emerge xen-tools without the hvm use flag, but this isn't a suitable option when you want to run unmodified domUs.

[Atom2]

Hi zino,
thanks for your reply. I was aware of the wiki and the statement that one needs a multilib system in order to be able to use the hvm USE flag. In my view that information, however, is outdated:

According to this resolved bug this should no longer be required. The only issue still pertaining is that the no-multilib profile erroneously still masks the hvm USE flag which thus has to be unmasked. There's same discussion on the mask/unmask issues available here which also provides some guidance on how to unmask the hvm USE flag for a no-multilib system.

I also would not think that a no-multilib profile should result in an error from gcc that it can't open an output file - that would be very strange indeed. That's because according to my understanding, the gcc compiler is well able to produce 32bit code even on a no-multilib system. The restriction of no-multilib is only in not being able to run 32bit code - and any 32bit code would not only not be run in dom0, but we are anyways quiet far off being able to run any such code with gcc erroring out.

So I am still confused, but also have to admit that I did not play any further recently due to some time constraints which will hopefully be over in a week or so. I am thus still very interested in further input/discussions/insight on the subject.

Thanks Atom2

[zino]

Hello Atom2,

you're absolutely right. It is indeed possible to build xen-tools on a no-multilib system. Sorry for giving you bad advice there.

I actually tested building xen-tools with the hvm use flag enabled on two hardened systems that are identical besides the fact of one being multilib and the other one being no-multilib.

While going through your error log again I came up with two new (hopefully more useful) suggestions for you:
First, I've noticed that the particular version of xen-tools you we're having problems with isn't in the tree anymore. So maybe an upgrade to version 4.7.2 (the version I tested) or even 4.8.1 would help.
Second, since you apparently applied a user provided patch to xen-tools I'd suggest to try to build xen-tools without this specific patch.

Of course, I'm only speculating but I'd say it's worth a try.

Greetings zino