glibc, multilib-bootstrap & broken @system (?)

Message

_kopsu_ · Post by **_kopsu_** » Thu Oct 28, 2021 11:51 am

What does GLIBC multilib-bootstarp flag do?
I have boostrapped my system doing Gentoo stage1 install in early 2000's and after that there is lot's things that have changed and I have upgraded GLIBC many many times.
Few times I have had to do things in chroot as I have borked the system so badly. I'm not willing to build whole @world again (although I have Ryzen 2600X & 16GB RAM but it still takes too much time, days... )

Do I need help? Yes - I'm having problem emerging Blender (newest), Thunderbird, Firefox.
I'm thinking something is broken but I don't know what it is, as smaller things from portage compile fine, it's only bigger things that don't work. I have tried to compile with Clang and I have tried with GCC/CMAKE but it's same shit.
I'm so tired!

Code: Select all

Portage 3.0.28 (python 3.8.12-final-0, default/linux/amd64/17.1/desktop, gcc-11.2.0, glibc-2.33-r7, 5.14.5-gentoo x86_64)
=================================================================
System uname: Linux-5.14.5-gentoo-x86_64-AMD_Ryzen_5_2600X_Six-Core_Processor-with-glibc2.33
KiB Mem:    16336804 total,   1429940 free
KiB Swap:   33554428 total,  33528316 free
Timestamp of repository gentoo: Thu, 28 Oct 2021 00:45:01 +0000
sh bash 5.1_p8
ld GNU ld (Gentoo 2.37_p1 p0) 2.37
app-shells/bash:          5.1_p8::gentoo
dev-java/java-config:     2.3.1::gentoo
dev-lang/perl:            5.34.0-r3::gentoo
dev-lang/python:          3.9.7_p1::gentoo
dev-lang/rust-bin:        1.56.0::gentoo
dev-util/cmake:           3.21.3::gentoo
sys-apps/baselayout:      2.8::gentoo
sys-apps/openrc:          0.44.7::gentoo
sys-apps/sandbox:         2.27::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.71-r1::gentoo
sys-devel/automake:       1.16.5::gentoo
sys-devel/binutils:       2.37_p1::gentoo
sys-devel/gcc:            10.3.0-r2::gentoo, 11.2.0::gentoo
sys-devel/gcc-config:     2.4::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.3::gentoo
sys-kernel/linux-headers: 5.14::gentoo (virtual/os-headers)
sys-libs/glibc:           2.33-r7::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: webrsync
    sync-uri: rsync://rsync.at.gentoo.org/gentoo-portage
    priority: -1000
    sync-webrsync-verify-signature: true

Installed sets: @perl-cleanup
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=znver1 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0 /var/lib/hsqldb"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -march=znver1 -pipe"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--jobs 1 --load-average 3.5 --autounmask=y --autounmask-write=y"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildsyspkg config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news noinfo parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="https://mirrors.dotsrc.org/gentoo/ http://mirrors.dotsrc.org/gentoo/ ftp://mirrors.dotsrc.org/gentoo/ rsync://mirrors.dotsrc.org/gentoo/ https://ftp.gwdg.de/pub/linux/gentoo/ http://ftp.gwdg.de/pub/linux/gentoo/ ftp://ftp.gwdg.de/pub/linux/gentoo/ rsync://ftp.gwdg.de/gentoo/ ftp://mirror.netcologne.de/gentoo/ https://mirror.netcologne.de/gentoo/ http://mirror.netcologne.de/gentoo/ rsync://mirror.netcologne.de/gentoo/ http://gentoo.mirror.root.lu/ ftp://mirror.root.lu/gentoo/ https://mirror.leaseweb.com/gentoo/ http://mirror.leaseweb.com/gentoo/ rsync://mirror.leaseweb.com/gentoo/ https://ftp.snt.utwente.nl/pub/os/linux/gentoo http://ftp.snt.utwente.nl/pub/os/linux/gentoo ftp://ftp.snt.utwente.nl/pub/os/linux/gentoo rsync://ftp.snt.utwente.nl/gentoo"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="en fi"
MAKEOPTS="-j4"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="16k_voice 3dnow 64-bit-bfd S3TC X a52 aac aacplus aacs acl acpi all_sfx alsa amd64 amr animation-rtl apng archive artworkextra ass audiofile audioscrobbler auto-hinter autoipd avahi avcodec avconv avformat bash bash-completion bluetooth bluray bookmarks bs2b btrfs buspirate-spi bzip2 cairo cdda cddb cdio cdr cdrdao clang cli clutter colord contrast corefonts cpudetection crypt cryptsetup css ctags cube cups curl curlwrappers cvs cycles d3d9 dbus deep-sky demosaic development dhcp dhcpcd dirac dos download dri drm dso dts dv dvb dvd dvdnav dvdr efi efiemu elogind emboss encode epub eselect eselect-ldso ewf exif extensions extra-ciphers f2fs faac faad facebook fading-colors fam fastscroll fat fbcon_frontend_sdl fbcondecor ffmpeg ffmpegthumbnailer fftw flac flickr fontconfig foomatic frei0r fuse g3dvl gallium gbm gdbm gentoo-vm geo geoip gflags gif gimp git glamor glib glibc-omitfp glut google googledrive gphoto2 gpm gpu-accel graphicsmagick graphite gstreamer gtk gtk3 gudev gui guile gzip harfbuzz hddtemp hdri heif hires-icons hwaccel hwdb i18n iconv icu id3 id3tag infinality initramfs inotify introspection ipp_autosetup ipv6 irc iso javafx javascript jbig jfs jpeg jpeg2k jumbo-build keymap lastfm lcms lensfun libass libburn libcanberra libdrm libffi libglvnd libinput libkms libmpeg2 libmpv libnl libnotify libtirpc libv4l2 libvisual libxml2 live llvm lm-sensors lock lua52compat luajit lz4 lzma lzo mad map markdown matroska mdnsresponder-compat media-library minizip mms mmx mmxext mng modemmanager modern-top mp3 mp4 mpeg mpeg2 mpg123 msn mtp multilib musepack musicbrainz ncurses netloc network networkmanager nls nmap-update nptl nsplugin ntfs ntfsprogs nut obex odf offensive offlinehelp ogg ogg123 opencl openexr opengl openimageio openmp openntpd openrc openssl opensubdiv opus orc osmesa pam pango pcap pclm pcre pdf pdf-writer pdfimport perl perl-geoipupdate picasa playlist png policykit postproc postscript ppds printsupport projectm proprietary-codecs pulseaudio python qt5 quicktime rar raw readline realtime rle rpc rtmp rustfmt s3tc savedconfig schroedinger sdl seccomp session sftp sha1 sha2 sha3 shared-glapi shout smp sndfile speex split-usr sqlite sse sse2 sse3 sse4a ssh ssl staging stars startup-notification stream subversion sudo svg svg2 symlink syslog system-cairo system-icu system-jpeg system-llvm system-mesa system-python system-sqlite system-tbb taglib tcpd textures theora threads threadsafe thumbnail thunar tiff timezone tls-heartbeat totem transcode truetype tsmuxer ttf tty-helpers twolame udev udf udisks unicode unzip update_drivedb upnp upower usb utp v4l v8 vala vdpau vector-icons verify-sig vim-syntax vimeo vkd3d voices vorbis vpx vte vulkan vulkaninfo wav wavpack webgl webkit webkit2 webm webp webphoto webready webrtc-aec webserver widevine widgets wifi wma wma-fixed wmf workbench wxwidgets x264 x265 xattr xcb xcomposite xdg xfce xfs xft xml xmp xorg xpm xpresent xrandr xscreensaver xulrunner xv xvid xvidmode zeroconf zip zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2019" ALSA_CARDS="hda-intel" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" CAMERAS="canon* nikon*" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="emu pc efi-32 efi-64" INPUT_DEVICES="keyboard mouse libinput" KERNEL="linux" L10N="en fi" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AMDGPU" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-3 luajit" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-3 php7-4" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9 pypy3" RUBY_TARGETS="ruby27 ruby30" SANE_BACKENDS="canon pixma epson epson2 sharp" USERLAND="GNU" VIDEO_CARDS="amdgpu radeon radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RUSTFLAGS

mike155 · Post by **mike155** » Thu Oct 28, 2021 12:30 pm

What does GLIBC multilib-bootstrap flag do?

Code: Select all

# equery u glibc
...
multilib-bootstrap : Provide prebuilt libgcc.a and crt files if missing. Only needed for ABI switch.
...

Yes - I'm having problem emerging Blender (newest), Thunderbird, Firefox.

What kind of problems are you having? Compile errors? Can you show us error messages or a build log?

BTW: Your output of "emerge --info" shows many USE flags (400, if I count correctly). There are only 70 on my machine. Many of those USE flags should better be defined on a per-package basis in package.use. Take, for example the USE flags "python" and "perl". If you define those USE flags in make.conf, dozens of packages will be built with Perl and Python bindings. Most likely, you won't need those bindings. But the bindings come with a price tag: they pull in additional packages and they blow up the dependency tree, which may cause problems.

My recommendation: Move most of those USE flags to package.use. Leave only the USE flags in make.conf that should be applied to all packages. In package.use, define only USE flags you really want or need. The less USE flags you define, the leaner your system will be and the less problems you will experience. The key to success is: install everything you need, but not more. And stay as close to the default values as possible.

_kopsu_ · Post by **_kopsu_** » Thu Oct 28, 2021 12:53 pm

Thanks, Yes, compile & install errors.

Those USE flags have followed me and increased as my installation has matured (15 years maybe...) I'm cleaning up system but it's still lot of work...
Any idea or any scripts that could help me moving those USE flags from /etc/portage/make.conf to /etc/portage/package.use/packages ?

latest big things I have done are the unsymlink-lib thing & migrating to python3.9+pypy3 only system, I have switched profiles years ago and as I said sometimes system has needed to be bootstraped stage1.
I have done countless chroot env fixes along the way from 2003 (I remember I used tinderbox sometimes to get working files over broken ones)...
This system is mess!

Blender & Thunderbird:

There's another threads on here forums I have posted about TB & Blender issues.
Generally TB compiles fine but portage won't install it as it's not finding some locale/l8n files. It does not affect anything to change locale/l8n/intl settings.
The Blender compiles fine until 99% but at the end emerge throws following error:

Code: Select all

/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld: ../../lib/libbf_intern_ghost.a(GHOST_DisplayManagerX11.cpp.o): undefined reference to symbol 'XF86VidModeQueryVersion'
/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld: /usr/lib64/libXxf86vm.so: error adding symbols: DSO missing from command line
collect2: error: ld returned 1 exit status

and I have feeling that there are lot's of others that do the same. It does not make any difference to emerge again x11-libs/libXxf86vm-1.1.4-r2.

so I'm thinking that these problems relate to @system set but I have emerged/re-emerged @system set manytimes but nothing works.
or is it about permissions or something?

I'm so totally out of ideas....

_kopsu_ · Post by **_kopsu_** » Thu Oct 28, 2021 1:07 pm

and YES, i confess that I have done lot's wrong things along the way over the years... I even have used --nodeps and removed .so files straight (knowing that there's some risks involved... :twisted: :evil: )

mike155 · Post by **mike155** » Thu Oct 28, 2021 1:13 pm

_kopsu_ wrote:The Blender compiles fine until 99% but at the end emerge throws following error:

Code: Select all

/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld: ../../lib/libbf_intern_ghost.a(GHOST_DisplayManagerX11.cpp.o): undefined reference to symbol 'XF86VidModeQueryVersion'
/usr/lib/gcc/x86_64-pc-linux-gnu/11.2.0/../../../../x86_64-pc-linux-gnu/bin/ld: /usr/lib64/libXxf86vm.so: error adding symbols: DSO missing from command line
collect2: error: ld returned 1 exit status

That's probably a Blender bug, see: https://bugs.gentoo.org/764563 (Comment #9)

Show us more error messages!

_kopsu_ · Post by **_kopsu_** » Thu Oct 28, 2021 1:54 pm

Wow man. I feel ashamed, some people can use search feature and find things. I tried to google it and could not find anything good. Thanks!

The second problem was with installing Thunderbird:

Code: Select all

>>> Source compiled.
>>> Test phase [not enabled]: mail-client/thunderbird-78.14.0

>>> Install mail-client/thunderbird-78.14.0 into /var/tmp/portage/mail-client/thunderbird-78.14.0/image
 0:00.74 /usr/bin/gmake -C . -j12 -s -w install
 0:00.75 gmake: Entering directory '/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird_build'
 0:00.75 gmake[1]: Entering directory '/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird_build/comm/mail/installer'
 0:00.80 /var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird-78.14.0/python/mozbuild/mozbuild/action/file_generate.py:12: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
 0:00.80   import imp
 0:01.22 Error: $OBJDIR/comm/mail/installer/locale-manifest.in:4: Missing file(s): bin/chrome/en
 0:01.22 Error: $OBJDIR/comm/mail/installer/locale-manifest.in:5: Missing file(s): bin/chrome/en.manifest
 0:01.22 Error: $OBJDIR/comm/mail/installer/locale-manifest.in:6: Missing file(s): bin/chrome/fi
 0:01.22 Error: $OBJDIR/comm/mail/installer/locale-manifest.in:7: Missing file(s): bin/chrome/fi.manifest
 0:04.02 Traceback (most recent call last):
 0:04.02   File "/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird-78.14.0/toolkit/mozapps/installer/packager.py", line 249, in <module>
 0:04.02     main()
 0:04.03   File "/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird-78.14.0/toolkit/mozapps/installer/packager.py", line 208, in main
 0:04.03     copier.add(mozpath.join(respath, 'removed-files'), removals)
 0:04.03   File "/usr/lib/python3.9/contextlib.py", line 126, in __exit__
 0:04.03     next(self.gen)
 0:04.03   File "/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird-78.14.0/python/mozbuild/mozpack/errors.py", line 131, in accumulate
 0:04.03     raise AccumulatedErrors()
 0:04.03 mozpack.errors.AccumulatedErrors
 0:04.05 gmake[1]: *** [/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird-78.14.0/toolkit/mozapps/installer/packager.mk:25: stage-package] Error 1
 0:04.05 gmake[1]: Leaving directory '/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird_build/comm/mail/installer'
 0:04.05 gmake: *** [/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird-78.14.0/comm/mail/build.mk:16: install] Error 2
 0:04.05 gmake: Leaving directory '/var/tmp/portage/mail-client/thunderbird-78.14.0/work/thunderbird_build'

This is tougher case? something related to dev-python/sip or dev-python/pkgconfig ??? :twisted:

mike155 · Post by **mike155** » Thu Oct 28, 2021 2:06 pm

That's harder, indeed. We already have a thread: viewtopic-p-8626533.html

mike155 · Post by **mike155** » Thu Oct 28, 2021 3:27 pm

@_kopsu_: let's try to solve this issue in the other thread. I just posted a message there: viewtopic-p-8671785.html#8671785

_kopsu_ · Post by **_kopsu_** » Fri Oct 29, 2021 7:05 am

Ok, Mike. We'll do that. Thanks!

figueroa · Post by **figueroa** » Sat Oct 30, 2021 4:26 am

You might consider giving some priority to the excessive USE flags mentioned by mike155. In the beginning, I just added every required USE flag in make.conf because it seemed simple.

Over more or less the same amount of time as you, I have regularly removed USE flags from make.conf or moved them for individual packages into package.use. Doing this has significantly reduced system bloat and made my systems easier to maintain.

For example, on my amd64 desktop, these are the global USE flags in make.conf:

Code: Select all

USE="dv elogind gimp live nas oss postscript scanner tcpd v4l zstd -bluetooth -gnome -kde -pulseaudio -samba -systemd linguas_en linguas_en_US"

These may not be right for you (probably not) but may give you a target for something that is attainable. My package.use file lists about 67 different packages.

As I posted this, I spotted at least two use flag (live scanner) that should be moved into package.use for the two packages that need each of them; and I DID.

"euse -i flag" and "euse -I flag" can be helpful