View previous topic :: View next topic |
Author |
Message |
heppen n00b
Joined: 17 Sep 2021 Posts: 22
|
Posted: Wed Jun 15, 2022 12:03 pm Post subject: Why my compilation fails with jobs more than 1? |
|
|
Hi
I just built new PC lately. I'm glad (kind of) I can use Gentoo with it and compile smoothly with Ryzen 5 5600X. Unfortunately I noticed that, when compiling bigger packages like webengine or llvm, it fails using MAKEOPTS > 1
The solution is to MAKEOPTS="-j1" when emerging big packages. Then it will build successfully but damn... after a lot of hours.
Maybe anyone can help me find root of a cause and I will be able to emerging using at least 6-8 cores.
I don't even know where to start so... Maybe this will help a bit:
emerge --info '=net-libs/webkit-gtk-2.36.3::gentoo'
Code: | Portage 3.0.30 (python 3.9.13-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-11.3.0, glibc-2.35-r7, 5.17.14-gentoo-dist x86_64)
=================================================================
System Settings
=================================================================
System uname: Linux-5.17.14-gentoo-dist-x86_64-AMD_Ryzen_5_5600X_6-Core_Processor-with-glibc2.35
KiB Mem: 16284280 total, 9195136 free
KiB Swap: 16777212 total, 16467452 free
Timestamp of repository gentoo: Tue, 14 Jun 2022 19:30:01 +0000
Head commit of repository gentoo: a5f303b6af0e93a5afc1bb3acf4e1e3530acadd6
Timestamp of repository steam-overlay: Sun, 12 Jun 2022 09:02:56 +0000
Head commit of repository steam-overlay: 23a727b7f9d868134563b44dcf4ebba5dd46b5a2
sh bash 5.1_p16
ld GNU ld (Gentoo 2.37_p1 p2) 2.37
app-misc/pax-utils: 1.3.4::gentoo
app-shells/bash: 5.1_p16::gentoo
dev-lang/perl: 5.36.0::gentoo
dev-lang/python: 3.9.13::gentoo, 3.10.5::gentoo, 3.11.0_beta3::gentoo
dev-lang/rust-bin: 1.61.0::gentoo
dev-util/cmake: 3.23.2::gentoo
dev-util/meson: 0.62.2::gentoo
sys-apps/baselayout: 2.8::gentoo
sys-apps/sandbox: 2.29::gentoo
sys-apps/systemd: 251.2::gentoo
sys-devel/autoconf: 2.71-r1::gentoo
sys-devel/automake: 1.16.5::gentoo
sys-devel/binutils: 2.37_p1-r2::gentoo, 2.38-r2::gentoo
sys-devel/binutils-config: 5.4.1::gentoo
sys-devel/gcc: 11.3.0::gentoo
sys-devel/gcc-config: 2.5-r1::gentoo
sys-devel/libtool: 2.4.7::gentoo
sys-devel/llvm: 14.0.5::gentoo
sys-devel/make: 4.3::gentoo
sys-kernel/linux-headers: 5.18-r1::gentoo (virtual/os-headers)
sys-libs/glibc: 2.35-r7::gentoo
Repositories:
gentoo
location: /var/db/repos/gentoo
sync-type: rsync
sync-uri: rsync://rsync.gentoo.org/gentoo-portage
priority: -1000
sync-rsync-verify-max-age: 24
sync-rsync-verify-jobs: 1
sync-rsync-verify-metamanifest: yes
sync-rsync-extra-opts:
steam-overlay
location: /var/db/repos/steam-overlay
sync-type: git
sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
masters: gentoo
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=znver3 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -march=znver3 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -march=znver3 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -march=znver3 -pipe"
GENTOO_MIRRORS="https://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ https://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/ http://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/"
LANG="pl_PL.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j6"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="X a52 aac acl acpi activities alsa amd64 bluetooth branding bzip2 cairo cdda cdr cli crypt cups dbus declarative dri dts dvd dvdr encode exif flac fortran gdbm gif gpm gui iconv icu ipv6 jpeg kde kwallet lcms libglvnd libnotify libtirpc mad mng mp3 mp4 mpeg multilib ncurses nls nptl ogg opengl openmp pam pango pcre pdf plasma png policykit ppds pulseaudio qml qt5 readline sdl seccomp semantic-desktop spell split-usr ssl startup-notification svg systemd tiff truetype udev udisks unicode upower usb vaapi vorbis wayland widgets wxwidgets x264 xattr xcb xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2020" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-4 php8-0" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9" RUBY_TARGETS="ruby27" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LEX, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS |
emerge -pqv '=net-libs/webkit-gtk-2.36.3::gentoo'
Code: | [ebuild N ] net-libs/webkit-gtk-2.36.3 USE="X egl geolocation gstreamer introspection jpeg2k jumbo-build lcms libnotify (seccomp) spell systemd wayland (-aqua) -avif -examples -gamepad -gles2-only -gnome-keyring -gtk-doc -test"
* IMPORTANT: 1 news items need reading for repository 'gentoo'.
* Use eselect news read to view new items. |
build log: https://paste.centos.org/view/caaab18b
My PC specs:
AMD Ryzen 5 5600X
AMD Radeon RX 6650 XT
16GB RAM 3200MHz (but running without XMP to check if this is causing fails so 2400MHz currently)
If you need more information, please ask me. I hope someone can help me
Thanks and have a nice day! |
|
Back to top |
|
|
larrys Tux's lil' helper
Joined: 20 Jul 2020 Posts: 81 Location: New Jersey
|
Posted: Wed Jun 15, 2022 12:52 pm Post subject: |
|
|
Heppen,
In this particular case, your build failed with an Internal Compiler Error (ICE). That might be a distinct problem from too many cores.
Code: | In file included from /var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkitgtk-2.36.3/Source/JavaScriptCore/config.h:38,
from /var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkitgtk-2.36.3/Source/JavaScriptCore/dfg/DFGSpeculativeJIT64.cpp:26:
/var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkit-gtk-2.36.3_build/WTF/Headers/wtf/FastMalloc.h:314:53: internal compiler error: Segmentation fault
314 | void* operator new(size_t, void* p) { return p; } \
| ^
/var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkit-gtk-2.36.3_build/WTF/Headers/wtf/FastMalloc.h:347:5: note: in expansion of macro ‘WTF_MAKE_FAST_ALLOCATED_IMPL’
347 | WTF_MAKE_FAST_ALLOCATED_IMPL \
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
/var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkitgtk-2.36.3/Source/JavaScriptCore/runtime/JSGlobalObject.h:278:9: note: in expansion of macro ‘WTF_MAKE_FAST_ALLOCATED’
278 | WTF_MAKE_FAST_ALLOCATED;
| ^~~~~~~~~~~~~~~~~~~~~~~
0x17481f8 internal_error(char const*, ...)
???:0
0x884e73 ggc_set_mark(void const*)
???:0
0x7e9a47 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eb075 gt_ggc_mx_lang_tree_node(void*)
???:0
0xa8cc00 gt_ggc_mx_vec_tree_va_gc_(void*)
???:0
0x7ebad7 gt_ggc_mx_lang_type(void*)
???:0
0x7eadb0 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eaaff gt_ggc_mx_lang_tree_node(void*)
???:0
0x7ead9f gt_ggc_mx_lang_tree_node(void*)
???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7e9c53 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7e9f5d gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eadf8 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eacf1 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eadc1 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eaf53 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
???:0
0x7eab29 gt_ggc_mx_lang_tree_node(void*)
???:0
Please submit a full bug report,
with preprocessed source if appropriate.
Please include the complete backtrace with any bug report.
See <https://bugs.gentoo.org/> for instructions.
|
|
|
Back to top |
|
|
larrys Tux's lil' helper
Joined: 20 Jul 2020 Posts: 81 Location: New Jersey
|
Posted: Wed Jun 15, 2022 1:05 pm Post subject: |
|
|
heppen,
Please see this bug report: https://bugs.gentoo.org/843323 Includes this quote from _sam, one of the develelopers:
Quote: | Internal compiler errors (ICEs) are always bugs in the compiler, not the respective packages.
If it's reproducible, please:
1. do a memtest (please don't skip this)
2. then follow https://wiki.gentoo.org/wiki/Gcc-ICE-reporting-guide (we can help as needed). |
|
|
Back to top |
|
|
user Apprentice
Joined: 08 Feb 2004 Posts: 194
|
Posted: Wed Jun 15, 2022 1:53 pm Post subject: |
|
|
Hi
heppen.
Faulty memory?
Try to excepts this case by memory testing at OS layer for e. g. with sys-apps/memtester |
|
Back to top |
|
|
heppen n00b
Joined: 17 Sep 2021 Posts: 22
|
Posted: Wed Jun 15, 2022 4:36 pm Post subject: |
|
|
user wrote: | Hi
heppen.
Faulty memory?
Try to excepts this case by memory testing at OS layer for e. g. with sys-apps/memtester |
Hey, let's start with this test.
So... I did 2 testes, with 200M and 8G
First one passed:
Quote: |
heppen@gentoo ~ $ sudo memtester 200M 1
Hasło:
memtester version 4.5.1 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).
pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 200MB (209715200 bytes)
got 200MB (209715200 bytes), trying mlock ...locked.
Loop 1/1:
Stuck Address : ok
Random Value : ok
Compare XOR : ok
Compare SUB : ok
Compare MUL : ok
Compare DIV : ok
Compare OR : ok
Compare AND : ok
Sequential Increment: ok
Solid Bits : ok
Block Sequential : ok
Checkerboard : ok
Bit Spread : ok
Bit Flip : ok
Walking Ones : ok
Walking Zeroes : ok
Done.
|
unfortunately, the second one is not
Quote: |
heppen@gentoo ~ $ sudo memtester 8G 1
memtester version 4.5.1 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).
pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 8192MB (8589934592 bytes)
got 8192MB (8589934592 bytes), trying mlock ...locked.
Loop 1/1:
Stuck Address : ok
Random Value : ok
Compare XOR : ok
Compare SUB : ok
Compare MUL : ok
Compare DIV : ok
Compare OR : ok
Compare AND : ok
Sequential Increment: ok
Solid Bits : ok
Block Sequential : ok
Checkerboard : ok
Bit Spread : ok
Bit Flip : ok
Walking Ones : ok
Walking Zeroes : testing 98FAILURE: 0x100000020000000 != 0x20000000 at offset 0x11ce9448.
FAILURE: 0x800000020000000 != 0x20000000 at offset 0x11ce9608.
FAILURE: 0x100000020000000 != 0x20000000 at offset 0x11ce9e48.
FAILURE: 0x2000000020000000 != 0x20000000 at offset 0x5ac230c8.
FAILURE: 0x400000020000000 != 0x20000000 at offset 0x5ac23448.
FAILURE: 0x400000020000000 != 0x20000000 at offset 0x5ac24088.
FAILURE: 0x2000000020000000 != 0x20000000 at offset 0x5ac24208.
FAILURE: 0x20000000 != 0x8000000020000000 at offset 0xaa170638.
Done.
|
Is that mean, my memory is corrupted?
I'm gonna try to compile linux-tkg with Clang/LLVM instead of GCC and see if it will success because I could not complete it with GCC. |
|
Back to top |
|
|
sam_ Developer
Joined: 14 Aug 2020 Posts: 1670
|
Posted: Wed Jun 15, 2022 5:36 pm Post subject: |
|
|
Yeah, if any memtest fails, it means it's time to replace / return RAM. |
|
Back to top |
|
|
heppen n00b
Joined: 17 Sep 2021 Posts: 22
|
Posted: Wed Jun 15, 2022 5:54 pm Post subject: |
|
|
sam_ wrote: | Yeah, if any memtest fails, it means it's time to replace / return RAM. |
Oh right. Thanks I will return it then. It's kinda new sticks, maybe I will be able to replace them easy. |
|
Back to top |
|
|
sam_ Developer
Joined: 14 Aug 2020 Posts: 1670
|
Posted: Wed Jun 15, 2022 6:00 pm Post subject: |
|
|
heppen wrote: | sam_ wrote: | Yeah, if any memtest fails, it means it's time to replace / return RAM. |
Oh right. Thanks I will return it then. It's kinda new sticks, maybe I will be able to replace them easy. |
No problem! FWIW, a LOT of manufacturers will give RMAs and handle returns well, so you're in luck I hope! |
|
Back to top |
|
|
C5ace Guru
Joined: 23 Dec 2013 Posts: 472 Location: Brisbane, Australia
|
Posted: Thu Jun 16, 2022 2:02 am Post subject: |
|
|
Get "Matched Memory Sticks". _________________ Observation after 30 years working with computers:
All software has known and unknown bugs and vulnerabilities. Especially software written in complex, unstable and object oriented languages such as perl, python, C++, C#, Rust and the likes. |
|
Back to top |
|
|
heppen n00b
Joined: 17 Sep 2021 Posts: 22
|
Posted: Thu Jun 16, 2022 12:43 pm Post subject: |
|
|
C5ace wrote: | Get "Matched Memory Sticks". |
I have G.Skill FlareX which should be "AMD compatible". Good memory, but probably just my pair is wrong.
I contacted with my seller and I can RMA it without problems. Unfortunatelly I will be without PC for 2-3 weeks :/
Thanks all for help I really appreciate it. That's why we love Gentoo, not only OS is awesome but people who using it are also nice |
|
Back to top |
|
|
eccerr0r Watchman
Joined: 01 Jul 2004 Posts: 9645 Location: almost Mile High in the USA
|
Posted: Fri Jun 17, 2022 12:46 pm Post subject: |
|
|
Hope you don't end up with "hard disk corruption" that you find down the road because of the bad ram ... mostly don't blame the hard drive/ssd when you have bad ram...
This "AMD" vs "Intel" compatible RAM thing of the past is BS IMHO. "Intel" RAM is compatible with everything, "AMD" RAM is only compatible with certain machines which include AMD... Not sure what the status is with DDR3 or DDR4 however, as far as I know the "problem" was "solved" finally, though the issue on old SDRAM (, DDR, ?) and DDR2 modules was annoying. _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
|
heppen n00b
Joined: 17 Sep 2021 Posts: 22
|
Posted: Wed Jun 22, 2022 8:45 am Post subject: |
|
|
Hi guys
New ram just came to me, this time I bought 32GB 3600MHz. Just quick memtester:
Code: |
memtester version 4.5.1 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).
pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 8192MB (8589934592 bytes)
got 8192MB (8589934592 bytes), trying mlock ...locked.
Loop 1/1:
Stuck Address : ok
Random Value : ok
Compare XOR : ok
Compare SUB : ok
Compare MUL : ok
Compare DIV : ok
Compare OR : ok
Compare AND : ok
Sequential Increment: ok
Solid Bits : ok
Block Sequential : ok
Checkerboard : ok
Bit Spread : ok
Bit Flip : ok
Walking Ones : ok
Walking Zeroes : ok
8-bit Writes : ok
16-bit Writes : ok
Done.
|
So it seems, test is passed
Now time to real test! Gentoo, I'm coming! |
|
Back to top |
|
|
eccerr0r Watchman
Joined: 01 Jul 2004 Posts: 9645 Location: almost Mile High in the USA
|
Posted: Wed Jun 22, 2022 1:20 pm Post subject: |
|
|
but you only tested 1/4 of your memory... Might need to bump it up more! _________________ Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
Back to top |
|
|
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|