Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Why my compilation fails with jobs more than 1?
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
heppen
n00b
n00b


Joined: 17 Sep 2021
Posts: 22

PostPosted: Wed Jun 15, 2022 12:03 pm    Post subject: Why my compilation fails with jobs more than 1? Reply with quote

Hi
I just built new PC lately. I'm glad (kind of) I can use Gentoo with it and compile smoothly with Ryzen 5 5600X. Unfortunately I noticed that, when compiling bigger packages like webengine or llvm, it fails using MAKEOPTS > 1
The solution is to MAKEOPTS="-j1" when emerging big packages. Then it will build successfully but damn... after a lot of hours.
Maybe anyone can help me find root of a cause and I will be able to emerging using at least 6-8 cores.

I don't even know where to start so... Maybe this will help a bit:

emerge --info '=net-libs/webkit-gtk-2.36.3::gentoo'

Code:
Portage 3.0.30 (python 3.9.13-final-0, default/linux/amd64/17.1/desktop/plasma/systemd, gcc-11.3.0, glibc-2.35-r7, 5.17.14-gentoo-dist x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-5.17.14-gentoo-dist-x86_64-AMD_Ryzen_5_5600X_6-Core_Processor-with-glibc2.35
KiB Mem:    16284280 total,   9195136 free
KiB Swap:   16777212 total,  16467452 free
Timestamp of repository gentoo: Tue, 14 Jun 2022 19:30:01 +0000
Head commit of repository gentoo: a5f303b6af0e93a5afc1bb3acf4e1e3530acadd6
Timestamp of repository steam-overlay: Sun, 12 Jun 2022 09:02:56 +0000
Head commit of repository steam-overlay: 23a727b7f9d868134563b44dcf4ebba5dd46b5a2

sh bash 5.1_p16
ld GNU ld (Gentoo 2.37_p1 p2) 2.37
app-misc/pax-utils:        1.3.4::gentoo
app-shells/bash:           5.1_p16::gentoo
dev-lang/perl:             5.36.0::gentoo
dev-lang/python:           3.9.13::gentoo, 3.10.5::gentoo, 3.11.0_beta3::gentoo
dev-lang/rust-bin:         1.61.0::gentoo
dev-util/cmake:            3.23.2::gentoo
dev-util/meson:            0.62.2::gentoo
sys-apps/baselayout:       2.8::gentoo
sys-apps/sandbox:          2.29::gentoo
sys-apps/systemd:          251.2::gentoo
sys-devel/autoconf:        2.71-r1::gentoo
sys-devel/automake:        1.16.5::gentoo
sys-devel/binutils:        2.37_p1-r2::gentoo, 2.38-r2::gentoo
sys-devel/binutils-config: 5.4.1::gentoo
sys-devel/gcc:             11.3.0::gentoo
sys-devel/gcc-config:      2.5-r1::gentoo
sys-devel/libtool:         2.4.7::gentoo
sys-devel/llvm:            14.0.5::gentoo
sys-devel/make:            4.3::gentoo
sys-kernel/linux-headers:  5.18-r1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.35-r7::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-metamanifest: yes
    sync-rsync-extra-opts:

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=znver3 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -march=znver3 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -march=znver3 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -march=znver3 -pipe"
GENTOO_MIRRORS="https://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ http://mirror.eu.oneandone.net/linux/distributions/gentoo/gentoo/ https://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/ http://ftp-stud.hs-esslingen.de/pub/Mirrors/gentoo/"
LANG="pl_PL.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j6"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="X a52 aac acl acpi activities alsa amd64 bluetooth branding bzip2 cairo cdda cdr cli crypt cups dbus declarative dri dts dvd dvdr encode exif flac fortran gdbm gif gpm gui iconv icu ipv6 jpeg kde kwallet lcms libglvnd libnotify libtirpc mad mng mp3 mp4 mpeg multilib ncurses nls nptl ogg opengl openmp pam pango pcre pdf plasma png policykit ppds pulseaudio qml qt5 readline sdl seccomp semantic-desktop spell split-usr ssl startup-notification svg systemd tiff truetype udev udisks unicode upower usb vaapi vorbis wayland widgets wxwidgets x264 xattr xcb xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2020" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-4 php8-0" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9" RUBY_TARGETS="ruby27" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LEX, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS


emerge -pqv '=net-libs/webkit-gtk-2.36.3::gentoo'

Code:
[ebuild  N    ] net-libs/webkit-gtk-2.36.3  USE="X egl geolocation gstreamer introspection jpeg2k jumbo-build lcms libnotify (seccomp) spell systemd wayland (-aqua) -avif -examples -gamepad -gles2-only -gnome-keyring -gtk-doc -test"

 * IMPORTANT: 1 news items need reading for repository 'gentoo'.
 * Use eselect news read to view new items.


build log: https://paste.centos.org/view/caaab18b

My PC specs:

AMD Ryzen 5 5600X
AMD Radeon RX 6650 XT
16GB RAM 3200MHz (but running without XMP to check if this is causing fails so 2400MHz currently)

If you need more information, please ask me. I hope someone can help me :)
Thanks and have a nice day!
Back to top
View user's profile Send private message
larrys
Tux's lil' helper
Tux's lil' helper


Joined: 20 Jul 2020
Posts: 81
Location: New Jersey

PostPosted: Wed Jun 15, 2022 12:52 pm    Post subject: Reply with quote

Heppen,
In this particular case, your build failed with an Internal Compiler Error (ICE). That might be a distinct problem from too many cores.

Code:
In file included from /var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkitgtk-2.36.3/Source/JavaScriptCore/config.h:38,
                 from /var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkitgtk-2.36.3/Source/JavaScriptCore/dfg/DFGSpeculativeJIT64.cpp:26:
/var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkit-gtk-2.36.3_build/WTF/Headers/wtf/FastMalloc.h:314:53: internal compiler error: Segmentation fault
  314 |     void* operator new(size_t, void* p) { return p; } \
      |                                                     ^
/var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkit-gtk-2.36.3_build/WTF/Headers/wtf/FastMalloc.h:347:5: note: in expansion of macro ‘WTF_MAKE_FAST_ALLOCATED_IMPL’
  347 |     WTF_MAKE_FAST_ALLOCATED_IMPL \
      |     ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
/var/tmp/portage/net-libs/webkit-gtk-2.36.3/work/webkitgtk-2.36.3/Source/JavaScriptCore/runtime/JSGlobalObject.h:278:9: note: in expansion of macro ‘WTF_MAKE_FAST_ALLOCATED’
  278 |         WTF_MAKE_FAST_ALLOCATED;
      |         ^~~~~~~~~~~~~~~~~~~~~~~
0x17481f8 internal_error(char const*, ...)
        ???:0
0x884e73 ggc_set_mark(void const*)
        ???:0
0x7e9a47 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eb075 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0xa8cc00 gt_ggc_mx_vec_tree_va_gc_(void*)
        ???:0
0x7ebad7 gt_ggc_mx_lang_type(void*)
        ???:0
0x7eadb0 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eaaff gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7ead9f gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7e9c53 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7e9f5d gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eadf8 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eacf1 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eadc1 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eaf53 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7ea438 gt_ggc_mx_lang_tree_node(void*)
        ???:0
0x7eab29 gt_ggc_mx_lang_tree_node(void*)
        ???:0
Please submit a full bug report,
with preprocessed source if appropriate.
Please include the complete backtrace with any bug report.
See <https://bugs.gentoo.org/> for instructions.
Back to top
View user's profile Send private message
larrys
Tux's lil' helper
Tux's lil' helper


Joined: 20 Jul 2020
Posts: 81
Location: New Jersey

PostPosted: Wed Jun 15, 2022 1:05 pm    Post subject: Reply with quote

heppen,
Please see this bug report: https://bugs.gentoo.org/843323 Includes this quote from _sam, one of the develelopers:
Quote:
Internal compiler errors (ICEs) are always bugs in the compiler, not the respective packages.

If it's reproducible, please:
1. do a memtest (please don't skip this)
2. then follow https://wiki.gentoo.org/wiki/Gcc-ICE-reporting-guide (we can help as needed).
Back to top
View user's profile Send private message
user
Apprentice
Apprentice


Joined: 08 Feb 2004
Posts: 194

PostPosted: Wed Jun 15, 2022 1:53 pm    Post subject: Reply with quote

Hi
heppen.

Faulty memory?

Try to excepts this case by memory testing at OS layer for e. g. with sys-apps/memtester
Back to top
View user's profile Send private message
heppen
n00b
n00b


Joined: 17 Sep 2021
Posts: 22

PostPosted: Wed Jun 15, 2022 4:36 pm    Post subject: Reply with quote

user wrote:
Hi
heppen.

Faulty memory?

Try to excepts this case by memory testing at OS layer for e. g. with sys-apps/memtester


Hey, let's start with this test.
So... I did 2 testes, with 200M and 8G
First one passed:
Quote:

heppen@gentoo ~ $ sudo memtester 200M 1
Hasło:
memtester version 4.5.1 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 200MB (209715200 bytes)
got 200MB (209715200 bytes), trying mlock ...locked.
Loop 1/1:
Stuck Address : ok
Random Value : ok
Compare XOR : ok
Compare SUB : ok
Compare MUL : ok
Compare DIV : ok
Compare OR : ok
Compare AND : ok
Sequential Increment: ok
Solid Bits : ok
Block Sequential : ok
Checkerboard : ok
Bit Spread : ok
Bit Flip : ok
Walking Ones : ok
Walking Zeroes : ok

Done.


unfortunately, the second one is not

Quote:

heppen@gentoo ~ $ sudo memtester 8G 1
memtester version 4.5.1 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 8192MB (8589934592 bytes)
got 8192MB (8589934592 bytes), trying mlock ...locked.
Loop 1/1:
Stuck Address : ok
Random Value : ok
Compare XOR : ok
Compare SUB : ok
Compare MUL : ok
Compare DIV : ok
Compare OR : ok
Compare AND : ok
Sequential Increment: ok
Solid Bits : ok
Block Sequential : ok
Checkerboard : ok
Bit Spread : ok
Bit Flip : ok
Walking Ones : ok
Walking Zeroes : testing 98FAILURE: 0x100000020000000 != 0x20000000 at offset 0x11ce9448.
FAILURE: 0x800000020000000 != 0x20000000 at offset 0x11ce9608.
FAILURE: 0x100000020000000 != 0x20000000 at offset 0x11ce9e48.
FAILURE: 0x2000000020000000 != 0x20000000 at offset 0x5ac230c8.
FAILURE: 0x400000020000000 != 0x20000000 at offset 0x5ac23448.
FAILURE: 0x400000020000000 != 0x20000000 at offset 0x5ac24088.
FAILURE: 0x2000000020000000 != 0x20000000 at offset 0x5ac24208.
FAILURE: 0x20000000 != 0x8000000020000000 at offset 0xaa170638.

Done.

Is that mean, my memory is corrupted?

I'm gonna try to compile linux-tkg with Clang/LLVM instead of GCC and see if it will success because I could not complete it with GCC.
Back to top
View user's profile Send private message
sam_
Developer
Developer


Joined: 14 Aug 2020
Posts: 1670

PostPosted: Wed Jun 15, 2022 5:36 pm    Post subject: Reply with quote

Yeah, if any memtest fails, it means it's time to replace / return RAM.
Back to top
View user's profile Send private message
heppen
n00b
n00b


Joined: 17 Sep 2021
Posts: 22

PostPosted: Wed Jun 15, 2022 5:54 pm    Post subject: Reply with quote

sam_ wrote:
Yeah, if any memtest fails, it means it's time to replace / return RAM.


Oh right. Thanks :) I will return it then. It's kinda new sticks, maybe I will be able to replace them easy.
Back to top
View user's profile Send private message
sam_
Developer
Developer


Joined: 14 Aug 2020
Posts: 1670

PostPosted: Wed Jun 15, 2022 6:00 pm    Post subject: Reply with quote

heppen wrote:
sam_ wrote:
Yeah, if any memtest fails, it means it's time to replace / return RAM.


Oh right. Thanks :) I will return it then. It's kinda new sticks, maybe I will be able to replace them easy.


No problem! FWIW, a LOT of manufacturers will give RMAs and handle returns well, so you're in luck I hope!
Back to top
View user's profile Send private message
C5ace
Guru
Guru


Joined: 23 Dec 2013
Posts: 472
Location: Brisbane, Australia

PostPosted: Thu Jun 16, 2022 2:02 am    Post subject: Reply with quote

Get "Matched Memory Sticks".
_________________
Observation after 30 years working with computers:
All software has known and unknown bugs and vulnerabilities. Especially software written in complex, unstable and object oriented languages such as perl, python, C++, C#, Rust and the likes.
Back to top
View user's profile Send private message
heppen
n00b
n00b


Joined: 17 Sep 2021
Posts: 22

PostPosted: Thu Jun 16, 2022 12:43 pm    Post subject: Reply with quote

C5ace wrote:
Get "Matched Memory Sticks".

I have G.Skill FlareX which should be "AMD compatible". Good memory, but probably just my pair is wrong.
I contacted with my seller and I can RMA it without problems. Unfortunatelly I will be without PC for 2-3 weeks :/

Thanks all for help :) I really appreciate it. That's why we love Gentoo, not only OS is awesome but people who using it are also nice :)
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 9645
Location: almost Mile High in the USA

PostPosted: Fri Jun 17, 2022 12:46 pm    Post subject: Reply with quote

Hope you don't end up with "hard disk corruption" that you find down the road because of the bad ram ... mostly don't blame the hard drive/ssd when you have bad ram...

This "AMD" vs "Intel" compatible RAM thing of the past is BS IMHO. "Intel" RAM is compatible with everything, "AMD" RAM is only compatible with certain machines which include AMD... Not sure what the status is with DDR3 or DDR4 however, as far as I know the "problem" was "solved" finally, though the issue on old SDRAM (, DDR, ?) and DDR2 modules was annoying.
_________________
Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
heppen
n00b
n00b


Joined: 17 Sep 2021
Posts: 22

PostPosted: Wed Jun 22, 2022 8:45 am    Post subject: Reply with quote

Hi guys :)

New ram just came to me, this time I bought 32GB 3600MHz. Just quick memtester:

Code:

memtester version 4.5.1 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 8192MB (8589934592 bytes)
got  8192MB (8589934592 bytes), trying mlock ...locked.
Loop 1/1:
  Stuck Address       : ok         
  Random Value        : ok
  Compare XOR         : ok
  Compare SUB         : ok
  Compare MUL         : ok
  Compare DIV         : ok
  Compare OR          : ok
  Compare AND         : ok
  Sequential Increment: ok
  Solid Bits          : ok         
  Block Sequential    : ok         
  Checkerboard        : ok         
  Bit Spread          : ok         
  Bit Flip            : ok         
  Walking Ones        : ok         
  Walking Zeroes      : ok         
  8-bit Writes        : ok
  16-bit Writes       : ok

Done.

So it seems, test is passed :)

Now time to real test! Gentoo, I'm coming! :D
Back to top
View user's profile Send private message
eccerr0r
Watchman
Watchman


Joined: 01 Jul 2004
Posts: 9645
Location: almost Mile High in the USA

PostPosted: Wed Jun 22, 2022 1:20 pm    Post subject: Reply with quote

but you only tested 1/4 of your memory... Might need to bump it up more!
_________________
Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching?
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum