| View previous topic :: View next topic |
| Author |
Message |
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
 Posted: Mon Oct 02, 2023 6:17 pm Post subject: [SOLVED] emerge-webrsync stuck |
 |
|
I have a virtual server with public IP. I use it as my VPN and web host plus my mail server on my home desktop machine (fitle2) with vpn into the virtual server and ports forwarded. Both machines have Gentoo installed: Pofile 1 on the virtual server and Profile 3 on the home desktop. Trying to update both of my systems, but recently update of the virtual server fails: | Code: | gklinux /home/gellert # emerge-webrsync
* PGP verification method: gemato
* Fetching most recent snapshot ...
* Trying to retrieve 20230928 snapshot from http://mirrors.rit.edu/gentoo ...
* Fetching file gentoo-20230928.tar.xz.md5sum ...
--2023-09-29 19:53:46-- http://mirrors.rit.edu/gentoo/snapshots/gentoo-20230928.tar.xz.md5sum
Resolving mirrors.rit.edu... 2620:8d:8000:15:1ead:ed:c0:ffe, 129.21.171.72
Connecting to mirrors.rit.edu|2620:8d:8000:15:1ead:ed:c0:ffe|:80... failed: Connection timed out.
Connecting to mirrors.rit.edu|129.21.171.72|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 57 [application/x-xz]
Saving to: ‘/var/tmp/portage/webrsync-7V4aUn/gentoo-20230928.tar.xz.md5sum’
/var/tmp/portage/we 100%[===================>] 57 --.-KB/s in 0s
2023-09-29 19:54:46 (2.36 MB/s) - ‘/var/tmp/portage/webrsync-7V4aUn/gentoo-20230928.tar.xz.md5sum’ saved [57/57]
* Fetching file gentoo-20230928.tar.xz.gpgsig ...
--2023-09-29 19:54:46-- http://mirrors.rit.edu/gentoo/snapshots/gentoo-20230928.tar.xz.gpgsig
Resolving mirrors.rit.edu... 2620:8d:8000:15:1ead:ed:c0:ffe, 129.21.171.72
Connecting to mirrors.rit.edu|2620:8d:8000:15:1ead:ed:c0:ffe|:80... failed: Connection timed out.
Connecting to mirrors.rit.edu|129.21.171.72|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 963 [application/x-xz]
Saving to: ‘/var/tmp/portage/webrsync-7V4aUn/gentoo-20230928.tar.xz.gpgsig’
/var/tmp/portage/we 100%[===================>] 963 --.-KB/s in 0s
2023-09-29 19:55:46 (109 MB/s) - ‘/var/tmp/portage/webrsync-7V4aUn/gentoo-20230928.tar.xz.gpgsig’ saved [963/963]
* Fetching file gentoo-20230928.tar.xz ...
--2023-09-29 19:55:46-- http://mirrors.rit.edu/gentoo/snapshots/gentoo-20230928.tar.xz
Resolving mirrors.rit.edu... 2620:8d:8000:15:1ead:ed:c0:ffe, 129.21.171.72
Connecting to mirrors.rit.edu|2620:8d:8000:15:1ead:ed:c0:ffe|:80... failed: Connection timed out.
Connecting to mirrors.rit.edu|129.21.171.72|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 43907876 (42M) [application/x-xz]
Saving to: ‘/var/tmp/portage/webrsync-7V4aUn/gentoo-20230928.tar.xz’
/var/tmp/portage/we 100%[===================>] 41.87M 55.5MB/s in 0.8s
2023-09-29 19:56:47 (55.5 MB/s) - ‘/var/tmp/portage/webrsync-7V4aUn/gentoo-20230928.tar.xz’ saved [43907876/43907876]
* Checking digest ...
* Checking signature ...
[ INFO] Refreshing keys...
|
There is a similar post, unanswered, unresolved: https://forums.gentoo.org/viewtopic-t-1162090-highlight-.html
Since then I was updating the virtual server with emerge-webrsync, but now this doe not work, either. Could these two be realated? To me it looks like something is wrong with mirrors and/or keys.
I have no problem updating the desktop machine with eix-sync.
One other thing: provider of the virtual server was recently purchased by Akamai. Could the problem be related (eix-syn and web-rsyn, keys) to the change of ownership? Everything else works though with the virtual server, my web site, mail server, ssh access to it, etc.
jankom
Last edited by jankom on Tue Oct 24, 2023 10:06 pm; edited 1 time in total |
|
| Back to top |
|
 |
eccerr0r
Watchman
Joined: 01 Jul 2004
Posts: 9714
Location: almost Mile High in the USA
|
| Posted: Tue Oct 03, 2023 1:32 pm Post subject: |
|
|
probably not helpful but each time I get a hang in the signature/key update it was due to some network firewall/routing issue of some sort. Might not be your problem but that's my experience...
_________________
Intel Core i7 2700K/Radeon R7 250/24GB DDR3/256GB SSD
What am I supposed watching? |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Tue Oct 03, 2023 2:27 pm Post subject: |
|
|
| Which version of Portage? Newer Portage (>=3.0.51) supports 'emerge --sync --debug' which can help figure out why it's stuck. |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Tue Oct 03, 2023 5:55 pm Post subject: |
|
|
| Quote: | | supports 'emerge --sync --debug' which can help figure out why it's stuck. |
| Code: | gellert@jgklinux ~ $ su -c "emerge --sync --debug"
Password:
myaction sync
myopts {'--debug': True, '--regex-search-auto': 'y'}
>>> Syncing repository 'gentoo' into '/var/db/repos/gentoo'...
* Using keys from /usr/share/openpgp-keys/gentoo-release.asc
* Refreshing keys via WKD ...
|
Same thing with eix-syn.
As far as the firewall - it is open - OK, it is dangerous, but so far no problem.
emerge-webrsync also has problem with refreshing keys.
Maybe something is wrong with keys, key servers, mirrors. Just looking for clues.
jankom |
|
| Back to top |
|
|
Banana
Moderator
Joined: 21 May 2004
Posts: 1478
Location: Germany
|
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Wed Oct 04, 2023 10:43 pm Post subject: |
|
|
Checked the .asc file, has the same time stamp and file size, Just 2B sure, I copied the key file from my home desktop (fitlet2 machine) - still the same problem as in my Oct 3 posting: emerge --sync is suck at "Refrshing keys via WKD...".
But I don't think I'm affected by the bug, because on my desktop the same command, emerge --sync proceeds well: | Code: | janos@andraslinux ~ $ emerge --sync
>>> Syncing repository 'gentoo' into '/var/db/repos/gentoo'...
* Using keys from /usr/share/openpgp-keys/gentoo-release.asc
* Refreshing keys via WKD ... [ ok ]
>>> Starting rsync with rsync://[2a01:90:200:10::1a]/gentoo-portage...
>>> Checking server timestamp ...
^C
Exiting on signal 2
janos@andraslinux ~ $ rsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(713) [Receiver=3.2.7]
janos@andraslinux ~ $
|
I also tried this on the virtual server after resetting iptablse, i.e. not forwarding any port. No change.
Maybe I'll contact the provider of the virtual server, Akamai.
Thanks for the ideas.
jakom |
|
| Back to top |
|
|
Banana
Moderator
Joined: 21 May 2004
Posts: 1478
Location: Germany
|
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Thu Oct 05, 2023 12:38 pm Post subject: |
|
|
| Code: | Shell script to establish ssh connection to linode as gellert.
Enter passphrase for key '/home/janos/.ssh/id_rsa':
gellert@jgklinux ~ $ su -c mc
Password:
jgklinux /home/gellert # emerge --sync
>>> Syncing repository 'gentoo' into '/var/db/repos/gentoo'...
* Using keys from /usr/share/openpgp-keys/gentoo-release.asc
* Refreshing keys via WKD ...^C
Exiting on signal 2
jgklinux /home/gellert #
|
This is pasted from a terminal session to the remote virtual server on my home desktop computer (fitlet2). Yes, I'm root on the virtual server using mc and terminal within root mc. emerge --sync process is sctuck at Refreshing keys.. until I interrupt it with Ctr-c
jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Fri Oct 06, 2023 4:32 pm Post subject: |
|
|
Which version of Portage (emerge --version) and which version of gemato (emerge -pvO app-portage/gemato)?
It would also help to know which date/commit your ::gentoo sync is at from emerge --info. |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Fri Oct 06, 2023 10:21 pm Post subject: |
|
|
| Code: | Shell script to establish ssh connection to linode as gellert.
Enter passphrase for key '/home/janos/.ssh/id_rsa':
gellert@jgklinux ~ $ emerge --version
Portage 3.0.49 (python 3.11.5-final-0, default/linux/amd64/17.1, gcc-12, glibc-2.37-r3, 6.2.9-x86_64-linode160 x86_64)
gellert@jgklinux ~ $ emerge -pvO app-portage/gemato
These are the packages that would be merged, in order:
[ebuild R ] app-portage/gemato-20.4::gentoo USE="gpg -pretty-log -test -tools" PYTHON_TARGETS="python3_11 (-pypy3) -python3_10 (-python3_12)" 0 KiB
Total: 1 package (1 reinstall), Size of downloads: 0 KiB
gellert@jgklinux ~ $
|
Except for the kernel version everything is the same for the home desktop machine where there is no problem with sync or WKD
jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Fri Oct 06, 2023 10:23 pm Post subject: |
|
|
| Thanks. In /var/db/repos/gentoo/sys-apps/portage (might be /usr/portage instead of /var/db/repos/gentoo on older systems), what ebuilds do you see in there? |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Sat Oct 07, 2023 2:25 am Post subject: |
|
|
Thanks, sam_ | Quote: | | what ebuilds do you see in there |
| Code: | jgklinux /var/db/repos/gentoo/sys-apps/portage # ls -al
total 100
drwxr-xr-x 3 root root 4096 Oct 3 16:40 .
drwxr-xr-x 301 root root 12288 Oct 3 16:40 ..
-rw-r--r-- 1 root root 5867 Oct 3 16:11 Manifest
drwxr-xr-x 2 root root 4096 Aug 29 20:53 files
-rw-r--r-- 1 root root 1539 Jan 3 2023 metadata.xml
-rw-r--r-- 1 root root 9026 Jun 16 04:40 portage-3.0.45.3-r2.ebuild
-rw-r--r-- 1 root root 9028 Jun 21 22:10 portage-3.0.46.ebuild
-rw-r--r-- 1 root root 9527 Aug 15 03:40 portage-3.0.49-r2.ebuild
-rw-r--r-- 1 root root 6627 Aug 19 20:40 portage-3.0.50.ebuild
-rw-r--r-- 1 root root 6621 Sep 28 04:40 portage-3.0.51.ebuild
-rw-r--r-- 1 root root 6648 Oct 3 16:11 portage-3.0.52.ebuild
-rw-r--r-- 1 root root 6648 Sep 8 20:10 portage-9999.ebuild
jgklinux /var/db/repos/gentoo/sys-apps/portage #
|
jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Sat Oct 07, 2023 10:48 pm Post subject: |
|
|
Thanks.
Could you put this in package.accept_keywords:
| Code: |
<app-portage/gemato-20.6
<sys-apps/portage-3.0.53
|
then try a world upgrade. Then emerge --sync --debug should work (and please share its output). |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Sun Oct 08, 2023 2:10 am Post subject: |
|
|
Thanks, sam.
This is the situation now:
package.accept_keywords was an empty directory (Gentoo was installed by the virual server provider, all I did was periodic updates until I ran into this problem) - so I renamed it, just in case and created the text file package.accept_keywords as you suggested. Then I issued the command "emerge -avuND -–with-bdeps=y @world". It is working now, emerging 114 packages. Will report later when process finishes - jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Sun Oct 08, 2023 3:12 am Post subject: |
|
|
| Sounds good! |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Mon Oct 09, 2023 1:02 pm Post subject: Update - jankom |
|
|
| Compiling rust during the emerge world process failed three times - all of a suddent ssh connection was lost lost. Now trying to do the same with weblish console. Will continue updates when applicable. |
|
| Back to top |
|
|
Banana
Moderator
Joined: 21 May 2004
Posts: 1478
Location: Germany
|
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Mon Oct 09, 2023 9:34 pm Post subject: update -compiling rust failed again 0more info |
|
|
Tried 3rd time the emerge world update, but compiling rust failed again. | Code: | emerge -avuND --with-bdeps=y @world
|
This time I ran it from web console so I was able to capture what happened.
At configuration checking there was a red warning/error snippet: | Code: | * Checking whether python3_12 is suitable ...
* dev-lang/python:3.12 ... [ !! ]
* Checking whether python3_11 is suitable ...
* dev-lang/python:3.11 ... [ ok ]
* Using python3.11 to build (via PYTHON_COMPAT iteration)
|
After about 6 hours of processing time: | Code: | * Messages for package dev-lang/rust-1.71.1:
* Log file: /var/log/portage/log/dev-lang:rust-1.71.1:20231009-131233.log
* ERROR: dev-lang/rust-1.71.1::gentoo failed (compile phase):
* (no error message)
*
* Call stack:
* ebuild.sh, line 136: Called src_compile
* environment, line 3897: Called die
* The specific snippet of code:
* RUST_BACKTRACE=1 "${EPYTHON}" ./x.py build -vv --config="${S}"/config.toml -j$(makeopts_jobs) || die
*
* If you need support, post the output of `emerge --info '=dev-lang/rust-1.71.1::gentoo'`,
* the complete build log and the output of `emerge -pqv '=dev-lang/rust-1.71.1::gentoo'`.
* The complete build log is located at '/var/log/portage/log/dev-lang:rust-1.71.1:20231009-131233.log'.
* For convenience, a symlink to the build log is located at '/var/tmp/portage/dev-lang/rust-1.71.1/temp/build.log'.
* The ebuild environment file is located at '/var/tmp/portage/dev-lang/rust-1.71.1/temp/environment'.
* Working directory: '/var/tmp/portage/dev-lang/rust-1.71.1/work/rustc-1.71.1-src'
* S: '/var/tmp/portage/dev-lang/rust-1.71.1/work/rustc-1.71.1-src'
gellert@jgklinux ~ $
|
Info about the processor of the virtual server:
| Code: | gellert@jgklinux ~ $ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 1
On-line CPU(s) list: 0
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7713 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 1
Core(s) per socket: 1
Socket(s): 1
Stepping: 1
BogoMIPS: 4001.65
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mc
a cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx m
mxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid ex
td_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 p
cid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_time
r aes xsave avx f16c rdrand hypervisor lahf_lm cmp_lega
cy cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw
perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_
adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt c
lwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsavee
rptr wbnoinvd arat umip pku ospke vaes vpclmulqdq rdpid
arch_capabilities
Virtualization features:
Hypervisor vendor: KVM
Virtualization type: full
Caches (sum of all):
L1d: 64 KiB (1 instance)
L1i: 64 KiB (1 instance)
L2: 512 KiB (1 instance)
L3: 16 MiB (1 instance)
NUMA:
NUMA node(s): 1
NUMA node0 CPU(s): 0
Vulnerabilities:
Itlb multihit: Not affected
L1tf: Not affected
Mds: Not affected
Meltdown: Not affected
Mmio stale data: Not affected
Retbleed: Not affected
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer
sanitization
Spectre v2: Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIB
P disabled, RSB filling, PBRSB-eIBRS Not affected
Srbds: Not affected
Tsx async abort: Not affected
gellert@jgklinux ~ $
|
My /etc/portage/make.conf:
| Code: | gellert@jgklinux ~ $ cat /etc/portage/make.conf
## JGK - 05/16/2022: stripped of commented lines
CHOST="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe"
CXXFLAGS="${CFLAGS}"
ACCEPT_LICENSE="* -@EULA"
PORTDIR=/var/db/repos/gentoo
DISTDIR=/var/cache/distfiles
PKGDIR=/var/cache/binpkgs
GENTOO_MIRRORS="http://mirrors.rit.edu/gentoo/"
## JGK - 06/16/2022: next changed
#MAKEOPTS="-j2"
MAKEOPTS="-j1"
# next added to eliminate warning while using emerge
# and to make it similar to fitlet setting
PORTAGE_LOGDIR="/var/log/portage/log"
gellert@jgklinux ~ $
|
My fitlet desktop was able to compile rust - in about a day...
jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Mon Oct 09, 2023 9:50 pm Post subject: |
|
|
| Could you show us /var/tmp/portage/dev-lang/rust-1.71.1/temp/build.log? Also, did emerge get updated in time? (emerge --version) |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Mon Oct 09, 2023 10:47 pm Post subject: |
|
|
Sam.
| Code: | gellert@jgklinux ~ $ emerge --version
Portage 3.0.49 (python 3.11.5-final-0, default/linux/amd64/17.1, gcc-12, glibc-2.37-r3, 6.2.9-x86_64-linode160 x86_64)
gellert@jgklinux ~ $
|
The build log is about 18 Meg. How, where to upload?
output of `emerge --info '=dev-lang/rust-1.71.1::gentoo'`: | Code: | Portage 3.0.49 (python 3.11.5-final-0, default/linux/amd64/17.1, gcc-12, glibc-2.37-r3, 6.2.9-x86_64-linode160 x86_64)
=================================================================
System Settings
=================================================================
System uname: Linux-6.2.9-x86_64-linode160-x86_64-AMD_EPYC_7713_64-Core_Processor-with-glibc2.37
KiB Mem: 1999756 total, 1604988 free
KiB Swap: 4718584 total, 4702840 free
Timestamp of repository gentoo: Tue, 03 Oct 2023 16:30:01 +0000
Head commit of repository gentoo: 6afb6078c379833913789a5ff359dc17f8f1860c
sh bash 5.1_p16-r6
ld GNU ld (Gentoo 2.40 p5) 2.40.0
app-misc/pax-utils: 1.3.5::gentoo
app-shells/bash: 5.1_p16-r6::gentoo
dev-lang/perl: 5.38.0-r1::gentoo
dev-lang/python: 3.11.5::gentoo
dev-lang/rust: 1.69.0-r1::gentoo
dev-util/cmake: 3.26.5-r2::gentoo
dev-util/meson: 1.1.1::gentoo
sys-apps/baselayout: 2.14::gentoo
sys-apps/openrc: 0.47.1::gentoo
sys-apps/sandbox: 2.37::gentoo
sys-devel/autoconf: 2.71-r6::gentoo
sys-devel/automake: 1.16.5-r1::gentoo
sys-devel/binutils: 2.40-r5::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/gcc: 12.3.1_p20230526::gentoo, 13.2.1_p20230826::gentoo
sys-devel/gcc-config: 2.11::gentoo
sys-devel/libtool: 2.4.7-r1::gentoo
sys-devel/make: 4.4.1-r1::gentoo
sys-kernel/linux-headers: 6.1::gentoo (virtual/os-headers)
sys-libs/glibc: 2.37-r3::gentoo
Repositories:
gentoo
location: /var/db/repos/gentoo
sync-type: rsync
sync-uri: rsync://rsync.gentoo.org/gentoo-portage
priority: -1000
volatile: False
sync-rsync-verify-metamanifest: yes
sync-rsync-verify-jobs: 1
sync-rsync-extra-opts:
sync-rsync-verify-max-age: 24
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/easy-rsa /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe"
DISTDIR="/var/cache/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://mirrors.rit.edu/gentoo/"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LEX="flex"
MAKEOPTS="-j1"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
SHELL="/bin/bash"
USE="acl amd64 bzip2 cli crypt dri fortran gdbm iconv ipv6 libtirpc multilib ncurses nls nptl openmp pam pcre readline seccomp split-usr ssl test-rust unicode xattr zlib" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" VIDEO_CARDS="amdgpu fbdev intel nouveau radeon radeonsi vesa dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS
|
jankom |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Fri Oct 13, 2023 12:56 pm Post subject: Update Oct 13 |
|
|
In Banan's reply of Oct 9, referencing Gentoo rust wiki I tried | Code: | # target-cpu=native is the equivalent of -march=native in C/CXXFLAGS:
RUSTFLAGS="-C target-cpu=native"
# enable target-cpu=native and DT_RELR
RUSTFLAGS="-C target-cpu=native -C link-arg=-Wl,-z,pack-relative-relocs"
# opt-level is similar to Clang's optimization options
RUSTFLAGS="-C opt-level=3" |
Rust still would not compile. Looking at compile log file it is too complicated and too long at the point when it fails with SIGKILL.
Question referring to sam's post and my post about python version: could python 3.11 vs 3.12 be the culprit? Just a thought.
Big question: should I try just to install the rust binary?
Even bigger question: why do we need rust? Both of my Gentoo instances (home desktop on fitlet2 machine Profile 3, and virtual linode server Profile 1) have dependencies needing rust.
Right now I'm stuck on the linode virtual server as far as updates are concerned. Otherwise it works well for my purposes.
Thank all of you again for your interest and suggestions,
jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Fri Oct 13, 2023 3:13 pm Post subject: |
|
|
Could you try emerge -v1 dev-lang/rust-bin? (We recently changed the default to that but you probably haven't picked that up yet).
I also assume you mean you tried each of those 3 options individually, as otherwise they will clobber each other unless you do RUSTFLAGS="${RUSTFLAGS} ...".
I don't expect any of those options would really help you if you're running out of memory though. Just use rust-bin. |
|
| Back to top |
|
|
Hu
Administrator
Joined: 06 Mar 2007
Posts: 21918
|
| Posted: Fri Oct 13, 2023 3:24 pm Post subject: Re: Update Oct 13 |
|
|
| jankom wrote: | | Question referring to sam's post and my post about python version: could python 3.11 vs 3.12 be the culprit? Just a thought. |
I think that is unlikely. SIGKILL is almost certainly an out-of-memory, and the memory requirements of either version of Python should be quite small compared to what Rust is using for itself. | jankom wrote: | | Big question: should I try just to install the rust binary? |
Yes. | jankom wrote: | | Even bigger question: why do we need rust? Both of my Gentoo instances (home desktop on fitlet2 machine Profile 3, and virtual linode server Profile 1) have dependencies needing rust. |
We need it because some upstream projects use it for some or all of their code. If you can emerge --ask --verbose --depclean dev-lang/rust dev-lang/rust-bin virtual/rust and then package.mask those packages, and nothing raises errors, you are welcome to do so. For most systems, there will be at least one package considered critical to a standard desktop system that now requires rust, and masking it as described will prevent you from updating any packages that require rust. Blocking those updates is usually a bad thing, so if Portage insists on installing Rust, then you need it (unless you choose to remove all the packages that require rust). |
|
| Back to top |
|
|
jankom
Guru
Joined: 30 Aug 2021
Posts: 329
Location: USA
|
| Posted: Sun Oct 15, 2023 8:10 pm Post subject: Update Oct 15, 2023 |
|
|
@sam | Quote: | | Could you try emerge -v1 dev-lang/rust-bin? |
Yes, did it after reading your suggestion. It worked fast, but noted one red color message: | Code: | | scanelf: rpath_security_checks(): Security problem NULL DT_RUNPATH in /var/tmp/portage/dev-lang/rust-bin-1.71.1/image/opt/rust-bin-1.71.1/lib/libLLVM-16-rust-1.71.1-stable.so |
After that "emerge -avuND –with-bdeps=y @world" completed OK finishing with compiling the rest of the stuff held back by the failed rust process.
@Hu
| Quote: | | SIGKILL is almost certainly an out-of-memory |
My linode virtual server has 2G memory with 4G swap. Maybe still not enough? It looks like after 5-6 hours of compile time the process dies. My home desktop fitlet2 has 4 CPUs and 8G RAM with additional 4G swap, but compiling rust took over 24 hours. At any rate the binary version is much more convenient for me on both home and remote virtual machines. So compiling rust part of this topic is now solved.
However...
The original issue of eix-sync not working on the virtual server is still unsolved. After successful completion of "emerge -avuND –with-bdeps=y @world" and additional commands: | Code: | emerge -a --depclean
emaint -c all
revdep-rebuild
eclean-dist -di
eclean-pkg
eix-test-obsolete
env-update && . /etc/profile |
Everything completed fine incicating a clean system. But I still could not do a normal system update: | Code: | gellert@jgklinux ~ $ su -c eix-sync
Password:
* Running emerge --sync
>>> Syncing repository 'gentoo' into '/var/db/repos/gentoo'...
* Using keys from /usr/share/openpgp-keys/gentoo-release.asc
* Refreshing keys via WKD ...^C
Exiting on signal 2
* Time statistics:
667 seconds total
gellert@jgklinux ~ $ |
If I do "emerge-webrsync": | Code: | ...
* Checking signature ...
[ INFO] Refreshing keys...
^C
Traceback (most recent call last):
File "/usr/lib/python-exec/python3.11/gemato", line 8, in <module>
sys.exit(setuptools_main())
^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/gemato/cli.py", line 761, in setuptools_main
sys.exit(main(sys.argv))
^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/gemato/cli.py", line 734, in main
vals.cmd.parse_args(vals, argp)
File "/usr/lib/python3.11/site-packages/gemato/cli.py", line 645, in parse_args
super().parse_args(args, argp)
File "/usr/lib/python3.11/site-packages/gemato/cli.py", line 178, in parse_args
self.openpgp_env.refresh_keys(allow_wkd=args.allow_wkd,
File "/usr/lib/python3.11/site-packages/gemato/openpgp.py", line 654, in refresh_keys
if allow_wkd and self.refresh_keys_wkd():
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/gemato/openpgp.py", line 591, in refresh_keys_wkd
resp = requests.get(url, proxies=proxies, timeout=self.timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/urllib3/connectionpool.py", line 790, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/usr/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1092, in _validate_conn
conn.connect()
File "/usr/lib/python3.11/site-packages/urllib3/connection.py", line 611, in connect
self.sock = sock = self._new_conn()
^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/urllib3/connection.py", line 203, in _new_conn
sock = connection.create_connection(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
KeyboardInterrupt
jgklinux /home/gellert # |
Is there something wrong with my python? (3.11 vs 3.12?). Looks like the problem is with keya.
jankom |
|
| Back to top |
|
|
sam_
Developer
Joined: 14 Aug 2020
Posts: 1720
|
| Posted: Mon Oct 16, 2023 3:40 am Post subject: |
|
|
No, that output is just from ^C.
Okay, can you try emerge --version and emerge --sync --debug now? |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Portage & Programming
