Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
[solved] ebuilds fail while fetching
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Gentoo on ARM
View previous topic :: View next topic  
Author Message
christoph_peter_s
Tux's lil' helper
Tux's lil' helper


Joined: 30 Nov 2015
Posts: 106

PostPosted: Sat Mar 27, 2021 11:49 pm    Post subject: [solved] ebuilds fail while fetching Reply with quote

Dear fellow Gentooers,

I have massive troubles with one of my little boxes. I've experimented with supplying them with binary packages - and it looks like something serious got broken. I did revert the getbinpkg feature - but all the ebuilds, that need to fetch files fail in the same manner:

Code:
horus /etc # emerge -1 net-fs/samba
Calculating dependencies... done!

>>> Verifying ebuild manifests

>>> Emerging (1 of 3) dev-python/markdown-3.3.3::gentoo
 * Fetching files in the background.
 * To view fetch progress, run in another terminal:
 * tail -f /var/log/emerge-fetch.log
>>> Downloading 'http://distfiles.gentoo.org/distfiles/layout.conf'
No digest file available and download failed.

!!! Couldn't download '.layout.conf.distfiles.gentoo.org'. Aborting.
>>> Downloading 'http://distfiles.gentoo.org/distfiles/Markdown-3.3.3.tar.gz'
>>> Downloading 'https://files.pythonhosted.org/packages/source/M/Markdown/Markdown-3.3.3.tar.gz'
!!! Couldn't download 'Markdown-3.3.3.tar.gz'. Aborting.


I am well aware of some issues with wrong permissions in /usr/portage - but this is not the problem.
Code:
horus /etc # ls -l /usr
...
drwxr-xr-x 176 portage portage  4096 Mar 27 23:56 portage


A second box, which I also did supply with binary packages, did not suffer from the issue. Emerging looks fine there:
Code:
circe /etc/portage # emerge -1 dev-python/markdown
Calculating dependencies... done!

>>> Verifying ebuild manifests

>>> Emerging (1 of 1) dev-python/markdown-3.3.3::gentoo
>>> Downloading 'http://distfiles.gentoo.org/distfiles/75/Markdown-3.3.3.tar.gz'
--2021-03-28 00:14:05--  http://distfiles.gentoo.org/distfiles/75/Markdown-3.3.3.tar.gz
Resolving distfiles.gentoo.org... 195.181.175.51, 195.181.175.54, 195.181.175.45, ...
Connecting to distfiles.gentoo.org|195.181.175.51|:80... connected.
HTTP request sent, awaiting response... 200 OK


Apparently the broken box got an issue even before actually trying to resolve the address for the download. The broken box is a virtual machine on a Turris router, which runs a fairly old kernel. But I run the VM on that router for more than two years now without ever having any issues with it.
Code:
horus /etc # uname -r
4.4.199-a890a5a94ebb621f8f1720c24d12fef1-1


I have switched the gentoo.conf repo from my internal mirror to the official Gentoo one, and I tried to rebuild portage (by copying files by hand, which works smoothly). I have also tried emaint to repair whatever it was able to. Some digest file seems corrupted - but where to look for? I did spend a lot of time on the issue - but I feel like being completely clueless.

But I am grateful for any tip on how to proceed. And where to look for more information. The /var/log/emerge-fetch.log repeats just the information given above. On the other logs (syslog, daemon.log) I don't see any related information at all.

Maybe somebody here has an idea, what to do.
TIA & Best regards
Peter


PS:
Code:

horus /etc/portage # emerge --info
Portage 3.0.13 (python 3.8.7-final-0, default/linux/arm/17.0/armv7a, gcc-10.2.0, glibc-2.32-r7, 4.4.199-a890a5a94ebb621f8f1720c24d12fef1-1 armv7l)
=================================================================
System uname: Linux-4.4.199-a890a5a94ebb621f8f1720c24d12fef1-1-armv7l-ARMv7_Processor_rev_1_-v7l-with-glibc2.4
KiB Mem:     2070032 total,    279836 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Sat, 27 Mar 2021 22:30:01 +0000
Head commit of repository gentoo: 513769430e0f4001d33f8c430fa44b5abab14ded
sh bash 5.0_p18
ld GNU ld (Gentoo 2.35.1 p2) 2.35.1
distcc 3.3.3 armv7a-unknown-linux-gnueabihf [disabled]
app-shells/bash:          5.0_p18::gentoo
dev-lang/perl:            5.30.3::gentoo
dev-lang/python:          3.8.7-r1::gentoo, 3.9.1-r1::gentoo
dev-util/cmake:           3.18.5::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/openrc:          0.42.1-r1::gentoo
sys-apps/sandbox:         2.20::gentoo
sys-devel/autoconf:       2.69-r5::gentoo
sys-devel/automake:       1.16.2-r1::gentoo
sys-devel/binutils:       2.35.1-r1::gentoo
sys-devel/gcc:            10.2.0-r5::gentoo
sys-devel/gcc-config:     2.3.2-r1::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.3::gentoo
sys-kernel/linux-headers: 5.4-r1::gentoo (virtual/os-headers)
sys-libs/glibc:           2.32-r7::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-jobs: 1
    sync-rsync-extra-opts:
    sync-rsync-verify-metamanifest: no

PSeOverlay
    location: /usr/local/overlay
    masters: gentoo
    priority: 10

ACCEPT_KEYWORDS="arm"
ACCEPT_LICENSE="@FREE"
CBUILD="armv7a-unknown-linux-gnueabihf"
CFLAGS="-O2 -pipe -march=armv7-a -mfpu=vfpv3-d16 -mfloat-abi=hard"
CHOST="armv7a-unknown-linux-gnueabihf"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt /var/bind"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -march=armv7-a"
DISTDIR="/usr/portage/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe -march=armv7-a"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe -march=armv7-a"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j1"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X acl arm bash-completion berkdb bzip2 caps cli crypt dri elogind fortran gdbm git iconv libglvnd lzma lzo ncurses nls nptl openmp pam pcre perl python quota readline seccomp session split-usr ssl startup-notification tcpd udev unicode xattr xorg zlib" ADA_TARGET="gnat_2018" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_ARM="edsp thumb thumb2 v4 v5 v6 v7 vfp" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_8" PYTHON_TARGETS="python3_8" RUBY_TARGETS="ruby26" USERLAND="GNU" VIDEO_CARDS="dummy" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS


Last edited by christoph_peter_s on Tue Apr 13, 2021 10:09 pm; edited 1 time in total
Back to top
View user's profile Send private message
christoph_peter_s
Tux's lil' helper
Tux's lil' helper


Joined: 30 Nov 2015
Posts: 106

PostPosted: Tue Apr 13, 2021 11:27 am    Post subject: Reply with quote

I have finally made some progress. I changed FETCHCOMMAND in make.conf:
Code:
FETCHCOMMAND="/usr/bin/wget -t 5 --passive-ftp -O \${DISTDIR}/\${FILE} \${URI}"


I wonder, where I could find the default value. There is a really old post in the forum (https://forums.gentoo.org/viewtopic-t-757880-start-0-postdays-0-postorder-asc-highlight-.html), so I am not 100% sure, whether the information is still valid.

I did remove the -T 60 argument from the assumed standard value. With that change, the fetch works.
At the moment the box is working on updates. But once, these are finished, I will re-emerge wget, and then - if this doesn't improve the situation without my work-around - I will file a bug...

- Peter
Back to top
View user's profile Send private message
Hu
Moderator
Moderator


Joined: 06 Mar 2007
Posts: 21489

PostPosted: Tue Apr 13, 2021 3:33 pm    Post subject: Reply with quote

The default value for FETCHCOMMAND should be fine in most cases. According to emerge --verbose --info here:
Code:
FETCHCOMMAND="wget -t 3 -T 60 --passive-ftp -O "${DISTDIR}/${FILE}" "${URI}""
Back to top
View user's profile Send private message
christoph_peter_s
Tux's lil' helper
Tux's lil' helper


Joined: 30 Nov 2015
Posts: 106

PostPosted: Tue Apr 13, 2021 10:13 pm    Post subject: Reply with quote

I can confirm, that the re-emerge of wget solved the issue.
To solve this caused me a lot of pain and hours of trying to recompile all the stuff, mentioned in the ebuild of portage. A longer strace session also did not give me any hints. And in the end it was so simple. Anyway, I don't what to complain. I've solved it, and I've learned another lesson on Gentoo...

- Peter.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo on ARM All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum