Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Many packages failing at dodoc [solved]
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Portage & Programming
View previous topic :: View next topic  
Author Message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Wed Apr 28, 2021 6:16 pm    Post subject: Many packages failing at dodoc [solved] Reply with quote

I have several gentoo servers. One of them is failing on many packages at dodoc like the following:

Code:

main.o checksum.o match.o syscall.o log.o backup.o delete.o options.o io.o compat.o hlink.o token.o uidlist.o socket.o hashtable.o usage.o fileio.o batch.o clientname.o chmod.o acls.o xattrs.o progress.o pipe.o lib/md5-asm-x86_64.o simd-checksum-x86_64.o params.o loadparm.o clientserver.o access.o connection.o authenticate.o lib/wildmatch.o lib/compat.o lib/snprintf.o lib/mdfour.o lib/md5.o lib/permstring.o lib/pool_alloc.o lib/sysacls.o lib/sysxattrs.o  zlib/deflate.o zlib/inffast.o zlib/inflate.o zlib/inftrees.o zlib/trees.o zlib/zutil.o zlib/adler32.o zlib/compress.o zlib/crc32.o  -lattr -lacl -lpopt -lcrypto
>>> Source compiled.
>>> Test phase [not enabled]: net-misc/rsync-3.2.3-r3

>>> Install net-misc/rsync-3.2.3-r3 into /var/tmp/portage/net-misc/rsync-3.2.3-r3/image
make -j9 DESTDIR=/var/tmp/portage/net-misc/rsync-3.2.3-r3/image install
/bin/mkdir -p /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/bin
/usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c  -m 755 rsync /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/bin
/usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 755 ./rsync-ssl /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/bin
/bin/mkdir -p /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man1
/bin/mkdir -p /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man5
if test -f rsync.1; then /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 644 rsync.1 /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man1; fi
if test -f rsync-ssl.1; then /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 644 rsync-ssl.1 /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man1; fi
if test -f rsyncd.conf.5; then /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 644 rsyncd.conf.5 /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man5; fi
ERROR:root:Failed to copy file: _parsed_options=Namespace(group=-1, mode=420, owner=-1, preserve_timestamps=False), source=b'NEWS.md', dest_dir=b'/var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/doc/rsync-3.2.3-r3'
Traceback (most recent call last):
  File "/usr/lib/portage/python3.8/doins.py", line 193, in run
    copyfile(source, dest)
  File "/usr/lib/python3.8/site-packages/portage/util/file_copy/__init__.py", line 30, in _optimized_copyfile
    _file_copy(src_file.fileno(), dst_file.fileno())
BlockingIOError: [Errno 11] Resource temporarily unavailable
 * ERROR: net-misc/rsync-3.2.3-r3::gentoo failed (install phase):
 *   dodoc failed
 *
 * If you need support, post the output of `emerge --info '=net-misc/rsync-3.2.3-r3::gentoo'`,
 * the complete build log and the output of `emerge -pqv '=net-misc/rsync-3.2.3-r3::gentoo'`.
 * The complete build log is located at '/var/tmp/portage/net-misc/rsync-3.2.3-r3/temp/build.log'.
 * The ebuild environment file is located at '/var/tmp/portage/net-misc/rsync-3.2.3-r3/temp/environment'.
 * Working directory: '/var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3'
 * S: '/var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3'
 *
 * The following package has failed to build, install, or execute postinst:
 *
 *  (net-misc/rsync-3.2.3-r3:0/0::gentoo, ebuild scheduled for merge), Log file:
 *   '/var/tmp/portage/net-misc/rsync-3.2.3-r3/temp/build.log'
 *

 * GNU info directory index is up-to-date.


I have looked at permissions, looked at python used binary packages from a system with a similar CPU and config however I am having great difficulty solving this issue. I did see an old post about python however I don't think it applies.
_________________
John

My gentoo overlay
Instructons for overlay


Last edited by drescherjm on Fri Jun 18, 2021 11:07 pm; edited 1 time in total
Back to top
View user's profile Send private message
redfish
n00b
n00b


Joined: 27 Apr 2021
Posts: 22

PostPosted: Wed Apr 28, 2021 9:46 pm    Post subject: Reply with quote

The symptom looks oddly similar tough not identical to this Python bug: https://bugs.python.org/issue43743

What filesystem are you on? Try the workaround posted there to see if it eliminates the error for you -- it did for me.
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Thu Apr 29, 2021 12:47 am    Post subject: Reply with quote

The OS is on zfs raidz3 (hard drives). That is one difference between the 2 servers that are similar in hardware. The other system has the root on btrfs. Although I do have other systems where the root is on zfs but these are on nvme devices.
_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
Zucca
Moderator
Moderator


Joined: 14 Jun 2007
Posts: 2254
Location: KUUSANKOSKI, Finland

PostPosted: Thu Apr 29, 2021 11:08 am    Post subject: Reply with quote

Code:
BlockingIOError: [Errno 11] Resource temporarily unavailable
sounds like filesystem being the culprit. But when it happens only on dodoc phase, it looks to be combination of python doing something and filesystem not cooperating.
Error code 11 is usually interpreted as EAGAIN, telling program to try again in few moments.

Can you reproduce the error on the bug report redfish linked? And also on other systems you have access to?
So basically:
Code:
truncate --size 65535 srcfile && python<your_version> -c "import shutil; shutil.copyfile(b'srcfile', b'dstfile')"
rm -f srcfile dstfile
truncate --size 65536 srcfile && python<your_version> -c "import shutil; shutil.copyfile(b'srcfile', b'dstfile')"

_________________
..: Zucca :..
Gentoo IRC channels no longer reside on freenode but instead on Libera.Chat.
[Quick IRC quide]
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Thu Apr 29, 2021 3:39 pm    Post subject: Reply with quote

No issue with that at the moment.

Code:

datastore4 ~ # mkdir /var/tmp/portage/test
truncate --size 65535 srcfile && python3.8 -c "import shutil; shutil.copyfile(b'srcfile', b'dstfile')"
rm -f srcfile dstfile
truncate --size 65536 srcfile && python3.8 -c "import shutil; shutil.copyfile(b'srcfile', b'dstfile')"datastore4 ~ # cd /var/tmp/portage/test
datastore4 test # truncate --size 65535 srcfile && python3.8 -c "import shutil; shutil.copyfile(b'srcfile', b'dstfile')"
datastore4 test # rm -f srcfile dstfile
datastore4 test # truncate --size 65536 srcfile && python3.8 -c "import shutil; shutil.copyfile(b'srcfile', b'dstfile')"
datastore4 test # ls
dstfile  srcfile
datastore4 test #


I retested the emerge to make sure it was still failing because at the moment I am rebuilding packages using a script and binary packages from the other working server

Code:

datastore4 test # emerge --ignore-default-opts rsync
!!! Section 'jmd-gentoo' in repos.conf has name different from repository name 'jmd-gentoo-main' set inside repository
Calculating dependencies... done!

>>> Verifying ebuild manifests

>>> Emerging (1 of 1) net-misc/rsync-3.2.3-r3::gentoo
 * rsync-3.2.3.tar.gz BLAKE2B SHA512 size ;-) ...                                                                                                                                              [ ok ]
>>> Unpacking source...
>>> Unpacking rsync-3.2.3.tar.gz to /var/tmp/portage/net-misc/rsync-3.2.3-r3/work
>>> Source unpacked in /var/tmp/portage/net-misc/rsync-3.2.3-r3/work
>>> Preparing source in /var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3 ...
 * Applying rsync-3.2.3-glibc-lchmod.patch ...                                                                                                                                                 [ ok ]
>>> Source prepared.
>>> Configuring source in /var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3 ...
 * econf: updating rsync-3.2.3/config.guess with /usr/share/gnuconfig/config.guess
 * econf: updating rsync-3.2.3/config.sub with /usr/share/gnuconfig/config.sub
./configure --prefix=/usr --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu --mandir=/usr/share/man --infodir=/usr/share/info --datadir=/usr/share --sysconfdir=/etc --localstatedir=/var/lib --docdir=/usr/share/doc/rsync-3.2.3-r3 --htmldir=/usr/share/doc/rsync-3.2.3-r3/html --libdir=/usr/lib64 --with-rsyncd-conf=/etc/rsyncd.conf --without-included-popt --enable-acl-support --enable-iconv --disable-ipv6 --disable-lz4 --enable-openssl --with-included-zlib --enable-xattr-support --disable-xxhash --disable-zstd
configure.sh: Configuring rsync 3.2.3
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking whether to include debugging symbols... yes
checking for x86_64-pc-linux-gnu-gcc... x86_64-pc-linux-gnu-gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether x86_64-pc-linux-gnu-gcc accepts -g... yes
checking for x86_64-pc-linux-gnu-gcc option to accept ISO C89... none needed
checking how to run the C preprocessor... x86_64-pc-linux-gnu-gcc -E
checking for x86_64-pc-linux-gnu-g++... x86_64-pc-linux-gnu-g++
checking whether we are using the GNU C++ compiler... yes
checking whether x86_64-pc-linux-gnu-g++ accepts -g... yes
checking for gawk... gawk
checking for grep that handles long lines and -e... /bin/grep
checking for egrep... /bin/grep -E
checking for a BSD-compatible install... /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c
checking for a thread-safe mkdir -p... /bin/mkdir -p
checking for x86_64-pc-linux-gnu-gcc option to accept ISO C99... none needed
checking for x86_64-pc-linux-gnu-gcc option to accept ISO Standard C... (cached) none needed
checking for perl... /usr/bin/perl
checking for python3... /usr/bin/python3
checking if md2man can create man pages... no
Failed to find cmarkgfm or commonmark for python3.
checking if we require man-page building... optional
checking for remsh... 0
checking for sh... /bin/sh
checking for fakeroot... /usr/bin/fakeroot
checking the group for user "nobody"... nobody
checking whether to enable SIMD optimizations... yes (x86_64)
checking if assembler accepts noexecstack... yes
checking whether to enable ASM optimizations... yes (x86_64)
checking for broken largefile support... no
checking for special C compiler options needed for large files... no
checking for _FILE_OFFSET_BITS value needed for large files... no
checking whether to call shutdown on all sockets... no
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking whether byte ordering is bigendian... no
checking for dirent.h that defines DIR... yes
checking for library containing opendir... none required
checking whether time.h and sys/time.h may both be included... yes
checking for sys/wait.h that is POSIX.1 compatible... yes
checking sys/fcntl.h usability... yes
checking sys/fcntl.h presence... yes
checking for sys/fcntl.h... yes
checking sys/select.h usability... yes
checking sys/select.h presence... yes
checking for sys/select.h... yes
checking fcntl.h usability... yes
checking fcntl.h presence... yes
checking for fcntl.h... yes
checking sys/time.h usability... yes
checking sys/time.h presence... yes
checking for sys/time.h... yes
checking sys/unistd.h usability... yes
checking sys/unistd.h presence... yes
checking for sys/unistd.h... yes
checking for unistd.h... (cached) yes
checking utime.h usability... yes
checking utime.h presence... yes
checking for utime.h... yes
checking grp.h usability... yes
checking grp.h presence... yes
checking for grp.h... yes
checking compat.h usability... no
checking compat.h presence... no
checking for compat.h... no
checking sys/param.h usability... yes
checking sys/param.h presence... yes
checking for sys/param.h... yes
checking ctype.h usability... yes
checking ctype.h presence... yes
checking for ctype.h... yes
checking for sys/wait.h... (cached) yes
checking sys/ioctl.h usability... yes
checking sys/ioctl.h presence... yes
checking for sys/ioctl.h... yes
checking sys/filio.h usability... no
checking sys/filio.h presence... no
checking for sys/filio.h... no
checking for string.h... (cached) yes
checking for stdlib.h... (cached) yes
checking sys/socket.h usability... yes
checking sys/socket.h presence... yes
checking for sys/socket.h... yes
checking sys/mode.h usability... no
checking sys/mode.h presence... no
checking for sys/mode.h... no
checking sys/un.h usability... yes
checking sys/un.h presence... yes
checking for sys/un.h... yes
checking sys/attr.h usability... no
checking sys/attr.h presence... no
checking for sys/attr.h... no
checking mcheck.h usability... yes
checking mcheck.h presence... yes
checking for mcheck.h... yes
checking arpa/inet.h usability... yes
checking arpa/inet.h presence... yes
checking for arpa/inet.h... yes
checking arpa/nameser.h usability... yes
checking arpa/nameser.h presence... yes
checking for arpa/nameser.h... yes
checking locale.h usability... yes
checking locale.h presence... yes
checking for locale.h... yes
checking netdb.h usability... yes
checking netdb.h presence... yes
checking for netdb.h... yes
checking malloc.h usability... yes
checking malloc.h presence... yes
checking for malloc.h... yes
checking float.h usability... yes
checking float.h presence... yes
checking for float.h... yes
checking limits.h usability... yes
checking limits.h presence... yes
checking for limits.h... yes
checking iconv.h usability... yes
checking iconv.h presence... yes
checking for iconv.h... yes
checking libcharset.h usability... no
checking libcharset.h presence... no
checking for libcharset.h... no
checking langinfo.h usability... yes
checking langinfo.h presence... yes
checking for langinfo.h... yes
checking sys/acl.h usability... yes
checking sys/acl.h presence... yes
checking for sys/acl.h... yes
checking acl/libacl.h usability... yes
checking acl/libacl.h presence... yes
checking for acl/libacl.h... yes
checking attr/xattr.h usability... yes
checking attr/xattr.h presence... yes
checking for attr/xattr.h... yes
checking sys/xattr.h usability... yes
checking sys/xattr.h presence... yes
checking for sys/xattr.h... yes
checking sys/extattr.h usability... no
checking sys/extattr.h presence... no
checking for sys/extattr.h... no
checking dl.h usability... no
checking dl.h presence... no
checking for dl.h... no
checking popt.h usability... yes
checking popt.h presence... yes
checking for popt.h... yes
checking popt/popt.h usability... no
checking popt/popt.h presence... no
checking for popt/popt.h... no
checking linux/falloc.h usability... yes
checking linux/falloc.h presence... yes
checking for linux/falloc.h... yes
checking netinet/in_systm.h usability... yes
checking netinet/in_systm.h presence... yes
checking for netinet/in_systm.h... yes
checking netinet/ip.h usability... yes
checking netinet/ip.h presence... yes
checking for netinet/ip.h... yes
checking zlib.h usability... yes
checking zlib.h presence... yes
checking for zlib.h... yes
checking xxhash.h usability... no
checking xxhash.h presence... no
checking for xxhash.h... no
checking openssl/md4.h usability... yes
checking openssl/md4.h presence... yes
checking for openssl/md4.h... yes
checking openssl/md5.h usability... yes
checking openssl/md5.h presence... yes
checking for openssl/md5.h... yes
checking zstd.h usability... yes
checking zstd.h presence... yes
checking for zstd.h... yes
checking lz4.h usability... yes
checking lz4.h presence... yes
checking for lz4.h... yes
checking sys/file.h usability... yes
checking sys/file.h presence... yes
checking for sys/file.h... yes
checking whether sys/types.h defines makedev... no
checking sys/mkdev.h usability... no
checking sys/mkdev.h presence... no
checking for sys/mkdev.h... no
checking sys/sysmacros.h usability... yes
checking sys/sysmacros.h presence... yes
checking for sys/sysmacros.h... yes
checking whether to enable use of openssl crypto library... yes
checking for library containing MD5_Init... -lcrypto
checking whether to enable xxhash checksum support... no
checking whether to enable zstd compression... no
checking whether to enable LZ4 compression... no
checking if makedev takes 3 args... no
checking size of int... 4
checking size of long... 8
checking size of long long... 8
checking size of short... 2
checking size of int16_t... 2
checking size of uint16_t... 2
checking size of int32_t... 4
checking size of uint32_t... 4
checking size of int64_t... 8
checking size of off_t... 8
checking size of off64_t... 8
checking size of time_t... 8
checking size of char*... 8
checking for inline... inline
checking for long double with more range or precision than double... yes
checking for uid_t in sys/types.h... yes
checking for mode_t... yes
checking for off_t... yes
checking for size_t... yes
checking for pid_t... yes
checking for id_t... yes
checking type of array argument to getgroups... gid_t
checking for struct stat.st_rdev... yes
checking for struct stat.st_mtimensec... no
checking for struct stat.st_mtimespec.tv_nsec... no
checking for struct stat.st_mtim.tv_nsec... yes
checking for socklen_t... yes
checking for errno in errno.h... yes
checking for connect... yes
checking for library containing inet_ntop... none required
checking for library containing iconv_open... none required
checking for library containing libiconv_open... no
checking for iconv declaration...
         extern size_t iconv (iconv_t cd, char * *inbuf, size_t *inbytesleft, char * *outbuf, size_t *outbytesleft);
checking for inet_ntop... yes
checking for inet_pton... yes
checking for struct addrinfo... yes
checking for struct sockaddr_storage... yes
checking whether defines needed by getaddrinfo exist... yes
checking for getaddrinfo... yes
checking for struct sockaddr.sa_len... no
checking for struct sockaddr_in.sin_len... no
checking for struct sockaddr_un.sun_len... no
checking for struct sockaddr_in6.sin6_scope_id... yes
checking for struct stat64... yes
checking for strcasecmp... yes
checking for aclsort... no
checking for aclsort in -lsec... no
checking for utime.h... (cached) yes
checking whether utime accepts a null argument... yes
checking for size_t... (cached) yes
checking for working alloca.h... yes
checking for alloca... yes
checking for waitpid... yes
checking for wait4... yes
checking for getcwd... yes
checking for chown... yes
checking for chmod... yes
checking for lchmod... yes
checking for mknod... yes
checking for mkfifo... yes
checking for fchmod... yes
checking for fstat... yes
checking for ftruncate... yes
checking for strchr... yes
checking for readlink... yes
checking for link... yes
checking for utime... yes
checking for utimes... yes
checking for lutimes... yes
checking for strftime... yes
checking for chflags... no
checking for getattrlist... no
checking for mktime... yes
checking for innetgr... yes
checking for linkat... yes
checking for memmove... yes
checking for lchown... yes
checking for vsnprintf... yes
checking for snprintf... yes
checking for vasprintf... yes
checking for asprintf... yes
checking for setsid... yes
checking for strpbrk... yes
checking for strlcat... no
checking for strlcpy... no
checking for strtol... yes
checking for mallinfo... yes
checking for getgroups... yes
checking for setgroups... yes
checking for geteuid... yes
checking for getegid... yes
checking for setlocale... yes
checking for setmode... no
checking for open64... yes
checking for lseek64... yes
checking for mkstemp64... yes
checking for mtrace... yes
checking for va_copy... no
checking for __va_copy... no
checking for seteuid... yes
checking for strerror... yes
checking for putenv... yes
checking for iconv_open... yes
checking for locale_charset... no
checking for nl_langinfo... yes
checking for getxattr... yes
checking for extattr_get_link... no
checking for sigaction... yes
checking for sigprocmask... yes
checking for setattrlist... no
checking for getgrouplist... yes
checking for initgroups... yes
checking for utimensat... yes
checking for posix_fallocate... yes
checking for attropen... no
checking for setvbuf... yes
checking for nanosleep... yes
checking for usleep... yes
checking for useable fallocate... yes
checking for FALLOC_FL_PUNCH_HOLE... yes
checking for FALLOC_FL_ZERO_RANGE... yes
checking for SYS_fallocate... yes
checking whether posix_fallocate is efficient... no
checking for getpgrp... yes
checking for tcgetpgrp... yes
checking whether getpgrp requires zero arguments... yes
checking whether chown() modifies symlinks... no
checking whether link() can hard-link symlinks... yes
checking whether link() can hard-link special files... yes
checking for working socketpair... yes
checking for getpass... yes
checking for poptGetContext in -lpopt... yes
checking whether to use included libpopt... no
checking whether to use included zlib... ./zlib
checking for unsigned char... yes
checking for broken readdir... no
checking for utimbuf... yes
checking if gettimeofday takes tz argument... yes
checking for C99 vsnprintf... yes
checking for secure mkstemp... yes
checking if mknod creates FIFOs... yes
checking if mknod creates sockets... yes
checking whether -c -o works... yes
checking for _acl... no
checking for __acl... no
checking for _facl... no
checking for __facl... no
checking whether to support ACLs... running tests:
checking for acl_get_file in -lacl... yes
checking for ACL support... yes
checking ACL test results... Using posix ACLs
checking for acl_get_perm_np... no
checking whether to support extended attributes... Using Linux xattrs
checking for getxattr in -lattr... yes
configure.sh: creating ./config.status
config.status: creating Makefile
config.status: creating lib/dummy
config.status: creating zlib/dummy
config.status: creating popt/dummy
config.status: creating shconfig
config.status: creating config.h

    rsync 3.2.3 configuration successful

>>> Source configured.
>>> Compiling source in /var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3 ...
make -j9
gawk -f ./daemon-parm.awk ./daemon-parm.txt
gawk -f ./help-from-md.awk -v hfile=help-rsync.h ./rsync.1.md
gawk -f ./help-from-md.awk -v hfile=help-rsyncd.h ./rsync.1.md
./mkgitver
gawk -f ./define-from-md.awk -v hfile=default-cvsignore.h ./rsync.1.md
gawk -f ./define-from-md.awk -v hfile=default-dont-compress.h ./rsync.1.md
sed 's;\@bindir\@;/usr/bin;g' <./stunnel-rsyncd.conf.in >stunnel-rsyncd.conf
gawk -f ./mkproto.awk ./*.c ./lib/compat.c daemon-parm.h
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c rsync.c -o rsync.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c generator.c -o generator.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c receiver.c -o receiver.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c cleanup.c -o cleanup.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c sender.c -o sender.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c exclude.c -o exclude.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c util.c -o util.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c util2.c -o util2.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c main.c -o main.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c checksum.c -o checksum.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c match.c -o match.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c syscall.c -o syscall.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c log.c -o log.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c backup.c -o backup.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c delete.c -o delete.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c options.c -o options.o
syscall.c: In function ▒do_chmod▒:
syscall.c:259:5: warning: ▒code▒ may be used uninitialized in this function [-Wmaybe-uninitialized]
  259 |  if (code != 0 && (preserve_perms || preserve_executability))
      |     ^
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c io.c -o io.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c compat.c -o compat.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c hlink.c -o hlink.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c token.c -o token.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c uidlist.c -o uidlist.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c socket.c -o socket.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c hashtable.c -o hashtable.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c fileio.c -o fileio.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c batch.c -o batch.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c clientname.c -o clientname.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c chmod.c -o chmod.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c acls.c -o acls.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c xattrs.c -o xattrs.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c progress.c -o progress.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c pipe.c -o pipe.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c params.c -o params.o
x86_64-pc-linux-gnu-gcc -I. -Wa,--noexecstack -c -o lib/md5-asm-x86_64.o ./lib/md5-asm-x86_64.S
x86_64-pc-linux-gnu-g++ -I. -O2 -pipe -fno-exceptions -fno-rtti -c -o simd-checksum-x86_64.o ./simd-checksum-x86_64.cpp
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c loadparm.c -o loadparm.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c clientserver.c -o clientserver.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c access.c -o access.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c connection.c -o connection.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c authenticate.c -o authenticate.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/wildmatch.c -o lib/wildmatch.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/compat.c -o lib/compat.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/snprintf.c -o lib/snprintf.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/mdfour.c -o lib/mdfour.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/md5.c -o lib/md5.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/permstring.c -o lib/permstring.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/pool_alloc.c -o lib/pool_alloc.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/sysacls.c -o lib/sysacls.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c lib/sysxattrs.c -o lib/sysxattrs.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/deflate.c -o zlib/deflate.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/inffast.c -o zlib/inffast.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/inflate.c -o zlib/inflate.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/inftrees.c -o zlib/inftrees.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/trees.c -o zlib/trees.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/zutil.c -o zlib/zutil.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/adler32.c -o zlib/adler32.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/compress.c -o zlib/compress.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c zlib/crc32.c -o zlib/crc32.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c flist.c -o flist.o
x86_64-pc-linux-gnu-gcc -I. -I. -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W  -c usage.c -o usage.o
x86_64-pc-linux-gnu-gcc -I./zlib -march=core2 -O2 -pipe -DHAVE_CONFIG_H -Wall -W -Wl,-O1 -Wl,--as-needed -o rsync flist.o rsync.o generator.o receiver.o cleanup.o sender.o exclude.o util.o util2.o main.o checksum.o match.o syscall.o log.o backup.o delete.o options.o io.o compat.o hlink.o token.o uidlist.o socket.o hashtable.o usage.o fileio.o batch.o clientname.o chmod.o acls.o xattrs.o progress.o pipe.o lib/md5-asm-x86_64.o simd-checksum-x86_64.o params.o loadparm.o clientserver.o access.o connection.o authenticate.o lib/wildmatch.o lib/compat.o lib/snprintf.o lib/mdfour.o lib/md5.o lib/permstring.o lib/pool_alloc.o lib/sysacls.o lib/sysxattrs.o  zlib/deflate.o zlib/inffast.o zlib/inflate.o zlib/inftrees.o zlib/trees.o zlib/zutil.o zlib/adler32.o zlib/compress.o zlib/crc32.o  -lattr -lacl -lpopt -lcrypto
>>> Source compiled.
>>> Test phase [not enabled]: net-misc/rsync-3.2.3-r3

>>> Install net-misc/rsync-3.2.3-r3 into /var/tmp/portage/net-misc/rsync-3.2.3-r3/image
make -j9 DESTDIR=/var/tmp/portage/net-misc/rsync-3.2.3-r3/image install
/bin/mkdir -p /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/bin
/usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c  -m 755 rsync /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/bin
/usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 755 ./rsync-ssl /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/bin
/bin/mkdir -p /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man1
/bin/mkdir -p /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man5
if test -f rsync.1; then /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 644 rsync.1 /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man1; fi
if test -f rsync-ssl.1; then /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 644 rsync-ssl.1 /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man1; fi
if test -f rsyncd.conf.5; then /usr/lib/portage/python3.8/ebuild-helpers/xattr/install -c -m 644 rsyncd.conf.5 /var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/man/man5; fi
ERROR:root:Failed to copy file: _parsed_options=Namespace(group=-1, mode=420, owner=-1, preserve_timestamps=False), source=b'NEWS.md', dest_dir=b'/var/tmp/portage/net-misc/rsync-3.2.3-r3/image/usr/share/doc/rsync-3.2.3-r3'
Traceback (most recent call last):
  File "/usr/lib/portage/python3.8/doins.py", line 193, in run
    copyfile(source, dest)
  File "/usr/lib/python3.8/site-packages/portage/util/file_copy/__init__.py", line 30, in _optimized_copyfile
    _file_copy(src_file.fileno(), dst_file.fileno())
BlockingIOError: [Errno 11] Resource temporarily unavailable
 * ERROR: net-misc/rsync-3.2.3-r3::gentoo failed (install phase):
 *   dodoc failed
 *
 * If you need support, post the output of `emerge --info '=net-misc/rsync-3.2.3-r3::gentoo'`,
 * the complete build log and the output of `emerge -pqv '=net-misc/rsync-3.2.3-r3::gentoo'`.
 * The complete build log is located at '/var/tmp/portage/net-misc/rsync-3.2.3-r3/temp/build.log'.
 * The ebuild environment file is located at '/var/tmp/portage/net-misc/rsync-3.2.3-r3/temp/environment'.
 * Working directory: '/var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3'
 * S: '/var/tmp/portage/net-misc/rsync-3.2.3-r3/work/rsync-3.2.3'

>>> Failed to emerge net-misc/rsync-3.2.3-r3, Log file:

>>>  '/var/tmp/portage/net-misc/rsync-3.2.3-r3/temp/build.log'

_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
guitou
Guru
Guru


Joined: 02 Oct 2003
Posts: 521
Location: France

PostPosted: Thu Apr 29, 2021 5:32 pm    Post subject: Reply with quote

Hello.

Just for my enlightenment:
Code:
_parsed_options=Namespace(group=-1, mode=420, owner=-1, preserve_timestamps=False)


Is there a special meaning for -1 as user or group for install command (either the ebuild helper command or the underlying system command)?..
Or could it simply be the matter?

++
Gi)
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Fri Apr 30, 2021 2:33 pm    Post subject: Reply with quote

If that question about -1 and permissions was aimed at me I certainly don't know. However I did notice it..
_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
guitou
Guru
Guru


Joined: 02 Oct 2003
Posts: 521
Location: France

PostPosted: Fri Apr 30, 2021 5:19 pm    Post subject: Reply with quote

Hi.

drescherjm wrote:
If that question about -1 and permissions was aimed at me I certainly don't know. However I did notice it..


Well, I would tend to believe there is a special meaning for these -1 uid and gid, but searching a little (surely not enough) about this gave nothing relevant...
I was rather expecting some knowledge from a system or most probably portage guru, than anything else :)

++
Gi)
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Mon May 03, 2021 1:43 pm    Post subject: Reply with quote

Thanks
_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Sat Jun 05, 2021 3:22 pm    Post subject: Reply with quote

This is still happening and is hampering my ability to emerge packages. However I do have a second gentoo machine with the same generation of CPU so I use that to produce binary packages when the build fails on this one at the dodoc stage.

Yesterday I used lxc to create a gentoo guest for testing. I used the gentoo template and with minimal changes to the default settings (did not add my ldap or change permissions) the emerge of bzip2 failed in the exact same way on the guest. It seems something is specific to this system. I have 2 guesses both are kernel related. Because of a problem with an LTO tape device attached to this system with the 4.19 kernel I am using I have stayed at 4.14.X kernels for several years. I am using a recent version. My second kernel related thought is I am using openzfs 2.X but not all the features are enabled. I am waiting to upgrade to 2.1 and plan to enable 0.8.x as the feature set for the data raidz3 and probably grub2 for the root.
_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
Tony0945
Advocate
Advocate


Joined: 25 Jul 2006
Posts: 4898
Location: Illinois, USA

PostPosted: Sat Jun 05, 2021 4:03 pm    Post subject: Reply with quote

One possibilty, build a second kernel using latest stable genntoo-sources. Boot into this for emerges. boot into the old kernel for everything else.
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Thu Jun 10, 2021 10:50 pm    Post subject: Reply with quote

I installed gentoo-sources-4.19.194 and the emerge of bzip2 no longer has this issue.

I will have to thoroughly test the tape drive. The LTO7 tape drive issue was instead of writing valid data on the tape early versions of 4.19 wrote only zeros. Switching back to 4.14 fixed that and I just kept using 4.14 kernels for years instead of upgrading to newer kernels.
_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
drescherjm
Advocate
Advocate


Joined: 05 Jun 2004
Posts: 2788
Location: Pittsburgh, PA, USA

PostPosted: Fri Jun 18, 2021 11:07 pm    Post subject: Reply with quote

The LTO7 tape drive tested out fine on this kernel. I did a bacula backup of almost 1TB then restored the backup in a different folder tree then used md5deep to verify each tree against the other and even compared the text output sorted to make 100% sure there was not a single bit out of place.

In the early 4.19.1 .. some low revision the tape drive wrote zeros instead of data under sum circumstances. I believe this was around the time where the kernels were being patched for spectre & meltdown. My fix for that at the time was to go back to 4.14 kernels and stay there.
_________________
John

My gentoo overlay
Instructons for overlay
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Portage & Programming All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum