[solved] python-3.4.8-r1 - failed to build _hashlib _ssl

[Skippy204]

Full build log is here:

https://paste.pound-python.org/show/Hcf ... nhZfx1Ae7/

Excerpt of problem:

Code: Select all

Python build finished successfully!
The necessary bits to build these optional modules were not found:
nis                                                            
To find the necessary bits, look in setup.py in detect_modules() for the module's name.


Failed to build these modules:
_hashlib              _ssl                                     

emerge --info '=dev-lang/python-3.4.8-r1::gentoo'

Code: Select all

Portage 2.3.58 (python 2.7.15-final-0, default/linux/amd64/17.0/desktop, gcc-8.2.0, glibc-2.28-r5, 4.19.12-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-4.19.12-gentoo-x86_64-Intel-R-_Core-TM-_i7_CPU_920_@_2.67GHz-with-gentoo-2.6
KiB Mem:    12265976 total,    191968 free
KiB Swap:   19535036 total,  19535036 free
Timestamp of repository gentoo: Wed, 23 Jan 2019 23:30:01 +0000
Head commit of repository gentoo: d678e7ae57b537f75179aaed8307b9212140eb22
sh bash 5.0_p2
ld GNU ld (Gentoo 2.31.1 p5) 2.31.1
app-shells/bash:          5.0_p2::gentoo
dev-java/java-config:     2.2.0-r4::gentoo
dev-lang/perl:            5.28.0::gentoo
dev-lang/python:          2.7.15::gentoo, 3.4.8-r1::gentoo, 3.6.6::gentoo
dev-util/cmake:           3.13.2::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/openrc:          0.40.3::gentoo
sys-apps/sandbox:         2.15::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.11.6-r3::gentoo, 1.16.1-r1::gentoo
sys-devel/binutils:       2.31.1-r3::gentoo
sys-devel/gcc:            8.2.0-r6::gentoo
sys-devel/gcc-config:     2.0::gentoo
sys-devel/libtool:        2.4.6-r5::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 4.20::gentoo (virtual/os-headers)
sys-libs/glibc:           2.28-r5::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-metamanifest: no
    sync-rsync-extra-opts:
    sync-rsync-verify-max-age: 24

Skippy
    location: /usr/local/portage/skippy
    masters: gentoo

x-portage
    location: /usr/local/portage
    masters: gentoo
    priority: 0

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/angband/gamedata/ /etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=native -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--quiet-build=n"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://gentoo.mirrors.tds.net/gentoo ftp://cosmos.illinois.edu/pub/gentoo/ http://91.121.188.201/gentoo-distfiles/ ftp://ftp.snt.utwente.nl/pub/os/linux/gentoo"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LINGUAS="en en_GB en_US"
MAKEOPTS="-j7"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acl acpi aim alsa amd64 amrnb amrub arts aspell berkdb branding bzip2 cairo cdda cddb cdr cli consolekit crypt css cups cxx dbus dillo dri dts dvd dvdr emboss encode exif extensions extras fam ffmpeg flac fontconfig fortran fts3 gdbm gif gimp glamor gnutls gpm gstreamer gtk hddtemp iconv id3tag imagemagick imap ipod ipv6 jack jadetex java jpeg jpeg2k kipi ladspa lcms ldap libnotify libsamplerate libtirpc lm_sensors mad midi mikmod mjpeg mmx mng mono mp3 mp4 mpeg mplayer multilib musepack musicbrainz mysql ncurses nls nptl nvidia offensive ogg opengl openmp oscar pam pango pcre pdf png policykit portaudio ppds qt3support qt5 quicktime readline redeyes scanner sdl seccomp secure-delete semantic-desktop smp sndfile soundtouch spamassassin spell sql sqlite sse sse2 ssl startup-notification svg tcpd theora tiff truetype twolame udev udisks ukit unicode upower usb vamp vcd vorbis wavpack wmf wxwidgets x264 xattr xcb xinerama xml xmp xv xvid xvmc zlib" ABI_X86="32 64" ALSA_CARDS="hda-intel intel8x0 intel8x0m" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse" KERNEL="linux" L10N="en en_GB en_US" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-1" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" RUBY_TARGETS="ruby24" USERLAND="GNU" VIDEO_CARDS="nvidia fbdev vesa" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

=================================================================
                        Package Settings
=================================================================

dev-lang/python-3.4.8-r1::gentoo was built with the following:
USE="gdbm ipv6 ncurses readline sqlite ssl (threads) tk xml -bluetooth -build -examples -hardened -libressl -wininst" ABI_X86="(64)"
CFLAGS="-march=native -O2 -pipe -fwrapv"
CXXFLAGS="-march=native -O2 -pipe -fwrapv"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -L."

Looking on the forum I found some similar looking situations:

viewtopic-t-1077812-highlight-hashlib.html

viewtopic-t-1066222-highlight-hashlib.html

They point to openssl as the cause of the problem. Here is where I am with openssl:

Code: Select all

[I] dev-libs/openssl
     Available versions:
     (0.9.8) 0.9.8z_p8-r1^d
     (0)    1.0.2q^d{tbz2} (~)1.1.0j(0/1.1)^d{tbz2} [M](~)1.1.1a(0/1.1)^d [M](~)1.1.1a-r1(0/1.1)^d
     (1.0.0) [m](~)1.0.2q-r200^t
       {+asm bindist gmp kerberos rfc3779 sctp sslv2 (+)sslv3 static-libs test (+)tls-heartbeat vanilla zlib ABI_MIPS="n32 n64 o32" ABI_PPC="32 64" ABI_S390="32 64" ABI_X86="32 64 x32" CPU_FLAGS_X86="sse2" ELIBC="musl"}
     Installed versions:  1.1.0j(0/1.1)^d{tbz2}(01:14:02 PM 01/19/2019)(asm zlib -bindist -rfc3779 -sctp -static-libs -test -tls-heartbeat -vanilla ABI_MIPS="-n32 -n64 -o32" ABI_PPC="-32 -64" ABI_S390="-32 -64" ABI_X86="32 64 -x32" CPU_FLAGS_X86="sse2" ELIBC="-musl")
     Homepage:            https://www.openssl.org/
     Description:         full-strength general purpose cryptography library (including SSL and TLS)

I wanted to get expert input before I start doing something stupid and break things worse.

Thank you.

[fedeliallalinea]

I think that python-3.4 not support openssl-1.1, but because you have yet this version installed?
Default PYTHON_TARGETS set by profile are python2_7 and python3_6, so python3_4 isn't longer required.

See also https://bugs.gentoo.org/673960

[jmanko]

I think that python-3.4 not support openssl-1.1, but because you have yet this version installed?
Default PYTHON_TARGETS set by profile are python2_7 and python3_6, so python3_4 isn't longer required.

See also https://bugs.gentoo.org/673960

Portage forces installation of 3.4.

Code: Select all

# emerge -uDv system

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild     U  ] sys-apps/diffutils-3.7::gentoo [3.6-r1::gentoo] USE="nls -static" 0 KiB
[ebuild     U  ] sys-apps/texinfo-6.5-r1::gentoo [6.5::gentoo] USE="nls -static" 0 KiB
[ebuild     U  ] app-editors/nano-3.2::gentoo [3.1::gentoo] USE="magic ncurses nls spell unicode -debug -justify -minimal -slang -static" 0 KiB
[ebuild     U  ] sys-apps/iproute2-4.20.0::gentoo [4.19.0-r1::gentoo] USE="iptables ipv6 -atm -berkdb -caps -elf -minimal (-selinux)" 0 KiB
[ebuild  NS    ] dev-lang/python-3.4.8-r1:3.4/3.4m::gentoo [2.7.15:2.7::gentoo, 3.5.5-r1:3.5/3.5m::gentoo, 3.6.6:3.6/3.6m::gentoo, 3.7.0:3.7/3.7m::gentoo] USE="gdbm hardened ipv6 ncurses readline ssl (threads%*) xml -bluetooth -build -examples -libressl -sqlite* -tk -wininst (-test%)" 0 KiB
[ebuild     U  ] www-servers/apache-2.4.38:2::gentoo [2.4.37-r1:2::gentoo] USE="ssl suexec suexec-caps -debug -doc -gdbm -ldap -libressl (-selinux) -static -suexec-syslog -threads" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_core authn_dbm authn_file authz_core authz_dbm authz_host authz_owner authz_user autoindex cache cgid dav dav_fs dav_lock dir env expires ext_filter filter headers include info log_config logio mime negotiation rewrite setenvif socache_shmcb speling status unique_id unixd usertrack version vhost_alias -access_compat -asis -auth_digest -authn_dbd -authz_dbd -authz_groupfile -brotli -cache_disk -cache_socache -cern_meta -cgi -charset_lite -dbd -deflate -dumpio -file_cache -http2 -ident -imagemap -lbmethod_bybusyness -lbmethod_byrequests -lbmethod_bytraffic -lbmethod_heartbeat -log_forensic -macro -md -mime_magic -proxy -proxy_ajp -proxy_balancer -proxy_connect -proxy_fcgi -proxy_ftp -proxy_html -proxy_http -proxy_http2 -proxy_scgi -proxy_wstunnel -ratelimit -remoteip -reqtimeout -slotmem_shm -substitute -userdir -watchdog -xml2enc" APACHE2_MPMS="prefork -event -worker" 0 KiB
[ebuild     U  ] net-libs/gnutls-3.6.5:0/30::gentoo [3.5.19-r1:0/30::gentoo] USE="cxx idn nls openssl seccomp tls-heartbeat -dane -doc -examples -guile -pkcs11 -sslv2 -sslv3 -static-libs -test -test-full -tools -valgrind (-openpgp%) (-zlib%*)" ABI_X86="(64) -32 (-x32)" 0 KiB
[ebuild     U  ] dev-libs/libuv-1.25.0:0/1::gentoo [1.24.1:0/1::gentoo] USE="-static-libs" ABI_X86="(64) -32 (-x32)" 0 KiB
[ebuild     U  ] virtual/editor-0-r2::gentoo [0-r1::gentoo] 0 KiB
[ebuild     U  ] dev-util/cmake-3.13.3::gentoo [3.12.3::gentoo] USE="ncurses -doc -emacs -qt5 -system-jsoncpp -test" 0 KiB
[ebuild     U  ] dev-vcs/subversion-1.11.1::gentoo [1.8.18::gentoo] USE="apache2 http nls perl sasl -berkdb* -ctypes-python -debug -doc -dso -extras -gnome-keyring -java -kwallet -python -ruby -test -vim-syntax" PYTHON_TARGETS="python2_7" 0 KiB
[ebuild  N     ] dev-python/certifi-2018.11.29::gentoo  PYTHON_TARGETS="python2_7 python3_4 python3_5 python3_6 python3_7 -pypy -pypy3" 0 KiB
[ebuild     U  ] dev-python/pypax-0.9.4::gentoo [0.9.2::gentoo] USE="xtpax -ptpax*" PYTHON_TARGETS="python2_7 python3_6* -pypy -python3_4* -python3_5" 0 KiB
[ebuild     U  ] sys-apps/elfix-0.9.4::gentoo [0.9.2::gentoo] USE="xtpax -ptpax*" 0 KiB
[ebuild     U  ] app-admin/perl-cleaner-2.27::gentoo [2.26-r1::gentoo] 0 KiB
[ebuild     U  ] dev-vcs/git-2.20.1::gentoo [2.20.0::gentoo] USE="blksha1 curl gpg iconv nls pcre perl python subversion threads webdav -cgi -cvs -doc -emacs -gnome-keyring -highlight -libressl -mediawiki -mediawiki-experimental (-pcre-jit) (-ppcsha1) -test -tk -xinetd" PYTHON_TARGETS="python2_7" 0 KiB
[ebuild     U  ] sys-apps/openrc-0.40.3::gentoo [0.39.2::gentoo] USE="ncurses netifrc pam unicode -audit -debug -newnet (-prefix) (-selinux) -static-libs" 0 KiB
[ebuild     U  ] sys-fs/eudev-3.2.7-r1::gentoo [3.2.7::gentoo] USE="hwdb kmod static-libs -introspection -rule-generator (-selinux) -test" ABI_X86="(64) -32 (-x32)" 0 KiB

Total: 18 packages (16 upgrades, 1 new, 1 in new slot), Size of downloads: 0 KiB

The following USE changes are necessary to proceed:
 (see "package.use" in the portage(5) man page for more details)
# required by dev-python/setuptools-9999::gentoo
# required by dev-python/pypax-0.9.4::gentoo
# required by sys-apps/elfix-0.9.4::gentoo
# required by @system
# required by @world (argument)
>=dev-python/certifi-2018.11.29 python_targets_python3_4

Use --autounmask-write to write changes to config files (honoring
CONFIG_PROTECT). Carefully examine the list of proposed changes,
paying special attention to mask or keyword changes that may expose
experimental or unstable packages.

Code: Select all

# emerge -uDv system --exclude python

These are the packages that would be merged, in order:

Calculating dependencies... done!

The following USE changes are necessary to proceed:
 (see "package.use" in the portage(5) man page for more details)
# required by app-portage/gemato-14.0::gentoo
# required by sys-apps/portage-2.3.58::gentoo[-build,rsync-verify]
# required by virtual/package-manager-1::gentoo
# required by @system (argument)
>=dev-python/setuptools-9999 python_targets_python3_4

Use --autounmask-write to write changes to config files (honoring
CONFIG_PROTECT). Carefully examine the list of proposed changes,
paying special attention to mask or keyword changes that may expose
experimental or unstable packages.

 * In order to avoid wasting time, backtracking has terminated early
 * due to the above autounmask change(s). The --autounmask-backtrack=y
 * option can be used to force further backtracking, but there is no
 * guarantee that it will produce a solution.

!!! All ebuilds that could satisfy "dev-lang/python:3.4[threads(+)]" have been masked.
!!! One of the following masked packages is required to complete your request:
- dev-lang/python-3.4.8-r1::gentoo (masked by: exclude option)
- dev-lang/python-3.4.8::gentoo (masked by: exclude option)
- dev-lang/python-3.4.6-r1::gentoo (masked by: exclude option)
- dev-lang/python-3.4.5-r1::gentoo (masked by: exclude option)

(dependency required by "app-portage/gemato-14.0::gentoo[python_targets_python3_4]" [installed])
(dependency required by "sys-apps/portage-2.3.58::gentoo[-build,rsync-verify]" [installed])
(dependency required by "virtual/package-manager-1::gentoo" [installed])
(dependency required by "@system" [argument])
For more information, see the MASKED PACKAGES section in the emerge
man page or refer to the Gentoo Handbook.

[fedeliallalinea]

Probably you have an entry in package.use

Code: Select all

$ grep -r python3_4 /etc/portage/package.use

[jmanko]

Probably you have an entry in package.use

Code: Select all

$ grep -r python3_4 /etc/portage/package.use

The resolution was to remove Python 3.4 from the system, and of course remove from eselect:

Code: Select all

# eselect python edit

Recompile each python module that was compiled again 3.4. Be sure to add the -python_targets_python3_4 use flag to each module.

When emerging, run with option --exclude python to avoid emerging 3.4 again. It took a while, but I finally got everything in order.

[Skippy204]

Found my problem. I had some python 3.4 use flags set in package.use.

Cleared all those out and everything is fine.

Thank you.