I don't get why qtwebengine won't install from binhost

Message

chaoscommander · Post by **chaoscommander** » Thu Aug 15, 2024 9:32 am

I just discovered the binhost project and was delighted to no longer have to compile monstrosities such as qtwebengine myself. I set everything up according to the Wiki page and it seems to be working in general. But my personal favourite package qtwebengine still wants to build from source. Here's what I tried:

emerge output when just trying to install/update qtwebengine:

Code: Select all

!!! The following binary packages have been ignored due to non matching USE:

    =dev-qt/qtwebengine-6.7.2 bindist

This is a little unclear. Do I NEED bindist activated for the binary to be used or do I need to NOT have bindist activated?

Anyway, since setting -bindist on the package didn't change anything, I assume it's the former.

Code: Select all

graptolith /home/martin # euse -E bindist -p dev-qt/qtwebengine
Adding "dev-qt/qtwebengine[bindist]" use flag in "/etc/portage/package.use"
graptolith /home/martin # emerge --pretend -1 qtwebengine
/usr/lib/python3.12/site-packages/portage/package/ebuild/_config/KeywordsManager.py:86: UserWarning: /etc/portage/package.keywords is deprecated, use /etc/portage/package.accept_keywords instead
  warnings.warn(

Local copy of remote index is up-to-date and will be used.

These are the packages that would be merged, in order:

Calculating dependencies... done!
Dependency resolution took 16.14 s (backtrack: 1/20).

[binary  NS    ] dev-qt/qtwebchannel-6.7.2-1 [5.15.14]
[ebuild  NS    ] dev-qt/qtwebengine-6.7.2 [5.15.14_p20240510] USE="bindist* opengl%* qml%* system-icu* vulkan%* -accessibility% -custom-cflags% -pdfium% -vaapi% -webdriver%"

No more complaints about USE mismatch, but Portage just decides to rebuild qtwebengine from source anyway. Why?

So I reset the USE flag and try to find the problem using the command from the Wiki page's troubleshooting section. Now it wants to use the binary but it can't:

Code: Select all

graptolith /home/martin # euse -R bindist -p dev-qt/qtwebengine
Removing "dev-qt/qtwebengine[bindist]" use flag in "/etc/portage/package.use"
graptolith /home/martin # emerge --pretend --getbinpkg --usepkgonly --binpkg-respect-use=n qtwebengine
/usr/lib/python3.12/site-packages/portage/package/ebuild/_config/KeywordsManager.py:86: UserWarning: /etc/portage/package.keywords is deprecated, use /etc/portage/package.accept_keywords instead
  warnings.warn(

Local copy of remote index is up-to-date and will be used.

These are the packages that would be merged, in order:

Calculating dependencies... done!
Dependency resolution took 35.46 s (backtrack: 9/20).

[binary     UD ] media-libs/libvpx-1.13.1-r1-1 [1.14.1] ABI_X86="-32*" 
[binary  NS    ] dev-qt/qtwebchannel-6.7.2-1 [5.15.14]
[binary  NS    ] dev-qt/qtwebengine-6.7.2-1 [5.15.14_p20240510] USE="bindist* opengl%* qml%* system-icu* vulkan%* -accessibility% -custom-cflags% -pdfium% -vaapi% -webdriver%" 

!!! Multiple package instances within a single package slot have been pulled
!!! into the dependency graph, resulting in a slot conflict:

media-libs/libvpx:0

  (media-libs/libvpx-1.13.1-r1-1:0/8::gentoo, binary scheduled for merge) USE="highbitdepth postproc threads -doc -static-libs -test" ABI_X86="(64) -32 (-x32)" pulled in by
    media-libs/libvpx:0/8= required by (dev-qt/qtwebengine-6.7.2-1:6/6.7.2::gentoo, binary scheduled for merge) USE="alsa bindist jumbo-build opengl pulseaudio qml screencast system-icu vulkan widgets -accessibility -custom-cflags -designer -geolocation -kerberos -pdfium -test -vaapi -webdriver" ABI_X86="(64)"
                     ^^^^^                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             

  (media-libs/libvpx-1.14.1:0/9::gentoo, installed) USE="highbitdepth postproc threads -doc -static-libs -test" ABI_X86="32 (64) (-x32)" pulled in by
    >=media-libs/libvpx-1.8.2:0/9=[postproc] required by (mail-client/thunderbird-115.9.0:0/0::gentoo, installed) USE="X clang dbus openh264 pulseaudio system-av1 system-harfbuzz system-jpeg system-libevent system-librnp system-libvpx system-webp wayland -debug -eme-free -hardened -hwaccel -jack -libproxy -lto (-pgo) (-selinux) -sndio (-system-icu) -system-png (-system-python-libs) -wifi" ABI_X86="(64)" L10N="de -af -ar -ast -be -bg -br -ca -cak -cs -cy -da -dsb -el -en-CA -en-GB -es-AR -es-ES -es-MX -et -eu -fi -fr -fy -ga -gd -gl -he -hr -hsb -hu -id -is -it -ja -ka -kab -kk -ko -lt -lv -ms -nb -nl -nn -pa -pl -pt-BR -pt-PT -rm -ro -ru -sk -sl -sq -sr -sv -th -tr -uk -uz -vi -zh-CN -zh-TW"
                             ^^^^^                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  
    >=media-libs/libvpx-1.4.0:=[abi_x86_32(-)?,abi_x86_64(-)?,abi_x86_x32(-)?,abi_mips_n32(-)?,abi_mips_n64(-)?,abi_mips_o32(-)?,abi_s390_32(-)?,abi_s390_64(-)?] required by (media-video/ffmpeg-6.1.1-r8:0/58.60.60::gentoo, installed) USE="X alsa bzip2 dav1d encode gnutls gpl iconv lcms libass mp3 network opengl openssl opus pic postproc pulseaudio sdl svg threads truetype vorbis vpx vulkan x264 xvid zlib (-amf) -amr -amrenc (-appkit) -bluray -bs2b -cdio -chromaprint -chromium -codec2 -cpudetection (-cuda) -debug -doc -fdk -flite -fontconfig -frei0r -fribidi -gcrypt -glslang -gme -gmp -gsm -hardcoded-tables -iec61883 -ieee1394 -jack -jpeg2k -jpegxl -kvazaar -ladspa -libaom -libaribb24 -libcaca -libdrm -libilbc -libplacebo -librtmp -libsoxr -libtesseract -libv4l -libxml2 -lv2 -lzma (-mipsdspr1) (-mipsdspr2) (-mipsfpu) -modplug -nvenc -openal -opencl -openh264 -oss (-qsv) -rav1e -rubberband -samba -shaderc -snappy -sndio -soc -speex -srt -ssh -static-libs -svt-av1 -test -theora -twolame -v4l -vaapi -vdpau -verify-sig -vidstab (-vmaf) -webp -x265 -zeromq -zimg -zvbi" ABI_X86="32 (64) (-x32)" CPU_FLAGS_X86="aes avx mmx mmxext sse sse2 sse3 sse4_1 sse4_2 ssse3 -3dnow -3dnowext -avx2 -fma3 -fma4 -xop" FFTOOLS="aviocat cws2fws ffescape ffeval ffhash fourcc2pixfmt graph2dot ismindex pktdumper qt-faststart sidxindex trasher"
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             
    (and 2 more with the same problems)

I'm lost. Can anyone walk me through how to resolve this so I won't need to rebuild qtwebengine every time there's an update? Isn't there some way to display the USE flag dependencies, such that I could see why something wants to deactivate bindist on qtwebengine? I couldn't find any.

chaoscommander · Post by **chaoscommander** » Thu Aug 15, 2024 10:00 am

I kept searching and this happened: when I emerge -ea @world, Portage tells me that qtwebengine binary was ignored because of USE mismatch, required: screencast. But if I set it to USE screencast in package.use and repeat the dependency resolution, it now tells me that the USE mismatch is "-screencast". This seems like a paradox to me.

Post by Hu » Thu Aug 15, 2024 11:09 am

When debugging problems like this, you should use --verbose.

For your first problem, it is unclear why Portage did not do what you want.

For your second problem, the binary qtwebengine requires a subslot of libvpx that is older than what you have, so a downgrade would be required. However, downgrading would break the installed thunderbird, and you did not authorize Portage to rebuild or reinstall thunderbird to fix this. Therefore, you get a conflict and cannot proceed.

For your third problem, please do not summarize. Per Guidelines item #4, show us the full command you ran and its full output.

logrusx · Post by **logrusx** » Thu Aug 15, 2024 12:54 pm

Hu wrote: For your third problem, please do not summarize. Per Guidelines item #4, show us the full command you ran and its full output.

May I add comment your EMERGE_DEFAULT_OPTS in your make.conf and pass all options explicitly until the issue is resolved. It's very unpleasant to have to guess which options emerge was passed behind the scenes.

Best Regards,
Georgi

Post by **eschwartz** » Fri Aug 16, 2024 5:27 am

In /var/cache/edb/binhost/gentoo.osuosl.org/releases/amd64/binpackages/23.0/x86-64-v3/Packages

Code: Select all

CPV: dev-qt/qtwebengine-6.7.2
[...]
PATH: dev-qt/qtwebengine/qtwebengine-6.7.2-1.gpkg.tar
[...]
RDEPEND: app-arch/snappy:0/1.1= dev-libs/expat dev-libs/libevent:0/2.1-7= dev-libs/libxml2[icu] dev-libs/libxslt dev-libs/nspr dev-libs/nss ~dev-qt/qtbase-6.7.2:6[-accessibility,gui,opengl,vulkan,widgets] ~dev-qt/qtdeclarative-6.7.2:6[widgets] ~dev-qt/qtwebchannel-6.7.2:6[qml] media-libs/fontconfig media-libs/freetype media-libs/harfbuzz:0/6.0.0= media-libs/lcms:2 media-libs/libjpeg-turbo:0/0.2= media-libs/libpng:0/16= media-libs/libwebp:0/7= media-libs/mesa[gbm(+)] media-libs/openjpeg:2/7= media-libs/opus media-libs/tiff:0/6= sys-apps/dbus sys-apps/pciutils sys-devel/gcc:* sys-libs/zlib:0/1=[minizip] virtual/libudev x11-libs/libX11 x11-libs/libXcomposite x11-libs/libXdamage x11-libs/libXext x11-libs/libXfixes x11-libs/libXrandr x11-libs/libXtst x11-libs/libdrm x11-libs/libxcb:0/1.12= x11-libs/libxkbcommon x11-libs/libxkbfile media-libs/alsa-lib media-libs/libpulse[glib] dev-libs/glib:2 media-video/pipewire:0/0.4= dev-libs/icu:0/74.1= media-libs/libvpx:0/8= >=sys-libs/glibc-2.39-r6
[...]
USE: abi_x86_64 alsa amd64 bindist elibc_glibc jumbo-build kernel_linux opengl pulseaudio qml screencast system-icu vulkan widgets

We can download the raw package archive and try to install it directly:

Code: Select all

$ wget -P /var/cache/binpkgs/dev-qt/qtwebengine/ https://gentoo.osuosl.org/releases/amd64/binpackages/23.0/x86-64-v3/dev-qt/qtwebengine/qtwebengine-6.7.2-1.gpkg.tar
$ emerge -a /var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-6.7.2-1.gpkg.tar

emerge will have no room whatsoever to try installing from source, not if you tell it to install a .gpkg.tar file directly. It will either successfully install the package, or it will tell you exactly what is incompatible about it that is preventing it from doing so.

chaoscommander · Post by **chaoscommander** » Sat Aug 17, 2024 8:31 am

Hey everyone, sorry for my previously incomplete information.

Hu wrote:When debugging problems like this, you should use --verbose.
For your first problem, it is unclear why Portage did not do what you want.

Unfortunately, --verbose does not generate any additional output in this case.

For your second problem, the binary qtwebengine requires a subslot of libvpx that is older than what you have, so a downgrade would be required. However, downgrading would break the installed thunderbird, and you did not authorize Portage to rebuild or reinstall thunderbird to fix this. Therefore, you get a conflict and cannot proceed.

That makes sense, thank you. I'm skipping this one for now in favour of trying eschwartz's idea (see below).

For your third problem, please do not summarize. Per Guidelines item #4, show us the full command you ran and its full output.

Sorry again. Here you go (I'm cutting out the list of hundreds of packages to be installed, hope that's okay):

Code: Select all

emerge -ea @world
[snip]
!!! The following binary packages have been ignored due to non matching USE:
[snip]
    =dev-qt/qtwebengine-5.15.14_p20240510 -screencast
[snip]
euse -D screencast -p dev-qt/qtwebengine
Adding "dev-qt/qtwebengine[-screencast]" use flag in "/etc/portage/package.use"
emerge -ea @world
[snip]
!!! The following binary packages have been ignored due to non matching USE:
[snip]
    =dev-qt/qtwebengine-5.15.14_p20240510 screencast
[snip]

logrusx wrote:May I add comment your EMERGE_DEFAULT_OPTS in your make.conf and pass all options explicitly until the issue is resolved. It's very unpleasant to have to guess which options emerge was passed behind the scenes.

I do not have EMERGE_DEFAULT_OPTS set in make.conf. I only have FEATURES="getbinpkg binpkg-request-signature".

Now, trying eschwartz's suggestion...

Code: Select all

wget -P /var/cache/binpkgs/dev-qt/qtwebengine/ https://mirror.netcologne.de/gentoo/releases/amd64/binpackages/23.0/x86-64/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar
--2024-08-17 10:11:39--  https://mirror.netcologne.de/gentoo/releases/amd64/binpackages/23.0/x86-64/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar
Auflösen des Hostnamens mirror.netcologne.de… 2001:4dd0:1234:1::deb, 194.8.197.22
Verbindungsaufbau zu mirror.netcologne.de|2001:4dd0:1234:1::deb|:443 … verbunden.
HTTP-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 47431680 (45M) [application/octet-stream]
Wird in »/var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar« gespeichert.

qtwebengine-5.15.14_p20240510-1 100%[=======================================================>]  45,23M  11,8MB/s    in 4,1s    

2024-08-17 10:11:43 (11,1 MB/s) - »/var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar« gespeichert [47431680/47431680]
emerge -a /var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar 
Local copy of remote index is up-to-date and will be used.

These are the packages that would be merged, in order:

Calculating dependencies |
*** You need to adjust PKGDIR to emerge this package: /var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar

... done!

I adjusted PKGDIR to /var/cache/binpkgs - no change.

logrusx · Post by **logrusx** » Sat Aug 17, 2024 12:04 pm

chaoscommander wrote:Hey everyone, sorry for my previously incomplete information.
Hu wrote:When debugging problems like this, you should use --verbose.
For your first problem, it is unclear why Portage did not do what you want.
Unfortunately, --verbose does not generate any additional output in this case.

Nevertheless, always include -v.

chaoscommander wrote:
For your second problem, the binary qtwebengine requires a subslot of libvpx that is older than what you have, so a downgrade would be required. However, downgrading would break the installed thunderbird, and you did not authorize Portage to rebuild or reinstall thunderbird to fix this. Therefore, you get a conflict and cannot proceed.
That makes sense, thank you. I'm skipping this one for now in favour of trying eschwartz's idea (see below).

For your third problem, please do not summarize. Per Guidelines item #4, show us the full command you ran and its full output.
Sorry again. Here you go (I'm cutting out the list of hundreds of packages to be installed, hope that's okay):
Code: Select all
emerge -ea @world
[snip]
!!! The following binary packages have been ignored due to non matching USE:
[snip]
    =dev-qt/qtwebengine-5.15.14_p20240510 -screencast
[snip]
euse -D screencast -p dev-qt/qtwebengine
Adding "dev-qt/qtwebengine[-screencast]" use flag in "/etc/portage/package.use"
emerge -ea @world
[snip]
!!! The following binary packages have been ignored due to non matching USE:
[snip]
    =dev-qt/qtwebengine-5.15.14_p20240510 screencast
[snip]

That command is wrong. Where did you come up with the idea to run an --emptytree emrge from? Just run a normal full world update. And please use wgetpaste to post full command and full output. We need to see the command in full. It's like you know better what to show when in fact you're the one asking for help. We can notice something you don't think is relevant. Forget about those snippets.

chaoscommander wrote:
logrusx wrote:May I add comment your EMERGE_DEFAULT_OPTS in your make.conf and pass all options explicitly until the issue is resolved. It's very unpleasant to have to guess which options emerge was passed behind the scenes.
I do not have EMERGE_DEFAULT_OPTS set in make.conf. I only have FEATURES="getbinpkg binpkg-request-signature".

Could you comment those for now?

chaoscommander wrote:Now, trying eschwartz's suggestion...

Code: Select all

wget -P /var/cache/binpkgs/dev-qt/qtwebengine/ https://mirror.netcologne.de/gentoo/releases/amd64/binpackages/23.0/x86-64/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar
--2024-08-17 10:11:39--  https://mirror.netcologne.de/gentoo/releases/amd64/binpackages/23.0/x86-64/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar
Auflösen des Hostnamens mirror.netcologne.de… 2001:4dd0:1234:1::deb, 194.8.197.22
Verbindungsaufbau zu mirror.netcologne.de|2001:4dd0:1234:1::deb|:443 … verbunden.
HTTP-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 47431680 (45M) [application/octet-stream]
Wird in »/var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar« gespeichert.

qtwebengine-5.15.14_p20240510-1 100%[=======================================================>]  45,23M  11,8MB/s    in 4,1s    

2024-08-17 10:11:43 (11,1 MB/s) - »/var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar« gespeichert [47431680/47431680]
emerge -a /var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar 
Local copy of remote index is up-to-date and will be used.

These are the packages that would be merged, in order:

Calculating dependencies |
*** You need to adjust PKGDIR to emerge this package: /var/cache/binpkgs/dev-qt/qtwebengine/qtwebengine-5.15.14_p20240510-1.gpkg.tar

... done!

I adjusted PKGDIR to /var/cache/binpkgs - no change.

What about emerge --info?

Best Regards,
Georgi

chaoscommander · Post by **chaoscommander** » Sat Aug 17, 2024 3:33 pm

Where did you come up with the idea to run an --emptytree emrge from?

I'm currently migrating from profile 17.1 to 23.0 and the guide told me to. That's also why I'm trying to get portage to install the big(gest) packages from binhost.

Could you comment those for now?

Done.

Here's FEATURES="getbinpkg binpkg-request-signature" emerge -eav @world and emerge --info: https://bpa.st/UX2A

Edit: By the way, in that paste you'll see "problems have been detected with your world file"... I ran emaint --check world

Code: Select all

Emaint: check world        100% [============================================>]

No further output, yet the warning keeps showing up. The file looks normal to me. Should I upload it as well?

logrusx · Post by **logrusx** » Sat Aug 17, 2024 5:21 pm

chaoscommander wrote:
Where did you come up with the idea to run an --emptytree emrge from?
I'm currently migrating from profile 17.1 to 23.0 and the guide told me to. That's also why I'm trying to get portage to install the big(gest) packages from binhost.

Could you comment those for now?
Done.

Here's FEATURES="getbinpkg binpkg-request-signature" emerge -eav @world and emerge --info: https://bpa.st/UX2A

This is not what I asked for. I didn't want those enabled, but nevertheless, this output is way more useful that way. You may uncomment the features in make.conf and continue as before. Go and deselct the packages that were reported there are no ebuilds for and try again. Post complete output with the complete command again. I'd recommend adding -D and -U.

chaoscommander wrote:Edit: By the way, in that paste you'll see "problems have been detected with your world file"... I ran emaint --check world
Code: Select all
Emaint: check world        100% [============================================>]
No further output, yet the warning keeps showing up. The file looks normal to me. Should I upload it as well?

It told me the same, ignore it. On normal update it doesn't.

Best Regards,
Georgi

Post by Hu » Sat Aug 17, 2024 6:02 pm

chaoscommander wrote:
Where did you come up with the idea to run an --emptytree emrge from?
I'm currently migrating from profile 17.1 to 23.0 and the guide told me to.

The instructions tell you to bring the system fully up to date and do a full depclean before beginning. To me, that implies that you should not be getting this output, because these packages should have been removed by the depclean:

Code: Select all

!!! Ebuilds for the following packages are either all
!!! masked or don't exist:
app-portage/layman dev-tex/biblatex-apa games-util/steam-meta kde-plasma/ksysguard net-analyzer/breitbandmessung net-im/teams www-plugins/adobe-flash x11-plugins/enigmail

chaoscommander · Post by **chaoscommander** » Fri Jan 31, 2025 6:31 pm

Oh wow, have I really left this unfinished for months now? I kept putting it off due to work-related stress. Now this is probably going to be even more fun...

I guess I'm going to accept whatever extraneous rebuilds portage throws at me before I get stuck even longer. After I resolve the messed-up dependencies due to waiting too long.