QtWebEngine - compile time

Message

ONEEYEMAN · Post by **ONEEYEMAN** » Thu Aug 05, 2021 3:09 am

Hi ALL,
What is the reason for such a long compile time?
Or there is already bin package for it?

Thank you.

Post by **fedeliallalinea** » Thu Aug 05, 2021 4:45 am

ONEEYEMAN wrote:What is the reason for such a long compile time?

It's based on chromium, so...

ONEEYEMAN wrote:Or there is already bin package for it?

Unfortunately not.

ONEEYEMAN · Post by **ONEEYEMAN** » Thu Aug 05, 2021 4:58 am

Hi,

fedeliallalinea wrote:
ONEEYEMAN wrote: What is the reason for such a long compile time?
It's based on chromium, so...

Google really need to rethink this...

ONEEYEMAN wrote: Or there is already bin package for it?

Unfortunately not.
[/quote]

It is.

GNOME/GTK devs are much more considerate in this regards.

Thank you.

Post by **asturm** » Thu Aug 05, 2021 11:38 am

I don't see a net-libs/webkit-gtk-bin available either, unless you mean something different.

ONEEYEMAN · Post by **ONEEYEMAN** » Thu Aug 05, 2021 11:42 am

Hi,
Webkit-gtk doesn't take days to compile on a decent hardware.

Thank you.

Post by **asturm** » Thu Aug 05, 2021 11:51 am

qtwebengine takes an 1-2 hours to compile on decent hardware.

Post by **fedeliallalinea** » Thu Aug 05, 2021 11:52 am

ONEEYEMAN wrote:Webkit-gtk doesn't take days to compile on a decent hardware.

In a old i7-6700HQ qtwebengine with jumbo-build compile in ~3h / ~3h 30min.

mike155 · Post by **mike155** » Thu Aug 05, 2021 1:30 pm

ONEEYEMAN: do you need/want QtWebEngine at all? Or is it installed on your machine, because other packages pull it in?

If the latter is the case: change a few use flags and get rid of it.

ONEEYEMAN · Post by **ONEEYEMAN** » Fri Aug 06, 2021 1:35 am

Hi,
I'm curious - does it compile chromium on top of it or I can install chromium as a binary and just merge qtwebengine?

Thank you.

Post by **fedeliallalinea** » Fri Aug 06, 2021 4:37 am

ONEEYEMAN wrote:I'm curious - does it compile chromium on top of it or I can install chromium as a binary and just merge qtwebengine?

No you can't, only a part of chromium is included in qtwebengine and moreover the used versions don't go at same time with the releases of chromium

ONEEYEMAN · Post by **ONEEYEMAN** » Fri Aug 06, 2021 4:49 am

Hi,,

fedeliallalinea wrote:
ONEEYEMAN wrote: I'm curious - does it compile chromium on top of it or I can install chromium as a binary and just merge qtwebengine?
No you can't, only a part of chromium is included in qtwebengine

as long as the sources are the same that should be OK.

fedeliallalinea wrote: and moreover the used versions don't go at same time with the releases of chromium

But stabilizing them might go at the same time, right?

Thank you.

Post by **Chiitoo** » Fri Aug 06, 2021 8:26 am

ONEEYEMAN wrote:as long as the sources are the same that should be OK.

They are not (example for 5.15): https://code.qt.io/cgit/qt/qtwebengine- ... h=87-based

ONEEYEMAN · Post by **ONEEYEMAN** » Wed Aug 25, 2021 5:05 pm

Hi,
Just to give more info

I have ~11 years old DELL laptop with 8GB (updated from 4) RAM and 2 processors (and so compiling with -j3).

As right now QtWebEngine is building approximately 3 and 1/2 weeks and it is on the 21159 out of 23888,

I estimate that it will build for another week or so (if not more).

I just want to have complete Qt/KDE in order to test my software under this "platform".

I hope someone can do something about that.

Thank you.

CaptainBlood · Post by **CaptainBlood** » Wed Aug 25, 2021 7:31 pm

ONEEYEMAN,
Your timing suggests you're building on RAM... (my 2 €cents).
Maybe HD would be a better option for quicker build precess.
Thks 4 ur attention, interest & support.

ONEEYEMAN · Post by **ONEEYEMAN** » Wed Aug 25, 2021 8:20 pm

Hi,
Am I missing a USE-flag?

I didn't change anything there - just a default set...

Thank you.

nikolis · Post by **nikolis** » Sat Sep 04, 2021 9:03 pm

About 12min. Ryzen 5950

ONEEYEMAN · Post by **ONEEYEMAN** » Sat Sep 04, 2021 9:23 pm

Hi,
Wow! What version you were compiling?

Thank you.
For me - it is still building. And my understanding is - its a one time build...

nikolis · Post by **nikolis** » Sat Sep 04, 2021 9:46 pm

Hi,
I do not remember exactly in March was the last time, i do not use it anymore.

wjb · Post by **wjb** » Sun Sep 05, 2021 11:26 am

ONEEYEMAN wrote:And my understanding is - its a one time build...

That seems very unlikely, but you could try masking higher versions once you get it installed.

Try with -j1 instead of -j3 - the chrome based builds are memory hungry and paging would explain the week+ build-times. It's not unusual to see one compile thread using between 2G and 3G - three of those would likely bring an 8G PC to its knees regardless what else its doing.

Qtwebengine can be removed - run "equery depends qtwebengine" to see what has to go and what useflags to disable.[/list]

Tony0945 · Post by **Tony0945** » Sun Sep 05, 2021 2:31 pm

On old hardware:

Code: Select all

~ $ genlop -t qtwebengine
 * dev-qt/qtwebengine

     Tue Jun 22 07:58:30 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
       merge time: 17 seconds.

     Sun Aug 15 06:10:26 2021 >>> dev-qt/qtwebengine-5.15.2_p20210625
       merge time: 3 hours, 54 minutes and 14 seconds

That first merge was from a package built on a Ryzen. The second is native.

Code: Select all

 AMD Phenom(tm) II X6 1090T Processor

Takes about the same time as gcc. Maybe a little longer.
Possibly the designers could have built it as several libraries, but monolithic is in these daus, since the younger generation deems Windows as the best OS eveh.

Goverp · Post by **Goverp** » Sun Sep 05, 2021 5:06 pm

Tony0945 wrote:On old hardware:

Code: Select all

~ $ genlop -t qtwebengine
 * dev-qt/qtwebengine

     Tue Jun 22 07:58:30 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
       merge time: 17 seconds.

...

Ryzen may be good, but not that good. At a guess, you've compiler cache running, so it didn't need to compile much. |My 12-core 24-thread takes a least an hour, up to 4 depending what else is active.
Or did you mean a binary package built on a Ryzen, in which case it's just untar and install, no compilation

I'm not sure if anyone's tried it; perhaps "-O1" might give a decent reduction in compile time without too much hit on runtime performance.

Tony0945 · Post by **Tony0945** » Sun Sep 05, 2021 5:18 pm

No No no! The emerge used "usepkgonly". So it only untarred the package bult on the other machine. That build time wasn't shown.
On the Ryzen:

Code: Select all

 ~ $ genlop -t qtwebengine
 * dev-qt/qtwebengine

     Wed Jan 13 23:27:50 2021 >>> dev-qt/qtwebengine-5.15.1
       merge time: 1 hour, 35 minutes and 11 seconds.

     Sat Jan 16 20:49:30 2021 >>> dev-qt/qtwebengine-5.15.2
       merge time: 1 hour, 52 minutes and 28 seconds.

     Fri May 21 11:51:26 2021 >>> dev-qt/qtwebengine-5.15.2_p20210224
       merge time: 1 hour, 18 minutes and 7 seconds.

     Fri Jun 11 18:56:27 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
       merge time: 1 hour, 18 minutes and 8 seconds.

     Mon Jul  5 01:59:25 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
       merge time: 1 hour, 18 minutes and 37 seconds.

     Mon Jul 26 20:20:14 2021 >>> dev-qt/qtwebengine-5.15.2_p20210625
       merge time: 1 hour, 16 minutes and 44 seconds.

Probably took 21 seconds to tar up the package.

Anon-E-moose · Post by **Anon-E-moose** » Sun Sep 05, 2021 5:59 pm

Code: Select all

$ genlop -t qtwebengine
 * dev-qt/qtwebengine

     Sun Sep  5 08:22:04 2021 >>> dev-qt/qtwebengine-5.15.2_p20210625
       merge time: 1 hour, 5 minutes and 59 seconds.

Ryzen 3700x, 64g mem, -j14, wayland running, but just light browsing while compiling

ONEEYEMAN · Post by **ONEEYEMAN** » Fri Oct 01, 2021 4:05 am

Hi,
it just finished compiling...

Thank you.

wrc1944 · Post by **wrc1944** » Sun Oct 10, 2021 3:43 pm

I run three kde gentoo installs, each with qtwebengine, and 2 on one amd zen 3700 system, and the other on an amd zen 1600 box. All three are virtually identical usage and apps, and all are ~amd64 current.

Can I avoid building qtwebengine 3 times, by building it once and then make a binary with

Code: Select all

quickpkg qtwebengine

and copy it to the other 2 installs to their /usr/portage/packages/dev-qt/ directories, and then emerge it with

Code: Select all

emerge -K qtwebengine

whenever portage wants to rebuild or update it on an @world update?

Seems like that would work fine as long as I keep the versions synced and current, but a second opinion would be helpful.

EDIT: Using quickpkg qtwebengine creates a dev-qt/qtwebengine-5.15.2_p20210824-r1-1.xpak file, which I'm having a problem extracting properly. Always, for many years quickpkg creates a normal tbz2 file, which works normally with emerge -K. I'm reading up on working with .xpak files, but no luck so far. Still am surprised that quickpkg only has created a .xpak result with qtwebengine, as I've literally done this routine thousands of times with never seeing any other file extension that emerge -K didn't recognize.

Anyone got any ideas- sure would save a lot of hours doing qtwebengine compiles if this plan would work.

Moderator: Should this post be in it's own thread? It's related, but might stray off the main topic if my post stays here.

QtWebEngine - compile time

QtWebEngine - compile time

Re: QtWebEngine - compile time

Re: QtWebEngine - compile time

><)))°€