| View previous topic :: View next topic |
| Author |
Message |
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
 Posted: Thu Aug 05, 2021 3:09 am Post subject: QtWebEngine - compile time |
 |
|
Hi ALL,
What is the reason for such a long compile time?
Or there is already bin package for it?
Thank you. |
|
| Back to top |
|
 |
fedeliallalinea
Administrator
Joined: 08 Mar 2003
Posts: 30894
Location: here
|
| Posted: Thu Aug 05, 2021 4:45 am Post subject: Re: QtWebEngine - compile time |
|
|
| ONEEYEMAN wrote: | | What is the reason for such a long compile time? |
It's based on chromium, so...
| ONEEYEMAN wrote: | | Or there is already bin package for it? |
Unfortunately not.
_________________
Questions are guaranteed in life; Answers aren't. |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Thu Aug 05, 2021 4:58 am Post subject: Re: QtWebEngine - compile time |
|
|
Hi,
| fedeliallalinea wrote: |
| ONEEYEMAN wrote: |
What is the reason for such a long compile time?
|
It's based on chromium, so...
|
Google really need to rethink this... 
| ONEEYEMAN wrote: |
Or there is already bin package for it?
|
Unfortunately not.
[/quote]
It is.
GNOME/GTK devs are much more considerate in this regards.
Thank you. |
|
| Back to top |
|
|
asturm
Developer
Joined: 05 Apr 2007
Posts: 8935
|
| Posted: Thu Aug 05, 2021 11:38 am Post subject: |
|
|
| I don't see a net-libs/webkit-gtk-bin available either, unless you mean something different. |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Thu Aug 05, 2021 11:42 am Post subject: |
|
|
Hi,
Webkit-gtk doesn't take days to compile on a decent hardware.
Thank you. |
|
| Back to top |
|
|
asturm
Developer
Joined: 05 Apr 2007
Posts: 8935
|
| Posted: Thu Aug 05, 2021 11:51 am Post subject: |
|
|
| qtwebengine takes an 1-2 hours to compile on decent hardware. |
|
| Back to top |
|
|
fedeliallalinea
Administrator
Joined: 08 Mar 2003
Posts: 30894
Location: here
|
| Posted: Thu Aug 05, 2021 11:52 am Post subject: |
|
|
| ONEEYEMAN wrote: | | Webkit-gtk doesn't take days to compile on a decent hardware. |
In a old i7-6700HQ qtwebengine with jumbo-build compile in ~3h / ~3h 30min.
_________________
Questions are guaranteed in life; Answers aren't. |
|
| Back to top |
|
|
mike155
Advocate
Joined: 17 Sep 2010
Posts: 4438
Location: Frankfurt, Germany
|
| Posted: Thu Aug 05, 2021 1:30 pm Post subject: |
|
|
ONEEYEMAN: do you need/want QtWebEngine at all? Or is it installed on your machine, because other packages pull it in?
If the latter is the case: change a few use flags and get rid of it. |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Fri Aug 06, 2021 1:35 am Post subject: |
|
|
Hi,
I'm curious - does it compile chromium on top of it or I can install chromium as a binary and just merge qtwebengine?
Thank you. |
|
| Back to top |
|
|
fedeliallalinea
Administrator
Joined: 08 Mar 2003
Posts: 30894
Location: here
|
| Posted: Fri Aug 06, 2021 4:37 am Post subject: |
|
|
| ONEEYEMAN wrote: | | I'm curious - does it compile chromium on top of it or I can install chromium as a binary and just merge qtwebengine? |
No you can't, only a part of chromium is included in qtwebengine and moreover the used versions don't go at same time with the releases of chromium
_________________
Questions are guaranteed in life; Answers aren't. |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Fri Aug 06, 2021 4:49 am Post subject: |
|
|
Hi,,
| fedeliallalinea wrote: |
| ONEEYEMAN wrote: |
I'm curious - does it compile chromium on top of it or I can install chromium as a binary and just merge qtwebengine?
|
No you can't, only a part of chromium is included in qtwebengine
|
as long as the sources are the same that should be OK.
But stabilizing them might go at the same time, right?
Thank you. |
|
| Back to top |
|
|
Chiitoo
Administrator
Joined: 28 Feb 2010
Posts: 2571
Location: Here and Away Again
|
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Wed Aug 25, 2021 5:05 pm Post subject: |
|
|
Hi,
Just to give more info
I have ~11 years old DELL laptop with 8GB (updated from 4) RAM and 2 processors (and so compiling with -j3).
As right now QtWebEngine is building approximately 3 and 1/2 weeks and it is on the 21159 out of 23888,
I estimate that it will build for another week or so (if not more).
I just want to have complete Qt/KDE in order to test my software under this "platform".
I hope someone can do something about that.
Thank you. |
|
| Back to top |
|
|
CaptainBlood
Advocate
Joined: 24 Jan 2010
Posts: 3596
|
| Posted: Wed Aug 25, 2021 7:31 pm Post subject: |
|
|
ONEEYEMAN,
Your timing suggests you're building on RAM... (my 2 €cents).
Maybe HD would be a better option for quicker build precess.
Thks 4 ur attention, interest & support.
_________________
USE="-* ..." in /etc/portage/make.conf here. |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Wed Aug 25, 2021 8:20 pm Post subject: |
|
|
Hi,
Am I missing a USE-flag?
I didn't change anything there - just a default set...
Thank you. |
|
| Back to top |
|
|
nikolis
Apprentice
Joined: 21 Aug 2003
Posts: 198
Location: Athens
|
| Posted: Sat Sep 04, 2021 9:03 pm Post subject: |
|
|
| About 12min. Ryzen 5950 |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Sat Sep 04, 2021 9:23 pm Post subject: |
|
|
Hi,
Wow! What version you were compiling?
Thank you.
For me - it is still building. And my understanding is - its a one time build... |
|
| Back to top |
|
|
nikolis
Apprentice
Joined: 21 Aug 2003
Posts: 198
Location: Athens
|
| Posted: Sat Sep 04, 2021 9:46 pm Post subject: |
|
|
Hi,
I do not remember exactly in March was the last time, i do not use it anymore. |
|
| Back to top |
|
|
wjb
l33t
Joined: 10 Jul 2005
Posts: 605
Location: Fife, Scotland
|
| Posted: Sun Sep 05, 2021 11:26 am Post subject: |
|
|
| ONEEYEMAN wrote: | | And my understanding is - its a one time build... |
That seems very unlikely, but you could try masking higher versions once you get it installed.
Try with -j1 instead of -j3 - the chrome based builds are memory hungry and paging would explain the week+ build-times. It's not unusual to see one compile thread using between 2G and 3G - three of those would likely bring an 8G PC to its knees regardless what else its doing.
Qtwebengine can be removed - run "equery depends qtwebengine" to see what has to go and what useflags to disable.[/list] |
|
| Back to top |
|
|
Tony0945
Watchman
Joined: 25 Jul 2006
Posts: 5127
Location: Illinois, USA
|
| Posted: Sun Sep 05, 2021 2:31 pm Post subject: |
|
|
On old hardware:
| Code: | ~ $ genlop -t qtwebengine
* dev-qt/qtwebengine
Tue Jun 22 07:58:30 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
merge time: 17 seconds.
Sun Aug 15 06:10:26 2021 >>> dev-qt/qtwebengine-5.15.2_p20210625
merge time: 3 hours, 54 minutes and 14 seconds |
That first merge was from a package built on a Ryzen. The second is native.
| Code: | | AMD Phenom(tm) II X6 1090T Processor |
Takes about the same time as gcc. Maybe a little longer.
Possibly the designers could have built it as several libraries, but monolithic is in these daus, since the younger generation deems Windows as the best OS eveh. |
|
| Back to top |
|
|
Goverp
Veteran
Joined: 07 Mar 2007
Posts: 1999
|
| Posted: Sun Sep 05, 2021 5:06 pm Post subject: |
|
|
| Tony0945 wrote: | On old hardware:
| Code: | ~ $ genlop -t qtwebengine
* dev-qt/qtwebengine
Tue Jun 22 07:58:30 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
merge time: 17 seconds. |
... |
Ryzen may be good, but not that good. At a guess, you've compiler cache running, so it didn't need to compile much. |My 12-core 24-thread takes a least an hour, up to 4 depending what else is active.
Or did you mean a binary package built on a Ryzen, in which case it's just untar and install, no compilation
I'm not sure if anyone's tried it; perhaps "-O1" might give a decent reduction in compile time without too much hit on runtime performance.
_________________
Greybeard |
|
| Back to top |
|
|
Tony0945
Watchman
Joined: 25 Jul 2006
Posts: 5127
Location: Illinois, USA
|
| Posted: Sun Sep 05, 2021 5:18 pm Post subject: |
|
|
No No no! The emerge used "usepkgonly". So it only untarred the package bult on the other machine. That build time wasn't shown.
On the Ryzen:
| Code: | ~ $ genlop -t qtwebengine
* dev-qt/qtwebengine
Wed Jan 13 23:27:50 2021 >>> dev-qt/qtwebengine-5.15.1
merge time: 1 hour, 35 minutes and 11 seconds.
Sat Jan 16 20:49:30 2021 >>> dev-qt/qtwebengine-5.15.2
merge time: 1 hour, 52 minutes and 28 seconds.
Fri May 21 11:51:26 2021 >>> dev-qt/qtwebengine-5.15.2_p20210224
merge time: 1 hour, 18 minutes and 7 seconds.
Fri Jun 11 18:56:27 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
merge time: 1 hour, 18 minutes and 8 seconds.
Mon Jul 5 01:59:25 2021 >>> dev-qt/qtwebengine-5.15.2_p20210421
merge time: 1 hour, 18 minutes and 37 seconds.
Mon Jul 26 20:20:14 2021 >>> dev-qt/qtwebengine-5.15.2_p20210625
merge time: 1 hour, 16 minutes and 44 seconds.
|
Probably took 21 seconds to tar up the package. |
|
| Back to top |
|
|
Anon-E-moose
Watchman
Joined: 23 May 2008
Posts: 6098
Location: Dallas area
|
| Posted: Sun Sep 05, 2021 5:59 pm Post subject: |
|
|
| Code: | $ genlop -t qtwebengine
* dev-qt/qtwebengine
Sun Sep 5 08:22:04 2021 >>> dev-qt/qtwebengine-5.15.2_p20210625
merge time: 1 hour, 5 minutes and 59 seconds. |
Ryzen 3700x, 64g mem, -j14, wayland running, but just light browsing while compiling
_________________
PRIME x570-pro, 3700x, 6.1 zen kernel
gcc 13, profile 17.0 (custom bare multilib), openrc, wayland |
|
| Back to top |
|
|
ONEEYEMAN
Advocate
Joined: 01 Mar 2005
Posts: 3610
|
| Posted: Fri Oct 01, 2021 4:05 am Post subject: |
|
|
Hi,
it just finished compiling...
Thank you. |
|
| Back to top |
|
|
wrc1944
Advocate
Joined: 15 Aug 2002
Posts: 3435
Location: Gainesville, Florida
|
| Posted: Sun Oct 10, 2021 3:43 pm Post subject: |
|
|
I run three kde gentoo installs, each with qtwebengine, and 2 on one amd zen 3700 system, and the other on an amd zen 1600 box. All three are virtually identical usage and apps, and all are ~amd64 current.
Can I avoid building qtwebengine 3 times, by building it once and then make a binary with | Code: | | quickpkg qtwebengine |
and copy it to the other 2 installs to their /usr/portage/packages/dev-qt/ directories, and then emerge it with | Code: | | emerge -K qtwebengine |
whenever portage wants to rebuild or update it on an @world update?
Seems like that would work fine as long as I keep the versions synced and current, but a second opinion would be helpful.
EDIT: Using quickpkg qtwebengine creates a dev-qt/qtwebengine-5.15.2_p20210824-r1-1.xpak file, which I'm having a problem extracting properly. Always, for many years quickpkg creates a normal tbz2 file, which works normally with emerge -K. I'm reading up on working with .xpak files, but no luck so far. Still am surprised that quickpkg only has created a .xpak result with qtwebengine, as I've literally done this routine thousands of times with never seeing any other file extension that emerge -K didn't recognize.
Anyone got any ideas- sure would save a lot of hours doing qtwebengine compiles if this plan would work. 
Moderator: Should this post be in it's own thread? It's related, but might stray off the main topic if my post stays here.
_________________
Main box- AsRock x370 Gaming K4
Ryzen 7 3700x, 3.6GHz, 16GB GSkill Flare DDR4 3200mhz
Samsung SATA 1000GB, Radeon HD R7 350 2GB DDR5
OpenRC Gentoo ~amd64 plasma, glibc-2.36-r7, gcc-13.2.1_p20230304
kernel-6.8.4 USE=experimental python3_11 |
|
| Back to top |
|
|
|
Desktop Environments
