Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
[SOLVED] Chromium compilation takes almost 6 hours
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Desktop Environments
View previous topic :: View next topic  
Author Message
samidarko
n00b
n00b


Joined: 10 Aug 2014
Posts: 27

PostPosted: Thu Jun 28, 2018 8:42 am    Post subject: [SOLVED] Chromium compilation takes almost 6 hours Reply with quote

Hi,

I'm running a Thinkpad W530 with Intel(R) Core(TM) i7-3630QM CPU @ 2.40GHz + 16Go of RAM

Chromium used to take:

Code:
     Tue Jul 22 17:53:31 2014 >>> www-client/chromium-35.0.1916.153
       merge time: 53 minutes and 14 seconds.


And now it takes:

Code:
     Wed May  9 01:39:52 2018 >>> www-client/chromium-66.0.3359.139
       merge time: 5 hours, 44 minutes and 53 seconds.

     Mon Jun 25 04:53:45 2018 >>> www-client/chromium-67.0.3396.87
       merge time: 5 hours, 58 minutes and 36 seconds.


When Vivaldi:

Code:
     Sun Jun 24 22:21:22 2018 >>> www-client/vivaldi-1.15.1147.47_p1
       merge time: 17 seconds.


And Firefox:

Code:
     Tue May 15 10:16:23 2018 >>> www-client/firefox-52.8.0
       merge time: 22 minutes and 2 seconds.


What is it inside that justify so much time compare to other browsers? Thanks for your insights


Last edited by samidarko on Fri Jul 06, 2018 2:11 am; edited 1 time in total
Back to top
View user's profile Send private message
Keruskerfuerst
Advocate
Advocate


Joined: 01 Feb 2006
Posts: 2288
Location: near Augsburg, Germany

PostPosted: Thu Jun 28, 2018 4:23 pm    Post subject: Reply with quote

Can you post the compiler flags for all browsers.
Back to top
View user's profile Send private message
Hu
Moderator
Moderator


Joined: 06 Mar 2007
Posts: 13504

PostPosted: Fri Jun 29, 2018 1:14 am    Post subject: Re: Chromium compilation takes almost 6 hours Reply with quote

samidarko wrote:
Chromium used to take:
Code:
     Tue Jul 22 17:53:31 2014 >>> www-client/chromium-35.0.1916.153
       merge time: 53 minutes and 14 seconds.
And now it takes:
Code:
     Wed May  9 01:39:52 2018 >>> www-client/chromium-66.0.3359.139
       merge time: 5 hours, 44 minutes and 53 seconds.

     Mon Jun 25 04:53:45 2018 >>> www-client/chromium-67.0.3396.87
       merge time: 5 hours, 58 minutes and 36 seconds.
You are comparing two versions built four years apart. Even if your hardware is unchanged, the browser has been extensively modified in those four years.

Modern browsers are disgustingly bloated because of the quest to reinvent everything as a web app. Slow build times are one symptom of this.
samidarko wrote:
When Vivaldi:
Code:
     Sun Jun 24 22:21:22 2018 >>> www-client/vivaldi-1.15.1147.47_p1
       merge time: 17 seconds.
This appears to be a prebuilt binary. Since you are only unpacking and copying, it will install very quickly.
samidarko wrote:
And Firefox:

Code:
     Tue May 15 10:16:23 2018 >>> www-client/firefox-52.8.0
       merge time: 22 minutes and 2 seconds.


What is it inside that justify so much time compare to other browsers? Thanks for your insights
This one is interesting. The major browsers are all notorious for bundling libraries that they should not bundle. Perhaps Firefox has been more thoroughly unbundled than Chromium.

Please post the output of emerge --pretend --verbose www-client/firefox www-client/chromium.
Back to top
View user's profile Send private message
mir3x
Guru
Guru


Joined: 02 Jun 2012
Posts: 427

PostPosted: Fri Jun 29, 2018 5:50 am    Post subject: Reply with quote

In last 8 months chromium compile time almost doubled ( its ryzen 7 compile time):
Code:
chromium: Mon Oct  9 10:08:10 2017: 1 hour, 24 minutes, 47 seconds
chromium: Mon Oct  9 13:46:57 2017: 1 hour, 25 minutes, 25 seconds
chromium: Wed Oct 18 11:36:01 2017: 1 hour, 26 minutes, 13 seconds
chromium: Sat Jan 13 12:38:29 2018: 1 hour, 39 minutes, 37 seconds
chromium: Tue Jan 16 20:24:41 2018: 1 hour, 39 minutes, 48 seconds
chromium: Tue Mar 13 19:22:13 2018: 1 hour, 51 minutes, 15 seconds
chromium: Sun Apr  1 11:37:31 2018: 2 hours, 11 minutes, 1 second
chromium: Wed May  2 14:14:28 2018: 2 hours, 19 minutes, 5 seconds
chromium: Sun Jun  3 19:36:42 2018: 2 hours, 14 minutes, 35 seconds


Just use google-chrome if you dont want to compile.
And firefox 22 mins is normal ( u typed version 52 maybe its also faster one)
Code:

firefox: Sat Nov 18 11:25:26 2017: 21 minutes, 36 seconds
firefox: Sat Nov 18 19:01:00 2017: 20 minutes, 22 seconds
firefox: Wed Dec 27 10:21:24 2017: 23 minutes, 35 seconds
firefox: Mon Jan 15 11:10:48 2018: 21 minutes, 17 seconds
firefox: Tue Jan 30 20:42:55 2018: 20 minutes, 3 seconds
firefox: Sat Apr 28 22:16:17 2018: 21 minutes, 22 seconds
firefox: Mon May 14 22:33:27 2018: 21 minutes, 13 seconds

_________________
Installation aborted to prevent system self-destruction
Back to top
View user's profile Send private message
samidarko
n00b
n00b


Joined: 10 Aug 2014
Posts: 27

PostPosted: Fri Jun 29, 2018 6:05 am    Post subject: Reply with quote

here are the flags @Keruskerfuerst

Probably I shouldn't have all those languages

Code:

[ebuild   R    ] www-client/firefox-52.8.0::gentoo  USE="dbus gmp-autoupdate jemalloc startup-notification wifi -bindist -custom-cflags -custom-optimization -debug -eme-free -gtk2 -hardened -hwaccel -jack (-neon) -pgo -pulseaudio (-rust) (-selinux) (-system-cairo) -system-harfbuzz -system-icu -system-jpeg -system-libevent -system-libvpx -system-sqlite {-test}" L10N="-ach -af -an -ar -as -ast -az -bg -bn-BD -bn-IN -br -bs -ca -cak -cs -cy -da -de -dsb -el -en-GB -en-ZA -eo -es-AR -es-CL -es-ES -es-MX -et -eu -fa -ff -fi -fr -fy -ga -gd -gl -gn -gu -he -hi -hr -hsb -hu -hy -id -is -it -ja -ka -kab -kk -km -kn -ko -lij -lt -lv -mai -mk -ml -mr -ms -nb -nl -nn -or -pa -pl -pt-BR -pt-PT -rm -ro -ru -si -sk -sl -son -sq -sr -sv -ta -te -th -tr -uk -uz -vi -xh -zh-CN -zh-TW" 0 KiB

[ebuild   R    ] www-client/chromium-67.0.3396.87::gentoo  USE="cups hangouts (pic) proprietary-codecs suid -component-build -custom-cflags -gnome-keyring -jumbo-build -kerberos (-neon) -pulseaudio (-selinux) (-system-ffmpeg) (-system-icu) (-system-libvpx) (-tcmalloc) -widevine" L10N="am ar bg bn ca cs da de el en-GB es es-419 et fa fi fil fr gu he hi hr hu id it ja kn ko lt lv ml mr ms nb nl pl pt-BR pt-PT ro ru sk sl sr sv sw ta te th tr uk vi zh-CN zh-TW" 0 KiB


Last edited by samidarko on Fri Jun 29, 2018 6:15 am; edited 2 times in total
Back to top
View user's profile Send private message
samidarko
n00b
n00b


Joined: 10 Aug 2014
Posts: 27

PostPosted: Fri Jun 29, 2018 6:13 am    Post subject: Reply with quote

Thanks @mir3x

@Hu I was aware I was comparing between 2014 to 2018. I just was just highlighting it was not such an increase of compile time for firefox than chromium for same period. Thanks to make me noticing vivaldi was prebuild I missed that.

Code:
~ # emerge --pretend --verbose www-client/firefox www-client/chromium

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild   R    ] www-client/firefox-52.8.0::gentoo  USE="dbus gmp-autoupdate jemalloc startup-notification wifi -bindist -custom-cflags -custom-optimization -debug -eme-free -gtk2 -hardened -hwaccel -jack (-neon) -pgo -pulseaudio (-rust) (-selinux) (-system-cairo) -system-harfbuzz -system-icu -system-jpeg -system-libevent -system-libvpx -system-sqlite {-test}" L10N="-ach -af -an -ar -as -ast -az -bg -bn-BD -bn-IN -br -bs -ca -cak -cs -cy -da -de -dsb -el -en-GB -en-ZA -eo -es-AR -es-CL -es-ES -es-MX -et -eu -fa -ff -fi -fr -fy -ga -gd -gl -gn -gu -he -hi -hr -hsb -hu -hy -id -is -it -ja -ka -kab -kk -km -kn -ko -lij -lt -lv -mai -mk -ml -mr -ms -nb -nl -nn -or -pa -pl -pt-BR -pt-PT -rm -ro -ru -si -sk -sl -son -sq -sr -sv -ta -te -th -tr -uk -uz -vi -xh -zh-CN -zh-TW" 0 KiB

[ebuild   R    ] www-client/chromium-67.0.3396.87::gentoo  USE="cups hangouts (pic) proprietary-codecs suid -component-build -custom-cflags -gnome-keyring -jumbo-build -kerberos (-neon) -pulseaudio (-selinux) (-system-ffmpeg) (-system-icu) (-system-libvpx) (-tcmalloc) -widevine" L10N="am ar bg bn ca cs da de el en-GB es es-419 et fa fi fil fr gu he hi hr hu id it ja kn ko lt lv ml mr ms nb nl pl pt-BR pt-PT ro ru sk sl sr sv sw ta te th tr uk vi zh-CN zh-TW" 0 KiB
Back to top
View user's profile Send private message
mir3x
Guru
Guru


Joined: 02 Jun 2012
Posts: 427

PostPosted: Sun Jul 01, 2018 10:36 pm    Post subject: Reply with quote

I noticed new flag for chromium
Code:
- - jumbo-build        : Combine source files to speed up build process.


I'll test tomorrow (if I dont forget ) and report back how if its faster.
_________________
Installation aborted to prevent system self-destruction
Back to top
View user's profile Send private message
mir3x
Guru
Guru


Joined: 02 Jun 2012
Posts: 427

PostPosted: Mon Jul 02, 2018 9:44 am    Post subject: Reply with quote

Jumbo seems very cool. Compilation time more than halved for me.

Code:
chromium: Mon Jul  2 07:52:59 2018: 8305 seconds
chromium: Mon Jul  2 10:18:08 2018: 3126 seconds


Both are chromium-68.0.3440.25, first one without jumbo, second with jumbo.
_________________
Installation aborted to prevent system self-destruction
Back to top
View user's profile Send private message
samidarko
n00b
n00b


Joined: 10 Aug 2014
Posts: 27

PostPosted: Tue Jul 03, 2018 3:41 am    Post subject: Reply with quote

Sounds promising @mir3x

You definitely have a very fast machine ;)

I will try it with and update the thread
Back to top
View user's profile Send private message
samidarko
n00b
n00b


Joined: 10 Aug 2014
Posts: 27

PostPosted: Fri Jul 06, 2018 2:08 am    Post subject: Reply with quote

Nice catch @mir3x

Code:

       Mon Jun 25 04:53:45 2018 >>> www-client/chromium-67.0.3396.87
       merge time: 5 hours, 58 minutes and 36 seconds.

       Thu Jul  5 21:19:28 2018 >>> www-client/chromium-67.0.3396.87
       merge time: 2 hours, 23 minutes and 7 seconds.  <= with jumbo-build
Back to top
View user's profile Send private message
salfter
n00b
n00b


Joined: 02 Jan 2003
Posts: 61

PostPosted: Fri Feb 15, 2019 10:05 pm    Post subject: Reply with quote

mir3x wrote:
I noticed new flag for chromium
Code:
- - jumbo-build        : Combine source files to speed up build process.


I'll test tomorrow (if I dont forget ) and report back how if its faster.


Just heard about that today when someone linked this page in a post to comp.misc:

https://chromium.googlesource.com/chromium/src/+/master/docs/linux_build_instructions.md#faster-builds

The poster said he'd gotten compile times down to less than an hour. Compared to my machine, his has hyperthreading (Core i7 4790K vs. my Core i5 4690K), but is otherwise configured similarly (actually, he mentioned he was building from a hard drive, while I'm building from a SATA SSD). I'm recompiling now to see what kind of difference it'll make.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Desktop Environments All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum