| View previous topic :: View next topic |
| Author |
Message |
Lebkoungcity
Apprentice
Joined: 16 Nov 2008
Posts: 220
Location: near Lebkoungcity (='Gingerbreadcity' =Nuremberg)
|
 Posted: Sat Dec 02, 2023 11:11 am Post subject: Compiling firefox jumped from ~6 hours to ~15½ hours[SOLVED] |
 |
|
Hello,
ten months ago I decided to try compiling on my Raspberry Pi4 with distcc. It worked and took about 6 hours.
But now the time has more than doubled:
| Code: | Wed Oct 25 10:36:48 2023 >>> www-client/firefox-119.0
merge time: 5 hours, 57 minutes and 23 seconds.
Thu Nov 9 23:44:22 2023 >>> www-client/firefox-119.0.1
merge time: 6 hours, 13 minutes and 24 seconds.
Wed Nov 22 08:12:54 2023 >>> www-client/firefox-120.0
merge time: 15 hours, 57 minutes and 14 seconds.
Fri Dec 1 15:43:59 2023 >>> www-client/firefox-120.0.1
merge time: 15 hours, 15 minutes and 11 seconds. |
I saw on htop that after all the compiling there is one process that took more than 9 hours in the end:
| Code: | | /usr/bin/python3.11 ./mach build --verbose |
Might anyone give me any insights on this?
Thanks a lot,
Andy
_________________
"The most dangerous world view is the world view of the ones who haven't viewed the world."
Alexander von Humboldt (1769-1859)
Last edited by Lebkoungcity on Wed Jan 24, 2024 10:00 pm; edited 1 time in total |
|
| Back to top |
|
 |
Juippisi
Developer
Joined: 30 Sep 2005
Posts: 745
Location: /home
|
| Posted: Sun Dec 03, 2023 6:33 am Post subject: |
|
|
| Did you toggle jumbo-build use flag? |
|
| Back to top |
|
|
Lebkoungcity
Apprentice
Joined: 16 Nov 2008
Posts: 220
Location: near Lebkoungcity (='Gingerbreadcity' =Nuremberg)
|
| Posted: Sun Dec 03, 2023 10:32 am Post subject: |
|
|
I didn't touch jumbo-build use flag - for firefox it came in without me noticing it... 
These are the set use flags:
| Code: | | [ebuild R *] www-client/firefox-120.0.1:rapid::gentoo USE="X clang dbus gmp-autoupdate hwaccel jumbo-build openh264 pulseaudio system-av1 system-harfbuzz system-icu system-jpeg system-libevent system-libvpx system-png system-webp wayland -debug (-eme-free) -geckodriver -hardened -jack -libproxy -lto (-pgo) -screencast (-selinux) -sndio (-system-python-libs) -telemetry -valgrind -wifi" CPU_FLAGS_ARM="neon" L10N="de -ach -af -an -ar -ast -az -be -bg -bn -br -bs -ca -ca-valencia -cak -cs -cy -da -dsb -el -en-CA -en-GB -eo -es-AR -es-CL -es-ES -es-MX -et -eu -fa -ff -fi -fr -fur -fy -ga -gd -gl -gn -gu -he -hi -hr -hsb -hu -hy -ia -id -is -it -ja -ka -kab -kk -km -kn -ko -lij -lt -lv -mk -mr -ms -my -nb -ne -nl -nn -oc -pa -pl -pt-BR -pt-PT -rm -ro -ru -sc -sco -si -sk -sl -son -sq -sr -sv -szl -ta -te -th -tl -tr -trs -uk -ur -uz -vi -xh -zh-CN -zh-TW" 0 KiB |
As far as I watched this one process on htop memory didn't run short and swapping did not occur (8 GB RAM).
_________________
"The most dangerous world view is the world view of the ones who haven't viewed the world."
Alexander von Humboldt (1769-1859) |
|
| Back to top |
|
|
NeddySeagoon
Administrator
Joined: 05 Jul 2003
Posts: 54572
Location: 56N 3W
|
| Posted: Sun Dec 03, 2023 10:43 am Post subject: |
|
|
Lebkoungcity,
What CPU governor is in use?
| Code: | cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
powersave |
is the wrong answer.
schedutil or ondemand are what you want to see.
You will require CPU cooling to stay out of thermal throttling.
_________________
Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
| Back to top |
|
|
Lebkoungcity
Apprentice
Joined: 16 Nov 2008
Posts: 220
Location: near Lebkoungcity (='Gingerbreadcity' =Nuremberg)
|
| Posted: Sun Dec 03, 2023 10:51 am Post subject: |
|
|
NeddySeagoon,
I've set it to ondemand when I was setting up the system:
| Code: | cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
ondemand |
Cooling is done by a constantly running 120mm fan by Noctua and temperature was around ~55°C when I checked it with 'vcgencmd measure_temp' while it was working on this one process.
Edit: Frequency was around 1500Mhz - at least htop told me so.
_________________
"The most dangerous world view is the world view of the ones who haven't viewed the world."
Alexander von Humboldt (1769-1859) |
|
| Back to top |
|
|
toralf
Developer
Joined: 01 Feb 2004
Posts: 3938
Location: Hamburg
|
| Posted: Sun Dec 03, 2023 11:54 am Post subject: |
|
|
| I'm satisfied by schedutil since or 2 years. |
|
| Back to top |
|
|
NeddySeagoon
Administrator
Joined: 05 Jul 2003
Posts: 54572
Location: 56N 3W
|
| Posted: Sun Dec 03, 2023 12:53 pm Post subject: |
|
|
Lebkoungcity,
Are you sure that distcc was being used?
Big chunks of firefox are written in rust which will not be distributed.
Did distccmon show jobs being distributed?
Much as I hate to suggest it, how long does www-client/firefox-120.0.1 take to emerge without distcc ?
_________________
Regards,
NeddySeagoon
Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail. |
|
| Back to top |
|
|
mirekm
Apprentice
Joined: 12 Feb 2004
Posts: 216
Location: Gliwice
|
| Posted: Mon Dec 04, 2023 7:39 am Post subject: |
|
|
| NeddySeagoon wrote: | Lebkoungcity,
What CPU governor is in use?
| Code: | cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
powersave |
is the wrong answer.
schedutil or ondemand are what you want to see.
You will require CPU cooling to stay out of thermal throttling. |
Except situation, when you use intel_pstate driver, where you have only 2 governors. And powersave is an equvalent of schedutil / ondemand. |
|
| Back to top |
|
|
Lebkoungcity
Apprentice
Joined: 16 Nov 2008
Posts: 220
Location: near Lebkoungcity (='Gingerbreadcity' =Nuremberg)
|
| Posted: Tue Dec 05, 2023 11:41 pm Post subject: |
|
|
| NeddySeagoon wrote: | Lebkoungcity,
Are you sure that distcc was being used?
Big chunks of firefox are written in rust which will not be distributed.
Did distccmon show jobs being distributed? |
Yes, I'm pretty sure that distcc worked because the corresponding processes were displayed on the helper under htop. And yes, the Rust processes were all executed exclusively on the Pi4 - which was to be expected. Everything ran in the expected time and speed.
But: The one process at the very end (/usr/bin/python3.11 ./mach build --verbose) has been taking between 9 and 10 hours since the last two versions of Firefox. And this single process runs exclusively on the Pi4.
| Quote: | | Much as I hate to suggest it, how long does www-client/firefox-120.0.1 take to emerge without distcc ? |
Good question! I never tried that. Maybe I'll see on the weekend...
_________________
"The most dangerous world view is the world view of the ones who haven't viewed the world."
Alexander von Humboldt (1769-1859) |
|
| Back to top |
|
|
Lebkoungcity
Apprentice
Joined: 16 Nov 2008
Posts: 220
Location: near Lebkoungcity (='Gingerbreadcity' =Nuremberg)
|
| Posted: Wed Jan 24, 2024 9:59 pm Post subject: |
|
|
OK... I didn't change anything and the build times dropped back to the previous levels:
| Code: | Fri Oct 13 03:07:04 2023 >>> www-client/firefox-118.0.2
merge time: 6 hours, 23 minutes and 7 seconds.
Wed Oct 25 10:36:48 2023 >>> www-client/firefox-119.0
merge time: 5 hours, 57 minutes and 23 seconds.
Thu Nov 9 23:44:22 2023 >>> www-client/firefox-119.0.1
merge time: 6 hours, 13 minutes and 24 seconds.
Wed Nov 22 08:12:54 2023 >>> www-client/firefox-120.0
merge time: 15 hours, 57 minutes and 14 seconds.
Fri Dec 1 15:43:59 2023 >>> www-client/firefox-120.0.1
merge time: 15 hours, 15 minutes and 11 seconds.
Thu Dec 21 17:24:47 2023 >>> www-client/firefox-121.0
merge time: 6 hours, 12 minutes and 51 seconds.
Thu Jan 11 00:51:50 2024 >>> www-client/firefox-121.0.1
merge time: 6 hours, 25 minutes and 12 seconds.
Wed Jan 24 02:52:37 2024 >>> www-client/firefox-122.0
merge time: 6 hours, 17 minutes and 28 seconds.
|
_________________
"The most dangerous world view is the world view of the ones who haven't viewed the world."
Alexander von Humboldt (1769-1859) |
|
| Back to top |
|
|
|
Gentoo on ARM
