| View previous topic :: View next topic |
| Author |
Message |
lyallp
Veteran
Joined: 15 Jul 2004
Posts: 1559
Location: Adelaide/Australia
|
 Posted: Thu Mar 28, 2024 8:15 am Post subject: Thunderbird 115 build - 11.5 hours! (and counting) |
 |
|
Sheesh!
And that is with a 24G tmpfs /tmp folder (memory, not disk nor SSD) and 32G or physical memory, and, according to htop all 8 CPU's going pretty much flat out.
| Code: |
Linux Lyalls-PC 6.6.21-gentoo #2 SMP PREEMPT_DYNAMIC Wed Mar 27 15:05:51 ACDT 2024 x86_64 Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz GenuineIntel GNU/Linux
Installed versions: 115.9.0(22:29:40 23/03/24)(X clang dbus openh264 pulseaudio system-av1 system-harfbuzz system-jpeg system-libevent system-librnp system-libvpx system-webp wayland -debug -eme-free -hardened -hwaccel -jack -libproxy -lto -pgo -selinux -sndio -system-icu -system-png -system-python-libs -wifi CPU_FLAGS_ARM="-neon" L10N="-af -ar -ast -be -bg -br -ca -cak -cs -cy -da -de -dsb -el -en-CA -en-GB -es-AR -es-ES -es-MX -et -eu -fi -fr -fy -ga -gd -gl -he -hr -hsb -hu -id -is -it -ja -ka -kab -kk -ko -lt -lv -ms -nb -nl -nn -pa -pl -pt-BR -pt-PT -rm -ro -ru -sk -sl -sq -sr -sv -th -tr -uk -uz -vi -zh-CN -zh-TW")
Homepage: https://www.thunderbird.net/
Description: Thunderbird Mail Client
|
I'll be lucky if it's finished compiling this version before the next version comes out!
I have updated my profile and moved to merged /usr, which involved a complete system rebuild, the rest of the system compiled in less time than this!
_________________
...Lyall |
|
| Back to top |
|
 |
saturnalia0
Tux's lil' helper
Joined: 13 Oct 2016
Posts: 136
|
| Posted: Thu Mar 28, 2024 10:26 am Post subject: |
|
|
If the binary package or simpler clients like mutt aren't palatable, then I guess you can
1. Offload your computation needs to the cloud, cross-compiling for your puny CPU
2. Upgrade your hardware to the industry scale needed to compile your mail client
3. Complain to Mozilla or start patching
 |
|
| Back to top |
|
|
C5ace
Guru
Joined: 23 Dec 2013
Posts: 473
Location: Brisbane, Australia
|
| Posted: Thu Mar 28, 2024 11:10 am Post subject: Re: Thunderbird 115 build - 11.5 hours! (and counting) |
|
|
| lyallp wrote: | Sheesh!
And that is with a 24G tmpfs /tmp folder (memory, not disk nor SSD) and 32G or physical memory, and, according to htop all 8 CPU's going pretty much flat out.
| Code: |
Linux Lyalls-PC 6.6.21-gentoo #2 SMP PREEMPT_DYNAMIC Wed Mar 27 15:05:51 ACDT 2024 x86_64 Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz GenuineIntel GNU/Linux
Installed versions: 115.9.0(22:29:40 23/03/24)(X [b]clang[/b] dbus openh264 [b]pulseaudio[/b] system-av1 system-harfbuzz system-jpeg system-libevent system-librnp system-libvpx system-webp wayland -debug -eme-free -hardened -hwaccel -jack -libproxy -lto -pgo -selinux -sndio -system-icu -system-png -system-python-libs -wifi [color=darkred]CPU_FLAGS_ARM="-neon" [/color]L10N="-af -ar -ast -be -bg -br -ca -cak -cs -cy -da -de -dsb -el -en-CA -en-GB -es-AR -es-ES -es-MX -et -eu -fi -fr -fy -ga -gd -gl -he -hr -hsb -hu -id -is -it -ja -ka -kab -kk -ko -lt -lv -ms -nb -nl -nn -pa -pl -pt-BR -pt-PT -rm -ro -ru -sk -sl -sq -sr -sv -th -tr -uk -uz -vi -zh-CN -zh-TW")
Homepage: https://www.thunderbird.net/
Description: Thunderbird Mail Client
|
I'll be lucky if it's finished compiling this version before the next version comes out!
I have updated my profile and moved to merged /usr, which involved a complete system rebuild, the rest of the system compiled in less time than this! |
On my Laptop:
| Code: | System uname: Linux-6.6.21-gentoo-x86_64-x86_64-AMD_Ryzen_5_2500U_with_Radeon_Vega_Mobile_Gfx-with-glibc2.38
KiB Mem: 7788068 total, 5401140 free
KiB Swap: 33554428 total, 33554428 free
CFLAGS="-O2 -march=znver1 -mtune=znver1 -pipe"
[ebuild R ] mail-client/thunderbird-115.9.0::gentoo USE="X dbus openh264 system-av1 system-harfbuzz system-jpeg system-libevent system-librnp system-libvpx system-webp -clang -debug -eme-free -hardened -hwaccel -jack -libproxy -lto (-pgo) -pulseaudio (-selinux) -sndio (-system-icu) -system-png (-system-python-libs) -wayland -wifi" L10N="-af -ar -ast -be -bg -br -ca -cak -cs -cy -da -de -dsb -el -en-CA -en-GB -es-AR -es-ES -es-MX -et -eu -fi -fr -fy -ga -gd -gl -he -hr -hsb -hu -id -is -it -ja -ka -kab -kk -ko -lt -lv -ms -nb -nl -nn -pa -pl -pt-BR -pt-PT -rm -ro -ru -sk -sl -sq -sr -sv -th -tr -uk -uz -vi -zh-CN -zh-TW" 0 KiB |
Build on my laptop:
qlop: 2023-10-17T16:38:32 >>> mail-client/thunderbird: 3:35:57
Build on my desktop in change root for my laptop:
qlop: 2024-03-25T00:43:06 >>> mail-client/thunderbird: 13′35″
_________________
Observation after 30 years working with computers:
All software has known and unknown bugs and vulnerabilities. Especially software written in complex, unstable and object oriented languages such as perl, python, C++, C#, Rust and the likes. |
|
| Back to top |
|
|
lyallp
Veteran
Joined: 15 Jul 2004
Posts: 1559
Location: Adelaide/Australia
|
| Posted: Fri Mar 29, 2024 1:28 am Post subject: |
|
|
I admit, my system is somewhat unusual in that I have debug enabled.
My reasoning for this is that Firefox regularly (I mean hourly) generates core dumps because of kernel exceptions and I wanted to submit a bug report that had decent symbols.
Still, I would not expect this to adversely affect runtime, only the fact that the binaries on my system take up a stack more storage than they need to, and I have plenty to spare....
| Code: | # emerge --info | grep FLAG
CFLAGS="-mtune=native -march=native -ggdb3 -pipe"
CFLAGS_amd64="-m64"
CFLAGS_x32="-mx32"
CFLAGS_x86="-m32 -mfpmath=sse"
CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3"
CXXFLAGS="-mtune=native -march=native -ggdb3 -pipe"
FCFLAGS="-O2 -pipe"
FFLAGS="-O2 -pipe"
LDFLAGS="-g"
LDFLAGS_amd64="-m elf_x86_64"
LDFLAGS_x32="-m elf32_x86_64"
LDFLAGS_x86="-m elf_i386"
|
_________________
...Lyall |
|
| Back to top |
|
|
lyallp
Veteran
Joined: 15 Jul 2004
Posts: 1559
Location: Adelaide/Australia
|
| Posted: Fri Mar 29, 2024 3:23 am Post subject: |
|
|
Just for giggles.
| Code: |
# qlop --nocolor --time --human $(EIX_LIMIT=0 eix --installed --only-names) | grep hour
2024-03-25T06:19:16 >>> gnome-base/librsvg: 1 hour, 4 minutes, 42 seconds
2024-03-25T06:22:37 >>> sys-devel/gcc: 1 hour, 26 minutes, 38 seconds
2024-03-25T07:52:55 >>> sys-devel/gcc: 1 hour, 11 minutes, 15 seconds
2024-03-25T14:17:10 >>> sys-devel/gcc: 1 hour, 40 minutes, 36 seconds
2024-03-25T12:58:21 >>> sys-devel/llvm: 4 hours, 35 minutes, 18 seconds
2024-03-25T16:02:46 >>> sys-devel/llvm: 4 hours, 14 minutes, 55 seconds
2024-03-26T11:25:35 >>> dev-lang/rust: 6 hours, 27 minutes, 34 seconds
2024-03-26T18:08:03 >>> net-libs/nodejs: 1 hour, 3 minutes, 53 seconds
2024-03-26T19:20:25 >>> dev-util/cbindgen: 1 hour, 8 minutes, 54 seconds
2024-03-26T19:44:15 >>> dev-util/maturin: 1 hour, 38 minutes, 56 seconds
2024-03-26T20:15:54 >>> app-crypt/gnupg: 1 hour, 7 minutes, 28 seconds
2024-03-26T21:30:45 >>> sys-devel/clang: 1 hour, 23 minutes, 34 seconds
2024-03-26T21:30:17 >>> virtual/package-manager: 1 hour, 24 minutes, 43 seconds
2024-03-26T21:31:50 >>> dev-qt/qtgui: 1 hour, 23 minutes, 23 seconds
2024-03-27T03:53:52 >>> dev-qt/qtwebengine: 5 hours, 36 minutes, 35 seconds
2024-03-27T04:47:26 >>> dev-qt/qtwebengine: 6 hours, 59 minutes, 24 seconds
2024-03-27T17:47:37 >>> www-client/firefox: 10 hours, 58 minutes, 15 seconds
2024-03-28T08:20:56 >>> mail-client/thunderbird: 12 hours, 28 minutes, 3 seconds |
_________________
...Lyall |
|
| Back to top |
|
|
toralf
Developer
Joined: 01 Feb 2004
Posts: 3922
Location: Hamburg
|
| Posted: Fri Mar 29, 2024 9:34 am Post subject: |
|
|
At a AMD Ryzen 7 PRO 6850U it takes 30 min for gcc and 31 min for thunderbird using
| Code: | COMMON_FLAGS="-O2 -pipe -march=native -ftrivial-auto-var-init=zero"
CFLAGS="${COMMON_FLAGS}"
|
Not sure if it is worth to tweak CFLAGS furthermore for thunderbird. Where is the benfit? |
|
| Back to top |
|
|
eschwartz
n00b
Joined: 29 Oct 2023
Posts: 17
|
| Posted: Sun Apr 07, 2024 2:45 pm Post subject: |
|
|
| lyallp wrote: | I admit, my system is somewhat unusual in that I have debug enabled.
My reasoning for this is that Firefox regularly (I mean hourly) generates core dumps because of kernel exceptions and I wanted to submit a bug report that had decent symbols.
Still, I would not expect this to adversely affect runtime, only the fact that the binaries on my system take up a stack more storage than they need to, and I have plenty to spare....
|
Enabling debug doesn't affect runtime here, it affects compile time. 
Large programs like browsers are known to take an exorbitantly long time to generate and link all that debug info you asked for. This is why it's often considered a bad idea to enable debug info for browsers when you don't know you need it.
Do a package override for Thunderbird if you only need it for Firefox. Or reevaluate whether you need it for Firefox either.
Both packages have -bin versions from Mozilla. Mozilla builds with debug symbols available on their debug symbol server, stripped out of the final binaries. |
|
| Back to top |
|
|
molletts
Tux's lil' helper
Joined: 16 Feb 2013
Posts: 119
|
| Posted: Tue Apr 09, 2024 6:23 pm Post subject: |
|
|
| lyallp wrote: | Just for giggles.
| Code: |
# qlop --nocolor --time --human $(EIX_LIMIT=0 eix --installed --only-names) | grep hour
[... some excessively-long build times ...]
|
|
Hm, those times look very odd. That virtual taking over an hour must be an artifact - did the system accidentally get put to standby or something (I don't know whether this would get accounted for in the portage logs)? Is the cooling adequate? Is the CPU using a sensible frequency governor (i.e. not "powersave")? Is it swapping for some reason?
On my system, for the same set of packages (at least, those that are installed):
| Code: | for PKG in sys-devel/gcc sys-devel/llvm dev-lang/rust net-libs/nodejs dev-util/cbindgen dev-util/maturin app-crypt/gnupg sys-devel/clang virtual/package-manager dev-qt/qtgui dev-qt/qtwebengine www-client/firefox mail-client/thunderbird; do qlop -tH "$PKG" | tail -1; done
2024-02-18T23:29:17 >>> sys-devel/gcc: 1 hour, 49 minutes, 44 seconds
2024-03-20T21:24:46 >>> sys-devel/llvm: 41 minutes, 32 seconds
2024-03-21T17:56:40 >>> dev-lang/rust: 30 minutes, 53 seconds
2024-02-19T01:19:52 >>> net-libs/nodejs: 25 minutes, 30 seconds
2023-10-08T13:31:27 >>> dev-util/cbindgen: 2 minutes, 11 seconds
2023-11-06T06:42:36 <<< dev-util/maturin: 2 seconds <--- see edit, below
2024-03-07T21:37:11 >>> app-crypt/gnupg: 1 minute, 1 second
2024-03-20T22:06:18 >>> sys-devel/clang: 40 minutes, 7 seconds
2024-03-25T21:51:13 >>> dev-qt/qtgui: 3 minutes, 45 seconds
2024-03-25T22:22:20 >>> dev-qt/qtwebengine: 2 hours, 7 minutes, 2 seconds
2024-03-26T00:29:58 >>> www-client/firefox: 1 hour, 50 minutes, 59 seconds
2024-03-20T22:50:27 >>> mail-client/thunderbird: 50 minutes, 7 seconds |
This is a fairly-elderly (2013) AMD FX-9590 so 8 real integer cores (but only 4 FPUs, hence the controversy over whether it was an 8-core CPU or not at the time) with 16GB RAM. Small packages are built in an 8GB tmpfs mounted on /var/tmp/portage while big ones that would either run out of tmpfs space or not leave enough free RAM to build without swapping (gcc, rust, qtwebengine, firefox and thunderbird out of these ones) are redirected using package.env settings to a directory on a hard drive with a very quick seek time.
Of course, my USE flags are likely very different to yours so this isn't a scientific comparison. I have PGO enabled for gcc and firefox which bumps up the build time significantly (approx. double).
[Edit: just noticed that the entry for dev-util/maturin was for its removal - it doesn't appear to be installed on my system any more. The last time it was built, it took 2 minutes, 50 seconds.] |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Portage & Programming
