post your build times and specs

[myga]

Hello,

***Disclaimer: this post is just to chat about packages' build time and collect information that might help others searching for it.***

I know that the wiki provide some hints about build times and RAM needed for them, but that info is not applicable to everyone and might be outdated. So, I starter searching around for anyone posting or blogging about any packages' build time and the specs used, but there is none. I was hesitant for awhile to build big packages, but today I decided to test my machine by building thunderbird and I expected it to take about 3 hrs. However, it took a lot less than that!

So, I'm hoping that you guys participate by posting your build times and specs for anyone seeking a general idea about their hardware and its capabilities.

Here are the build times of thunderbird & friends, and specs of my machine:

Code: Select all

root@~ # genlop -t thunderbird
 * mail-client/thunderbird

     Fri Dec  8 23:06:02 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 32 minutes and 31 seconds.

root@~ # genlop -t nodejs     
 * net-libs/nodejs

     Fri Dec  8 22:28:32 2023 >>> net-libs/nodejs-20.6.1
       merge time: 27 minutes and 33 seconds.

root@~ # genlop -t openh264
 * media-libs/openh264

     Fri Dec  8 22:00:39 2023 >>> media-libs/openh264-2.3.1-r3
       merge time: 15 seconds.

root@~ # genlop -t botan   
 * dev-libs/botan

     Fri Dec  8 22:29:45 2023 >>> dev-libs/botan-2.19.3-r2
       merge time: 1 minute and 6 seconds.

Code: Select all

Host: ThinkPad P52 
Kernel: 6.1.66-gentoo 
CPU: Intel i7-8850H (12) @ 4.300GHz 
GPU: NVIDIA Quadro P2000 Mobile 
Memory: 2639MiB / 31793MiB 

[rfx]

Code: Select all

Kernel: 6.6.5-gentoo
CPU: Intel Core i5-6200u (4) @ 2.3 GHz
Ram: 8 GB

Big Stuff like Thunderbird Firefox & Co. i build over night without display-manager, so i have more free Ram for compiling

Code: Select all

genlop -t firefox thunderbird nodejs openh264 botan
 * www-client/firefox

     Tue Nov 14 12:31:50 2023 >>> www-client/firefox-115.4.0
       merge time: 1 hour, 44 minutes.

     Fri Nov 24 04:44:04 2023 >>> www-client/firefox-115.5.0
       merge time: 1 hour, 36 minutes and 51 seconds.

 * mail-client/thunderbird

     Wed Nov 15 02:25:16 2023 >>> mail-client/thunderbird-115.4.1
       merge time: 1 hour, 44 minutes and 22 seconds.

     Fri Nov 24 03:07:13 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 1 hour, 44 minutes and 37 seconds.

 * net-libs/nodejs

     Tue Nov 14 10:42:49 2023 >>> net-libs/nodejs-20.6.1
       merge time: 1 hour, 41 minutes and 29 seconds.

 * media-libs/openh264

     Mon Nov 13 13:30:50 2023 >>> media-libs/openh264-2.3.1-r3
       merge time: 34 seconds.

 * dev-libs/botan

     Wed Nov 15 00:40:01 2023 >>> dev-libs/botan-2.19.3-r2
       merge time: 3 minutes and 22 seconds.

     Mon Nov 20 13:39:33 2023 >>> dev-libs/botan-2.19.3-r2
       merge time: 3 minutes and 34 seconds.

[eeckwrk99]

- CPU: Intel i7-5820K (12) @ 3.80 GHz
- RAM: 32 GB
- COMMON_FLAGS="-march=haswell -O2 -pipe"
- CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3"
-j12 -l10.8

Code: Select all

$ emlop l -e sys-devel/llvm

2023-01-07 01:49:31  1:00:50 sys-devel/llvm-15.0.6-r1
2023-01-13 17:23:31  1:01:45 sys-devel/llvm-15.0.7
2023-03-18 17:46:50  1:12:53 sys-devel/llvm-16.0.0
2023-04-06 14:38:40  1:12:26 sys-devel/llvm-16.0.1
2023-04-20 11:04:19  1:10:53 sys-devel/llvm-16.0.2
2023-05-04 10:58:23  1:08:54 sys-devel/llvm-16.0.3
2023-05-18 08:21:09  1:06:19 sys-devel/llvm-16.0.4
2023-06-03 09:49:04  1:14:12 sys-devel/llvm-16.0.5
2023-06-14 14:04:00  1:28:26 sys-devel/llvm-16.0.6
2023-09-20 10:59:44  1:04:41 sys-devel/llvm-17.0.1
2023-10-04 18:20:05  1:03:23 sys-devel/llvm-17.0.2
2023-10-05 10:29:23  1:08:44 sys-devel/llvm-17.0.2-r1
2023-10-18 09:27:44  1:06:03 sys-devel/llvm-17.0.3
2023-10-31 22:33:13  1:07:16 sys-devel/llvm-17.0.4
2023-11-15 18:06:21  1:08:41 sys-devel/llvm-17.0.5
2023-11-29 12:53:24  1:06:17 sys-devel/llvm-17.0.6

Code: Select all

$ emlop l -e www-client/firefox

2022-10-26 14:29:13    32:38 www-client/firefox-106.0.2
2022-11-03 15:56:14    30:54 www-client/firefox-106.0.4
2022-11-05 15:11:00    30:58 www-client/firefox-106.0.5
2022-11-15 20:41:14    29:38 www-client/firefox-107.0
2022-12-06 05:05:57  1:13:53 www-client/firefox-107.0.1
2022-12-14 14:34:15    26:47 www-client/firefox-108.0
2022-12-17 12:23:05    59:39 www-client/firefox-108.0
2022-12-18 11:41:50    29:23 www-client/firefox-108.0.1
2023-01-05 12:51:14    27:14 www-client/firefox-108.0.2
2023-01-17 12:10:54    27:08 www-client/firefox-109.0
2023-01-31 12:14:18    30:45 www-client/firefox-109.0.1
2023-02-14 19:27:00    31:44 www-client/firefox-109.0.1-r1
2023-02-20 15:35:01    26:43 www-client/firefox-110.0
2023-02-28 21:56:43  3:15:23 www-client/firefox-110.0.1
2023-03-14 14:48:10    29:35 www-client/firefox-111.0

Code: Select all

$ emlop l -e app-office/libreoffice

2022-08-16 00:40:53  1:03:46 app-office/libreoffice-7.3.5.2
2022-09-09 08:42:14    55:10 app-office/libreoffice-7.3.6.2
2022-09-09 14:58:59  1:04:20 app-office/libreoffice-7.3.6.2
2022-10-21 12:01:30  1:34:38 app-office/libreoffice-7.3.6.2
2022-11-04 11:23:26    58:12 app-office/libreoffice-7.3.7.2
2022-12-06 05:34:17  1:42:00 app-office/libreoffice-7.3.7.2
2022-12-17 12:44:49  1:26:26 app-office/libreoffice-7.3.7.2
2022-12-18 00:15:18    51:44 app-office/libreoffice-7.3.7.2
2022-12-27 11:25:04    54:29 app-office/libreoffice-7.4.3.2
2023-01-10 10:46:05    59:57 app-office/libreoffice-7.4.3.2
2023-01-12 18:45:05  1:07:00 app-office/libreoffice-7.4.4.2
2023-02-01 23:48:10  1:04:42 app-office/libreoffice-7.4.5.1
2023-02-04 10:00:14  1:02:28 app-office/libreoffice-7.4.5.1
2023-03-10 16:41:31  1:10:25 app-office/libreoffice-7.4.6.2

[NeddySeagoon]

Code: Select all

Pi5 ~ # genlop -t thunderbird
 * mail-client/thunderbird

     Tue Nov 28 21:15:57 2023 >>> mail-client/thunderbird-115.5.1
       merge time: 1 hour, 49 minutes and 4 seconds.

     Tue Dec  5 01:37:04 2023 >>> mail-client/thunderbird-115.5.1
       merge time: 1 hour, 52 minutes and 34 seconds.

and for a biggie ...

Code: Select all

Pi5 ~ # genlop -t chromium
 * www-client/chromium

     Thu Nov 30 10:22:16 2023 >>> www-client/chromium-119.0.6045.159-r1
       merge time: 1 day, 5 minutes and 3 seconds.

That's an 8G Raspberry Pi 5 with 4G swap. The interesting part of make.conf is

Code: Select all

CPU_FLAGS_ARM="edsp neon thumb vfp vfpv3 vfpv4 vfp-d32 aes sha1 sha2 crc32 v4 v5 v6 v7 v8 thumb2"

COMMON_FLAGS="-mcpu=cortex-a76+crc+crypto -O2 -pipe -mtune=cortex-a76"
CFLAGS="${COMMON_FLAGS}"
CXXFLAGS="${COMMON_FLAGS}"
FCFLAGS="${COMMON_FLAGS}"
FFLAGS="${COMMON_FLAGS}"

# WARNING: Changing your CHOST is not something that should be done lightly.
# Please consult https://wiki.gentoo.org/wiki/Changing_the_CHOST_variable before changing.
CHOST="aarch64-unknown-linux-gnu"

# NOTE: This stage was built with the bindist Use flag enabled

ACCEPT_KEYWORDS="~arm64"
ACCEPT_LICENSE="linux-fw-redistributable"

[apiaio]

Code: Select all

     Sat Sep 30 15:23:05 2023 >>> net-libs/nodejs-20.6.1
       merge time: 9 minutes and 49 seconds.

     Tue Sep 26 16:55:39 2023 >>> sys-devel/gcc-13.2.1_p20230826
       merge time: 23 minutes and 1 second.

     Wed Nov 22 18:17:36 2023 >>> dev-qt/qtwebengine-5.15.11_p20231120
       merge time: 40 minutes and 20 seconds.

Code: Select all

RAM Kingston 2x32GB DDR4 3600MHz 
5.15.80-gentoo
CPU Intel Core i7-12700 (4,9 GHz, LGA 1700), Alder Lake

[myga]

and for a biggie ...

Code: Select all

Pi5 ~ # genlop -t chromium
 * www-client/chromium

     Thu Nov 30 10:22:16 2023 >>> www-client/chromium-119.0.6045.159-r1
       merge time: 1 day, 5 minutes and 3 seconds.

All the posts so far seem to have consistent merge times, but that is excessive! I bet you if you merge chromium multiple times a week, that ARM CPU is going to cease functioning. Those little computers are not meant for compiling software, at least not large projects, but thank you for experimenting.

[gorg86]

It's always interesting to see compile times of big packages on different machines, but I'd suggest adding at least LTO and PGO useflags, too.

[NeddySeagoon]

myga,

It never goes over a CPU temp of 60C.

gorg86,

PGO will at least double the build time as the package will be built twice.
LTO will drive a lot more swapping as its a memory hog.

I do use LTO on my Pi4 build system (with 128G RAM) but it won't run code built for the Pi5 which makes building Pi5 optimised code a bit tedious.

All the Pi5 code on my binhost is actually built on the Pi5 just now.
distcc would help a bit, maybe, but that's a double edged sword.

The rest, is Pi4 optimised with LTO but not PGO.

Code: Select all

# genlop -t chromium
 * www-client/chromium

     Wed Nov 15 15:06:07 2023 >>> www-client/chromium-119.0.6045.123
       merge time: 17 hours, 43 minutes and 1 second.

That's with 32 3.3GHz cores, 128G RAM and LTO.


On an 8G Pi4 ...

Code: Select all

#genlop -t chromium

 * www-client/chromium

     Thu Oct 26 23:08:54 2023 >>> www-client/chromium-119.0.6045.21
       merge time: 3 days, 10 hours, 26 minutes and 57 seconds.

I was looking for a build error but it built. No LTO or PGO there either.

[mss]

I used Gentoo for ~5 years, and it was the first OS I installed on my last computer: https://www.cpubenchmark.net/compare/48 ... -5750M-APU

That machine was my daily driver for ten years, up until last week. I had been using OpenBSD for awhile, but switched back to Linux for the hardware support, and so Gentoo is the first install on this machine as well. The specs:

Ryzen 7 5700X
32x2 GB @ 3600
Radeon RX 6600 (8 GB VRAM)

As for build times, my old machine took several hours to build Rust, Clang, GHC, etc. As the benchmark numbers suggest, builds are ~14 times faster on this machine.

I think the increases in build time are because I added the LTO and vectorization flags a few days ago.

Code: Select all

COMMON_FLAGS="-O2 -pipe -march=native -flto=auto -ftree-vectorize -fvect-cost-model=very-cheap"
USE="archive opencv gme alsa elogind X jpeg bzip2 png webp ffmpeg mp4 aac dbus unicode cjk"
*/* CPU_FLAGS_X86: aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sha sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3

Code: Select all

 * sys-devel/gcc

     Sun Dec 10 10:11:29 2023 >>> sys-devel/gcc-13.2.1_p20231014
       merge time: 19 minutes and 16 seconds.

 * sys-devel/clang

     Sun Dec  3 22:08:00 2023 >>> sys-devel/clang-16.0.6
       merge time: 14 minutes and 42 seconds.

     Mon Dec  4 02:06:18 2023 >>> sys-devel/clang-15.0.7-r3
       merge time: 14 minutes.

     Thu Dec  7 20:48:05 2023 >>> sys-devel/clang-17.0.6
       merge time: 18 minutes and 5 seconds.

 * virtual/rust

     Thu Dec  7 16:52:58 2023 >>> dev-lang/rust-1.73.0
       merge time: 27 minutes and 40 seconds.

 * dev-lang/ghc

     Sun Dec  3 23:37:46 2023 >>> dev-lang/ghc-9.0.2-r4
       merge time: 17 minutes and 9 seconds.

     Thu Dec  7 18:38:31 2023 >>> dev-lang/ghc-9.2.8
       merge time: 20 minutes and 32 seconds.

 * dev-qt/qtwebengine

     Mon Dec  4 22:07:33 2023 >>> dev-qt/qtwebengine-6.5.3
       merge time: 1 hour, 8 minutes and 30 seconds.

 * sys-devel/llvm

     Mon Dec  4 01:51:20 2023 >>> sys-devel/llvm-15.0.7-r3
       merge time: 13 minutes and 48 seconds.

     Tue Dec  5 02:26:17 2023 >>> sys-devel/llvm-16.0.6
       merge time: 29 minutes and 51 seconds.

     Thu Dec  7 20:29:54 2023 >>> sys-devel/llvm-17.0.6
       merge time: 32 minutes and 47 seconds.

[greyspoke]

Mon Sep 4 20:27:56 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 1 day, 5 hours, 5 minutes and 42 seconds.

This is on my home server, 32 bit Intel Atom processor (1 core, 1.6GHz, 2GiB memory). gcc doesn't get upgraded very often!

[eccerr0r]

Code: Select all

$ sudo qlop -mtv gcc
Password: 
2023-11-21T22:52:29 >>> sys-devel/gcc-11.4.1_p20230622: 2:04:14
$ uname -a
Linux milly 6.1.66-gentoo #2 SMP PREEMPT_DYNAMIC Sat Dec  9 23:45:40 MST 2023 x86_64 AMD A6-3420M APU with Radeon(tm) HD Graphics AuthenticAMD GNU/Linux

This is USE="-pgo -lto +fortran". My build times are all suspect as I use distcc and --jobs > 1 ... With careful planning, even my rust qlop times are not completely indicative of the local machine's build speed.

milly "new to me" was a "Free Stuff" Craigslist computer...

[myga]

Mon Sep 4 20:27:56 2023 >>> sys-devel/gcc-12.3.1_p20230526
merge time: 1 day, 5 hours, 5 minutes and 42 seconds.

This is on my home server, 32 bit Intel Atom processor (1 core, 1.6GHz, 2GiB memory). gcc doesn't get upgraded very often!

My God! That's a long time to wait. I remember when I used to compile Firefox on FreeBSD, I leave it overnight too.

How were you able to compile GCC anyway? This is a quote from the Wiki:

More than 4 GBs (will fail with <= 4 GBs), and even more if Java and Objective C are also included.

This is USE="-pgo -lto +fortran". My build times are all suspect as I use distcc and --jobs > 1 ... With careful planning, even my rust qlop times are not completely indicative of the local machine's build speed.

milly "new to me" was a "Free Stuff" Craigslist computer...

That's not bad at all. But if you attempt to emerge Chromium, you will be waiting a while and from my experience with AMD, it'll generate more heat than a motorcycle on a hot summer day.


BTW, I got two old computers, one is Dell Vostro 220s (32bit) with Pentium 2200 CPU and the other is Compaq (64bit) with an Athlon II CPU. Yall are welcome to take them for your labs.

[eccerr0r]

My Pentium-M 1.6GHz (1.5GiB RAM) and Atom N270 (2GiB RAM) haven't quite reached their Gentoo refresh cycle yet... For kicks I tend to update them (both 32 bit) to latest about once a year. The N270 with distcc help still takes 5 days 24h/day compiling, and the Pentium-M is not far behind - both building firefox and its dependencies...

Luckily I really don't need these machines up so they can just build in the background.

Incidentally I've had LTO going for rust and I had the rust RSS go to almost 7GiB.

My A6-3420 (quad core):

2023-11-04T02:48:08 >>> dev-lang/rust-1.71.1: 3:14:27

It only has 7.5GiB RAM because 512MB is swallowed up by the on-die graphics (wish I could reduce it, I don't do graphics that much on this machine. Can't wait until I could do open CL on it so that 512MB could actually be useful...) Again this is with distcc help... My dual core i5-3317 with 16GiB RAM actually was significantly faster (about 2 hours) probably because of the lack of need to swap, I figure.

[krumpf]

Last summer I changed CPU from a Ryzen 3600 (6C/12T - 3.6 to 4.2 GHz) to a Ryzen 5700X (8C/16T - 3.4 to 4.6 GHz), here are a few qlop stats :

Firefox (with USE=lto)
Ryzen 3600 (-j12)

Code: Select all

2023-02-15T23:54:25 >>> www-client/firefox-102.7.0-r1: 21 minutes, 8 seconds
2023-02-23T13:13:21 >>> www-client/firefox-102.8.0: 21 minutes, 12 seconds
2023-03-19T21:30:56 >>> www-client/firefox-102.9.0: 21 minutes, 30 seconds
2023-04-13T00:28:10 >>> www-client/firefox-102.10.0: 22 minutes, 21 seconds
2023-05-15T21:37:56 >>> www-client/firefox-102.11.0: 21 minutes, 34 seconds
2023-06-11T11:08:30 >>> www-client/firefox-102.12.0: 22 minutes, 22 seconds
2023-07-09T23:40:50 >>> www-client/firefox-102.13.0: 23 minutes, 4 seconds
2023-07-21T21:15:25 >>> www-client/firefox-102.13.0: 22 minutes, 2 seconds

Ryzen 5700X (-j16)

Code: Select all

2023-08-04T08:00:52 >>> www-client/firefox-102.14.0: 17 minutes, 32 seconds
2023-09-03T20:25:53 >>> www-client/firefox-102.15.0: 18 minutes, 34 seconds
2023-09-17T19:54:22 >>> www-client/firefox-102.15.1: 18 minutes, 20 seconds
2023-09-27T20:57:26 >>> www-client/firefox-115.2.1: 19 minutes, 10 seconds
2023-09-29T11:26:30 >>> www-client/firefox-115.3.0: 18 minutes, 42 seconds
2023-10-01T20:06:06 >>> www-client/firefox-115.3.1: 19 minutes, 25 seconds
2023-10-29T23:30:36 >>> www-client/firefox-115.4.0: 18 minutes, 48 seconds
2023-11-26T19:36:23 >>> www-client/firefox-115.5.0: 18 minutes, 43 seconds

Thunderbird (with USE=lto)
Ryzen 3600 (-j12)

Code: Select all

2023-01-19T00:23:07 >>> mail-client/thunderbird-102.6.0: 23 minutes, 38 seconds
2023-01-22T23:32:56 >>> mail-client/thunderbird-102.6.1: 23 minutes, 55 seconds
2023-02-15T23:30:41 >>> mail-client/thunderbird-102.6.1-r1: 23 minutes, 44 seconds
2023-02-23T12:47:57 >>> mail-client/thunderbird-102.8.0: 25 minutes, 24 seconds
2023-03-19T21:05:13 >>> mail-client/thunderbird-102.9.0: 25 minutes, 43 seconds
2023-04-19T14:08:15 >>> mail-client/thunderbird-102.10.0: 26 minutes, 15 seconds
2023-05-15T23:58:01 >>> mail-client/thunderbird-102.11.0: 24 minutes, 12 seconds
2023-06-11T13:30:22 >>> mail-client/thunderbird-102.12.0: 24 minutes, 13 seconds
2023-07-09T23:15:51 >>> mail-client/thunderbird-102.13.0: 24 minutes, 59 seconds

Ryzen 5700X (-j16)

Code: Select all

2023-08-04T08:20:22 >>> mail-client/thunderbird-102.14.0: 18 minutes, 38 seconds
2023-09-03T20:05:11 >>> mail-client/thunderbird-102.15.0: 20 minutes, 42 seconds
2023-09-17T19:34:33 >>> mail-client/thunderbird-102.15.1: 19 minutes, 49 seconds
2023-09-29T11:06:19 >>> mail-client/thunderbird-115.3.0: 20 minutes, 11 seconds
2023-10-01T19:45:38 >>> mail-client/thunderbird-115.3.1: 20 minutes, 28 seconds
2023-10-29T23:49:24 >>> mail-client/thunderbird-115.4.1: 19 minutes, 9 seconds
2023-11-28T08:52:22 >>> mail-client/thunderbird-115.5.0: 20 minutes, 12 seconds

GCC (with USE=lto)
Ryzen 3600 (-j12)

Code: Select all

2023-05-16T10:58:35 >>> sys-devel/gcc-12.2.1_p20230428-r1: 53 minutes, 17 seconds
2023-06-29T00:06:28 >>> sys-devel/gcc-12.3.1_p20230526: 54 minutes, 22 seconds

Ryzen 5700X (-j16)

Code: Select all

2023-08-03T20:22:50 >>> sys-devel/gcc-12.3.1_p20230526: 41 minutes, 33 seconds
2023-09-27T19:46:53 >>> sys-devel/gcc-13.2.1_p20230826: 51 minutes, 26 seconds

[rfx]

@krumpf thank you, the comparison of the two CPU's with differenct Cores was very interesting, even if a different gcc and kernelversion also impact on build times.

Here my little workstation:

Kernel: 6.6.7
CPU: Intel Celeron N5105 (4x 2.9 GHz)
RAM: 16GB (50% as tmpfs)

Code: Select all

rene@gentoo ~ $ genlop -t firefox thunderbird nodejs
 * www-client/firefox

     Sat Dec 16 15:34:14 2023 >>> www-client/firefox-115.5.0
       merge time: 1 hour, 37 minutes and 17 seconds.

 * mail-client/thunderbird

     Sat Dec 16 10:52:55 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 1 hour, 44 minutes and 4 seconds.

 * net-libs/nodejs

     Thu Dec 14 06:51:30 2023 >>> net-libs/nodejs-20.6.1
       merge time: 1 hour, 29 minutes and 20 seconds.

I was interested in testing the impact of different kernel versions on a larger package. The result surprised me; I expected a larger difference over time.


##updating #5 and #6

#1 = gentoo-sources-6.6.6
#2 = gentoo-kernel-bin-6.1.67
#3 = gentoo-kernel-bin-6.6.7
#4 = gentoo-sources-6.6.7
#5 = gentoo-kernel-6.1.67
#6 = gentoo-kernel-6.6.8

Code: Select all

genlop -t firefox thunderbird
 * www-client/firefox

     Thu Dec 14 21:53:50 2023 >>> www-client/firefox-115.5.0
#1       merge time: 1 hour, 38 minutes and 51 seconds.

     Fri Dec 15 21:32:34 2023 >>> www-client/firefox-115.5.0
#2       merge time: 1 hour, 37 minutes and 44 seconds.

     Sat Dec 16 06:06:17 2023 >>> www-client/firefox-115.5.0
#3       merge time: 1 hour, 37 minutes and 41 seconds.

     Sat Dec 16 15:34:14 2023 >>> www-client/firefox-115.5.0
#4       merge time: 1 hour, 37 minutes and 17 seconds.

     Tue Dec 19 18:28:42 2023 >>> www-client/firefox-115.5.0
#5       merge time: 1 hour, 37 minutes and 52 seconds.

     Thu Dec 21 16:25:28 2023 >>> www-client/firefox-115.5.0
#6       merge time: 1 hour, 38 minutes and 54 seconds.


 * mail-client/thunderbird

     Thu Dec 14 08:45:34 2023 >>> mail-client/thunderbird-115.5.0
#1       merge time: 1 hour, 45 minutes and 21 seconds.

     Fri Dec 15 16:48:16 2023 >>> mail-client/thunderbird-115.5.0
#2       merge time: 1 hour, 45 minutes and 3 seconds.

     Sat Dec 16 01:22:00 2023 >>> mail-client/thunderbird-115.5.0
#3       merge time: 1 hour, 45 minutes and 10 seconds.

     Sat Dec 16 10:52:55 2023 >>> mail-client/thunderbird-115.5.0
#4       merge time: 1 hour, 44 minutes and 4 seconds.

     Tue Dec 19 20:13:18 2023 >>> mail-client/thunderbird-115.5.0
#5       merge time: 1 hour, 44 minutes and 36 seconds.

     Thu Dec 21 14:46:34 2023 >>> mail-client/thunderbird-115.5.0
#6       merge time: 1 hour, 46 minutes.

[Spanik]

The only ones I find that have already passed here:

Code: Select all

~ $ emlop l -e sys-devel/gcc
2021-08-22 16:38:45    37:52 sys-devel/gcc-10.3.0-r2
2021-11-08 13:10:59    35:57 sys-devel/gcc-11.2.0
2022-03-12 10:43:40    34:19 sys-devel/gcc-11.2.1_p20220115
2022-06-11 10:34:29    32:42 sys-devel/gcc-11.3.0
2023-01-07 13:05:31    33:29 sys-devel/gcc-11.3.1_p20221209
2023-01-09 19:11:28  3:58:55 sys-devel/gcc-11.3.1_p20221209
2023-01-09 21:01:11    56:58 sys-devel/gcc-11.3.1_p20221209
2023-01-29 13:49:03    49:37 sys-devel/gcc-12.2.1_p20230121-r1
2023-04-27 15:57:17    49:59 sys-devel/gcc-12.2.1_p20230304
2023-05-26 17:28:04    53:08 sys-devel/gcc-12.2.1_p20230428-r1
2023-07-14 22:21:36    53:37 sys-devel/gcc-12.3.1_p20230526
2023-11-17 16:17:46    35:52 sys-devel/gcc-13.2.1_p20230826

The one that took 4 hours is funny. No idea why it takes a bit more than 30 minutes one time and almost an hour the other time. I would think it would always be similar on the same pc when you don't change things like cpu or memory.

Code: Select all

emlop l -e www-client/firefox
2021-12-09 13:01:03  15:25 www-client/firefox-91.3.0

Code: Select all

emlop l -e dev-lang/rust
2021-08-22 18:05:29  27:29 dev-lang/rust-1.53.0
2021-12-16 17:16:13  22:20 dev-lang/rust-1.56.1
2022-01-26 15:43:35  21:43 dev-lang/rust-1.58.1
2022-05-01 11:57:11  21:17 dev-lang/rust-1.59.0
2022-06-11 10:55:24  20:55 dev-lang/rust-1.60.0
2022-08-21 11:39:31  21:51 dev-lang/rust-1.62.1
2022-10-21 08:51:29  22:48 dev-lang/rust-1.64.0-r1
2022-12-03 12:28:27  22:09 dev-lang/rust-1.65.0
2023-01-29 14:36:06  21:09 dev-lang/rust-1.66.1
2023-07-14 23:41:02  21:29 dev-lang/rust-1.69.0-r1
2023-09-25 10:18:17  39:59 dev-lang/rust-1.71.1

Code: Select all

emlop l -e sys-devel/clang
2021-12-09 12:33:50   9:41 sys-devel/clang-12.0.1
2023-01-09 22:01:37  14:44 sys-devel/clang-15.0.6-r1
2023-01-29 15:00:04  11:09 sys-devel/clang-15.0.7-r1
2023-05-26 18:19:21  11:06 sys-devel/clang-15.0.7-r1
2023-07-15 03:12:18  12:03 sys-devel/clang-16.0.5
2023-09-25 11:15:35  11:56 sys-devel/clang-16.0.6

Code: Select all

emlop l -e net-libs/nodejs
2021-12-09 12:43:52  5:19 net-libs/nodejs-14.17.6

Code: Select all

uname -a
Linux daw 6.1.57-gentoo #1 SMP PREEMPT_DYNAMIC Sun Nov 19 11:45:26 CET 2023 x86_64 AMD EPYC 7401P 24-Core Processor AuthenticAMD GNU/Linux

Looks like a need an update for some of those things

[myga]

Today I realized that www-client/thunderbird was built with clang USE FLAG and caused a build error. I removed it and emerged again and it looks it took longer to build this time.

Code: Select all

# genlop -t thunderbird
 * mail-client/thunderbird

     Fri Dec  8 23:06:02 2023 >>> mail-client/thunderbird-115.5.0
       merge time: 32 minutes and 31 seconds.

     Fri Dec 22 20:18:34 2023 >>> mail-client/thunderbird-115.6.0
       merge time: 40 minutes and 20 seconds.

[eccerr0r]

More Atom 1.6GHz (N270 i686 1C2T, 2GiB RAM, mPCIe SSD):

2023-07-25T06:42:38 >>> sys-devel/gcc-12.3.1_p20230526: 17:44:15
2023-07-26T11:12:24 >>> dev-lang/rust-1.69.0-r1: 15:57:01
2022-08-30T02:50:57 >>> dev-util/cbindgen-0.24.3: 38′15″
2023-07-27T20:38:35 >>> gnome-base/librsvg-2.56.0: 1:15:42

I would hope these are not as corrupted by distcc but they may well still be due to --jobs ...

[sdauth]

A funny one (A106800K @ 4.1Ghz Piledriver)

Code: Select all

     Tue Jun 27 04:00:07 2023 >>> sys-devel/gcc-12.3.1_p20230526
       merge time: 10 hours, 7 minutes and 25 seconds.

     Thu Oct 19 01:02:37 2023 >>> sys-devel/gcc-12.3.1_p20230825
       merge time: 4 hours, 33 minutes and 27 seconds.

I was very surprised (and pleased) to see the speed improvement. What happened ? Same use flags (ada, lto, pgo, objc..) and both compiled while nothing else was running.

[myga]

A funny one (A106800K @ 4.1Ghz Piledriver)

Code: Select all

     Tue Jun 27 04:00:07 2023 >>> sys-devel/gcc-12.3.1_p20230526
       merge time: 10 hours, 7 minutes and 25 seconds.

     Thu Oct 19 01:02:37 2023 >>> sys-devel/gcc-12.3.1_p20230825
       merge time: 4 hours, 33 minutes and 27 seconds.

I was very surprised (and pleased) to see the speed improvement. What happened ? Same use flags (ada, lto, pgo, objc..) and both compiled while nothing else was running.

the flags lto and pgo quadruple build time and I don't see a reason for me to use them. Your build time was reduced significantly due to gcc not needing to rebuild most or all of its code and only the code that was committed is what was built.

[superjaded]

Code: Select all

2023-09-25T05:07:47 >>> sys-devel/gcc-13.2.1_p20230826: 18 minutes, 13 seconds
2023-11-02T16:49:06 >>> sys-devel/clang-16.0.6: 7 minutes, 31 seconds
2023-02-04T18:11:01 >>> www-client/firefox-109.0.1: 17 minutes, 47 seconds

AMD Ryzen 9 7950X 16-Core Processor (-j16 since this system only has 32GB of memory)

Code: Select all

2023-09-25T21:48:48 >>> sys-devel/gcc-13.2.1_p20230826: 51 minutes, 21 seconds
2023-12-16T16:28:42 >>> sys-devel/clang-16.0.6: 18 minutes, 17 seconds
2023-02-10T05:27:50 >>> www-client/firefox-102.7.0: 52 minutes, 14 seconds

2x Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz (-j32, 192GB of memory)

Firefox examples probably aren't great since I normally use www-client/librewolf-bin for my browser which is why those are crazy old versions, but those were compiled with lto and pgo fwiw.

[mid-kid]

I suggest using a command like:

Code: Select all

qlist -Iv | xargs sudo qlop -Mma | sort -k 2 -nr | head -n 10

In order to obtain the 10 longest-to-compile packages on any given system.

For me, that is:

Code: Select all

dev-qt/qtwebengine: 16327 average for 1 merge
sys-devel/gcc: 12383 average for 1 merge
app-office/libreoffice: 7795 average for 1 merge
sys-devel/llvm: 6484 average for 6 merges
www-client/firefox: 5410 average for 1 merge
dev-lang/rust: 5098 average for 1 merge
sys-devel/clang: 4253 average for 3 merges
app-doc/doxygen: 4154 average for 1 merge
net-libs/nodejs: 4027 average for 1 merge
dev-util/mingw64-toolchain: 3676 average for 1 merge

Some averages here are skewed due to the occasional binary merge (downgrading llvm or gcc, primarily).

Code: Select all

$ sudo genlop -t dev-qt/qtwebengine sys-devel/gcc app-office/libreoffice sys-devel/llvm www-client/firefox
 * dev-qt/qtwebengine

     Tue Dec 19 04:13:49 2023 >>> dev-qt/qtwebengine-5.15.11_p20231120
       merge time: 4 hours, 32 minutes and 7 seconds.

 * sys-devel/gcc

     Wed Dec 20 02:28:40 2023 >>> sys-devel/gcc-12.3.1_p20230825
       merge time: 3 hours, 45 minutes and 9 seconds.

 * app-office/libreoffice

     Fri Dec 22 00:07:56 2023 >>> app-office/libreoffice-7.5.6.2
       merge time: 2 hours, 9 minutes and 55 seconds.

 * sys-devel/llvm

     Tue Aug  1 08:08:28 2023 >>> sys-devel/llvm-16.0.6
       merge time: 2 hours, 22 minutes and 9 seconds.

 * www-client/firefox

     Sat Dec 16 16:32:04 2023 >>> www-client/firefox-115.5.0
       merge time: 1 hour, 30 minutes and 10 seconds.

Code: Select all

Host: 20MUCTO1WW ThinkPad A485 
Kernel: 6.1.60 
CPU: AMD Ryzen 5 PRO 2500U w/ Radeon Vega Mobile Gfx (8) @ 2.000GHz 
Memory: 22919MiB 

USE="pgo lto"; CFLAGS="-pipe -march=znver1 -O3 -fuse-linker-plugin -flto=4 --param=lto-max-streaming-parallelism=4 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition"
Though I disable USE=pgo for firefox these days. Updates too often and takes too long.[/code]

[eeckwrk99]

I suggest using a command like:

Code: Select all

qlist -Iv | xargs sudo qlop -Mma | sort -k 2 -nr | head -n 10

In order to obtain the 10 longest-to-compile packages on any given system.

Nice one. You don't need sudo for qlop though.

Edit: Nevermind, you actually do. My current user was still in the Portage group when I wrote this

[DavidF]

Code: Select all

i9-13900k

Mon Sep 25 10:22:49 2023 >>> sys-devel/gcc-13.2.1_p20230826
       merge time: 17 minutes and 46 seconds
Thu Dec 28 08:02:29 2023 >>> mail-client/thunderbird-115.6.0
       merge time: 6 minutes and 54 seconds.

[/code]

[pietinger]

DavidF,

do you have running many other tasks when you do your emerge world ?

I have also an i9-13900K - using only -j24 (instead of possible -j32 ... because of CPU heat) =>

Code: Select all

 * sys-devel/gcc

     Tue Nov 21 14:11:13 2023 >>> sys-devel/gcc-13.2.1_p20230826
       merge time: 12 minutes and 37 seconds.

with a manually configured kernel where almost every security feature is ENABLED ... so it should be slower than yours ... ?