Hello all,
First a quick introduction, before I get discarded as some crazy CFLAGS-maniac overclocker

: a friend and I are running an IT company in Japan, and we are using Gentoo in production environments, including for customers. Our main business is custom software development, and we also actively participate in the open source community, by contributing code and testing time to various projects (specially regarding Japanese support), and more generally by being Open Source Software advocates. Sorry for this being a long post, but I hope you will make it to the end
I would like to start by thanking all the Gentoo developers for their work. They have put together a great distribution, and they are making our work easier every day

Now I am afraid but I must agree with crohnnie: I too have seen a noticeable degradation in the quality of the portage tree stable branch in the past few months. "emerge world" used to work like a charm. Our machines use an autosync script that builds binary packages at night, and all we have to do is an "emerge -avK ..." to get an almost instant upgrade. As of late, every once in a while, something fails, and we have to spend time figuring the problem out and restart the emerge manually. While for the Gentoo hobbyist that may be an acceptable small annoyance, for us it more of a concern. Please read on to find out exactly why.
(If it was not obvious yet: no we are not using crazy CFLAGS or anything. We are talking production machines here: our settings are very conservative; and yes, we always etc-update; and we revdev-rebuild too.)
We started using Gentoo about a couple of years ago, and quickly fell in love with it. First I was just using it on one of my workstations, and as I saw the power of portage and the ease of adminitrating a Gentoo box, little by little, we ended up migrating all our machines to Gentoo, and also recommending it to our customers. We are currently running Gentoo on 3 laptops, 4 workstations and 5 productions servers. 3 of these machines are customers'.
Now the important thing is: why did we choose to install Gentoo on all these machines? The three main reasons are:
1) Fast updates. We used to run Debian or TurboLinux. The problem with TurboLinux was that they were too slow to release security fixes. Last year when a serious SSH vulnerability was discovered, it took them like a week to release an RPM with the fix. This week of being vulnerable made our customers very nervious. On the other hand, our Gentoo boxes were already fixed even before we heard about the vulnerability.
2) Latest packages. Now with Debian the problem was different: sure it is very stable, but it is too conservative for us. With the applications we develop, we need some packages that were not even in Debian unstable. So we ended up having to install them manually, and therefore maintain them manually, which quickly became a real drag.
3) Easy maintenance. Gentoo alleviated both the problems in 1) and 2), while maintaining the same ease of maintenance as Debian with "sync && emerge -uD world".
So, rock solid, latest packages, fast updates and a breeze to maintain, Gentoo was like a Linux dream. And that's why it became our distribution of choice.
Now let's go back to point 3: it is really a major point for us. We do not get paid for administrating machines but for developing software. We are a small team and cannot afford to waste man-hours. So it is very important for us to keep system administration overhead to a minimum, since every hour we spend there is an hour lost. That is why we use scripts to automate most maintenance tasks. But unfortunately, the number of hours lost to system administration has noticeably increased lately. Some examples of the problems we ran into: giflib and libungif claiming the same library, need to run fix_libtool_files.sh after a gcc upgrade, and various packages suddently blocking each other. While it is still within an acceptable realm, if things continue going that way, we may have to reconsider using and recommending Gentoo.
Now do not get me wrong: I am not saying the situation is unbearable yet. Gentoo is still our favorite distribution, and Gentoo stable, the system itself, is still rock solid. But it is Portage and upgrades that fail more and more often lately, forcing us to increase our system administration overhead. We have noticed this trend, and apparently we are not the only ones. So maybe there is actually a problem worth looking into. We just thought we should bring this matter to the attention of the Gentoo developers.
Sorry again for the long post, and thank you for reading this far.
Best regards,
--
Yves-Eric Martin