Gentoo brought to its knees by large ebuilds

Message

eccerr0r · Post by **eccerr0r** » Wed Aug 01, 2012 5:23 pm

Looks like it's not only Linux that has problems with Firefox...

https://bugzilla.mozilla.org/show_bug.cgi?id=709193

I was just thinking about this when building firefox10 on my ia64 box. Though this box has 4GB RAM and being a 64-bit arch it shouldn't run out of virtual address space, it's been an hour doing the link. It's allocated 1962MB RAM (3MB of which is shared).

klevin · Post by **klevin** » Sat Aug 25, 2012 5:36 am

Trying emerge mail-client/thunderbird-10.0.6. It dies every time with

Code: Select all

/usr/bin/python2.7 /var/tmp/portage/mail-client/thunderbird-10.0.6/work/comm-esr10/mozilla/config/pythonpath.py -I../../config /var/tmp/portage/mail-client/thunderbird-10.0.6/work/comm-esr10/mozilla/config/expandlibs_exec.py --uselist --  i686-pc-linux-gnu-g++  -fno-rtti -Wall -Wpointer-arith -Woverloaded-virtual -Wsynth -Wno-ctor-dtor-privacy -Wno-non-virtual-dtor -Wcast-align -Wno-invalid-offsetof -Wno-variadic-macros -Werror=return-type -march=i686 -pipe -Wno-return-type -w -mno-avx -fno-exceptions -fno-strict-aliasing -fshort-wchar -fno-tree-vrp -pthread -ffunction-sections -fdata-sections -pipe  -DNDEBUG -DTRIMMED -g -O2 -fomit-frame-pointer -fPIC -shared -Wl,-z,defs -Wl,--gc-sections -Wl,-h,libxul.so -o libxul.so  nsStaticXULComponents.o nsUnicharUtils.o nsBidiUtils.o nsRDFResource.o    -lpthread -Wl,-O1 -Wl,--as-needed   -Wl,-rpath-link,/var/tmp/portage/mail-client/thunderbird-10.0.6/work/comm-esr10/tbird/mozilla/dist/bin -Wl,-rpath-link,/usr/lib    ../../toolkit/xre/libxulapp_s.a  ../../staticlib/components/libnecko.a ../../staticlib/components/libuconv.a ../../staticlib/components/libi18n.a ../../staticlib/components/libchardet.a ../../staticlib/components/libjar50.a ../../staticlib/components/libstartupcache.a ../../staticlib/components/libpref.a ../../staticlib/components/libhtmlpars.a ../../staticlib/components/libimglib2.a ../../staticlib/components/libgkgfx.a ../../staticlib/components/libgklayout.a ../../staticlib/components/libdocshell.a ../../staticlib/components/libembedcomponents.a ../../staticlib/components/libwebbrwsr.a ../../staticlib/components/libnsappshell.a ../../staticlib/components/libtxmgr.a ../../staticlib/components/libcommandlines.a ../../staticlib/components/libtoolkitcomps.a ../../staticlib/components/libpipboot.a ../../staticlib/components/libpipnss.a ../../staticlib/components/libappcomps.a ../../staticlib/components/libjsreflect.a ../../staticlib/components/libcomposer.a ../../staticlib/components/libjetpack_s.a ../../staticlib/components/libtelemetry.a ../../staticlib/components/libjsdebugger.a ../../staticlib/components/libstoragecomps.a ../../staticlib/components/librdf.a ../../staticlib/components/libwindowds.a ../../staticlib/components/libjsctypes.a ../../staticlib/components/libjsperf.a ../../staticlib/components/libgkplugin.a ../../staticlib/components/libunixproxy.a ../../staticlib/components/libjsd.a ../../staticlib/components/libautoconfig.a ../../staticlib/components/libauth.a ../../staticlib/components/libcookie.a ../../staticlib/components/libpermissions.a ../../staticlib/components/libuniversalchardet.a ../../staticlib/components/libfileview.a ../../staticlib/components/libplaces.a ../../staticlib/components/libtkautocomplete.a ../../staticlib/components/libsatchel.a ../../staticlib/components/libpippki.a ../../staticlib/components/libwidget_gtk2.a ../../staticlib/components/libsystem-pref.a ../../staticlib/components/libimgicon.a ../../staticlib/components/libaccessibility.a ../../staticlib/components/libremoteservice.a ../../staticlib/components/libspellchecker.a ../../staticlib/components/libzipwriter.a ../../staticlib/components/libservices-crypto.a ../../staticlib/components/libxpautocomplete.a ../../staticlib/components/libmailcomps.a ../../staticlib/components/libmail.a ../../staticlib/components/libmsgsmime.a ../../staticlib/components/libimport.a ../../staticlib/components/libmozldap.a ../../staticlib/components/libmork.a ../../staticlib/libjsipc_s.a ../../staticlib/libdomipc_s.a ../../staticlib/libdomplugins_s.a ../../staticlib/libmozipc_s.a ../../staticlib/libmozipdlgen_s.a ../../staticlib/libipcshell_s.a ../../staticlib/libgfx2d.a ../../staticlib/libgfxipc_s.a ../../staticlib/libhal_s.a ../../staticlib/libxpcom_core.a ../../staticlib/libucvutil_s.a ../../staticlib/libchromium_s.a ../../staticlib/libmozreg_s.a ../../staticlib/libgtkxtbin.a ../../staticlib/libthebes.a ../../staticlib/libycbcr.a ../../staticlib/libangle.a  -L../../dist/bin -L../../dist/lib -ljpeg  -lpng  ../../gfx/qcms/libmozqcms.a /var/tmp/portage/mail-client/thunderbird-10.0.6/work/comm-esr10/tbird/mozilla/dist/lib/libjs_static.a -lffi   -Wl,-R/usr/lib -L/usr/lib -lssl3 -lsmime3 -lnss3 -lnssutil3 -lcrmf -lcairo -lpixman-1 -lfreetype -lfontconfig    -L/usr/lib -lXrender -lcairo -lX11   ../../gfx/harfbuzz/src/libmozharfbuzz.a ../../gfx/ots/src/libmozots.a -L../../dist/bin -L../../dist/lib -lldap60 -lprldap60 -lldif60 ../../dist/lib/libmozsqlite3.a  -lz  -lhunspell-1.3   -L/usr/lib -levent  -lasound   -L../../dist/bin -L../../dist/lib  -Wl,-R/usr/lib -L/usr/lib -lplds4 -lplc4 -lnspr4 -lpthread -ldl ../../dist/lib/libmozalloc.a -pthread -ldbus-glib-1 -ldbus-1 -lpthread -lgobject-2.0 -lgthread-2.0 -lrt -lglib-2.0   -L/usr/lib -lX11  -lXext  -pthread -lpangoft2-1.0 -lfreetype -lfontconfig -lpangocairo-1.0 -lpango-1.0 -lcairo -lgobject-2.0 -lgmodule-2.0 -lgthread-2.0 -lrt -lglib-2.0   -pthread -lgtk-x11-2.0 -latk-1.0 -lgio-2.0 -lpangoft2-1.0 -lfreetype -lfontconfig -lgdk-x11-2.0 -lpangocairo-1.0 -lgdk_pixbuf-2.0 -lpango-1.0 -lcairo -lgmodule-2.0 -lgobject-2.0 -lgthread-2.0 -lrt -lglib-2.0   -lXt -lgthread-2.0 -lfreetype -lz -lbz2 -lvpx -ldl  -lrt    
collect2: ld terminated with signal 9 [Killed]
make[5]: *** [libxul.so] Error 1

At the same time as the build was killed, I find:

Code: Select all

[2934758.964185] gconfd-2 invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
[2934758.964189] gconfd-2 cpuset=/ mems_allowed=0

in /var/log/messages. This is on a system with 4GB of RAM.

Post by **John R. Graham** » Sat Aug 25, 2012 12:48 pm

"Invoked oom-killer". You're out of memory. How much swap do you have?

- John

klevin · Post by **klevin** » Sat Aug 25, 2012 7:41 pm

John R. Graham wrote:"Invoked oom-killer". You're out of memory. How much swap do you have?

- John

No swap. Don't usually need it. I ended up stopping a few processes with large memory footprints (Firefox, for one), and the Thunderbird build was able to complete. Given how rarely I use a standalone email client, any more, I'm considering just dropping Thunderbird from my system, in favor of something less enormous.

Post by **John R. Graham** » Sat Aug 25, 2012 7:57 pm

Okay. I've never really understood the no-swap thing. It's almost entirely harmless when not in use (and if you make the appropriate swappiness settings) and it prevents annoying failures like this.

- John

klevin · Post by **klevin** » Sat Aug 25, 2012 8:08 pm

John R. Graham wrote:Okay. I've never really understood the no-swap thing. It's almost entirely harmless when not in use (and if you make the appropriate swappiness settings) and it prevents annoying failures like this.

- John

This is the first time it's been an issue, for me. Also, this is a laptop, and reducing the amount of disk I/O seems to have a significant impact on battery life.

eccerr0r · Post by **eccerr0r** » Sat Aug 25, 2012 8:37 pm

klevin wrote:
John R. Graham wrote:Okay. I've never really understood the no-swap thing. It's almost entirely harmless when not in use (and if you make the appropriate swappiness settings) and it prevents annoying failures like this.

- John
This is the first time it's been an issue, for me. Also, this is a laptop, and reducing the amount of disk I/O seems to have a significant impact on battery life.

Also reducing the amount of work/thrash would also improve battery life. Try to reduce your workload on your laptop. Linux is merely trying to prevent you losing work when you run out of RAM and it has to kill something before it crashes and burns...

Hypnos · Post by **Hypnos** » Sun Aug 26, 2012 1:19 am

If you set /proc/sys/vm/swappiness to zero, the system will only use swap when it absolutely has to, such as in this instance, leaving disk I/O unchanged under normal usage.

Moreover, if you use a swapfile instead of a swap partition, you can reallocate disk space easily.

This is what I do. I also use a lean XFCE desktop (no gconf, no orbit) to reduce the number of background processes as eccerr0r suggests.

Gentoo brought to its knees by large ebuilds

thunderbird emerge gets killed by oom killer