Distcc not using hostlist when used by emerge

[swarsron]

Hi,

i installed distcc following http://www.gentoo.org/doc/en/distcc.xml. When i compile something manually (aka make) it works flawlessly, but when i emerge something it only uses localhost to compile.

cat /etc/distcc/hosts
localhost 192.168.1.88

emerge info
Portage 2.0.50-r9 (default-x86-2004.0, gcc-3.3.3, glibc-2.3.3.20040420-r0, 2.6.7)
=================================================================
System uname: 2.6.7 i686 AMD Athlon(tm) XP 1800+
Gentoo Base System version 1.4.16
distcc 2.13 i686-pc-linux-gnu (protocols 1 and 2) (default port 3632) [enabled]
ccache version 2.3 [enabled]
Autoconf: sys-devel/autoconf-2.59-r3
Automake: sys-devel/automake-1.8.3
ACCEPT_KEYWORDS="x86"
AUTOCLEAN="yes"
CFLAGS="-march=athlon-xp -O2 -pipe -fomit-frame-pointer"
CHOST="i686-pc-linux-gnu"
COMPILER="gcc3"
CONFIG_PROTECT="/etc /usr/kde/2/share/config /usr/kde/3/share/config /usr/share/config /var/qmail/control"
CONFIG_PROTECT_MASK="/etc/gconf /etc/terminfo /etc/env.d"
CXXFLAGS="-march=athlon-xp -O2 -pipe -fomit-frame-pointer"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoaddcvs ccache distcc keeptemp keepwork sandbox userpriv"
GENTOO_MIRRORS="ftp://ftp.uni-erlangen.de/pub/mirrors/gentoo http://gentoo.oregonstate.edu http://www.ibiblio.org/pub/Linux/distributions/gentoo"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY=""
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="apm berkdb crypt cups encode foomaticdb gdbm gif imlib libg++ libwww mad maildir mikmod motif ncurses nls oss pam pdflib perl png python readline slang spell ssl tcpd x86 xml2 zlib"

Any advice?

TIA,
Johannes

[Jinidog]

Play around with the settings.
If you make a / behind the hostnames, you can say, how much makes the host maximal should do.
I would set MAKEOPTS to "-j4" and change the hosts file a little bit.
If the other machine is signifcantly slower than localhost, set it to:
localhost/3
192.168.1.88/1

Is it nearly the same speed, perhaps set MAKEOPTS to 5 and make something like.

localhost/3
192.168.1.88/2

Is the other machine faster than localhost, write it before localhost:
192.168.1.88/3
localhost/2

Try them out, I don't know how good the settings are.
In may "Optimizing distcc" thread I there came not much tips.

[swarsron]

I don't want to tune my settings for performance (now), i just want to get it to work. I simply don't get why portage seems to ignore /etc/distcc/hosts

[b-llwyd]

Using x.x.x.x/3 and x.x.x.x/2 in my host list was the thing that got my distcc up and running. Before this, I was only using ip numbers (and "localhost"), but it didnt want to share the work load.

[elpierco]

Billwyd is right I couldnt get it to send any jobs to the other computer for compiling I had to set both the localhost (192.168.1.6) and the remote host 192.168.1.5 and then specify respectively /2 and /12. I then run netstat on the local machine and top u distcc on the remote machine and it gets hammered

So now my question is I cant get the distccmon-text to work for me any ideas??? It just comes out blank when I run it on the server ie the one I am emergeing on

[Dr_Smack]

So now my question is I cant get the distccmon-text to work for me any ideas??? It just comes out blank when I run it on the server ie the one I am emergeing on

Try running:
"DISTCC_DIR=/var/tmp/portage/.distcc/ distccmon-text" Or setting the DISTCC_DIR environment variable earlier. This assumes you haven't modified the distcc locations from the default ebuild.

[malv]

[quote="Dr_Smack"][quote="elpierco"]So now my question is I cant get the distccmon-text to work for me any ideas??? It just comes out blank when I run it on the server ie the one I am emergeing on[/quote]
Try running:
"DISTCC_DIR=/var/tmp/portage/.distcc/ distccmon-text" Or setting the DISTCC_DIR environment variable earlier. This assumes you haven't modified the distcc locations from the default ebuild.[/quote]

Did you ever get distccmon-gnome going?

Thx.
malv

[Minox]

Yo,
distccmon-gnome works for me: I've started it with:

Code: Select all

DISTCC_DIR=/var/tmp/portage/.distcc/ distccmon-text &

[silentbob]

Just replying so I can find this thread later, it looks like the solution to problems I was having with distcc not sharing the work out and distcc-mon showing blank. Cheers all.

[Minox]

Hello again,

... but it is quite embarassing. With distccmon i've seen that only the remote host will be used the most times. Sometimes it works quite well. I read the forum and i also set the make option in make.conf to "-j4" Also i'm using a host list:

/etc/distcc/hosts

Code: Select all

192.168.100.250/3
192.168.100.102/2

How get it work correctly? Does anybody got happy with it?

[mrmeanor]

What you're probably running into is not that distcc is ignoring your host list, but rather you're compiling a package that doesn't pass gcc a lot of work. The way the package's makefile is writen determines this, some packages will pass entire directories to be built, some will just pass a singe file to the compiler. The other thing is you might be compiling a package that doesn't allow the use of distcc (such as mozilla).

http://gallery.iceenakedpenguins.net/Screenshots/aag

[Minox]

Yeah, you're completly right. I've just emerged enlightenment and for that emerge it uses distcc quite well.