Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Dynamic DISTCC_HOSTS & MAKEOPTS Generation for Portage
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2  
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
xaviermiller
Bodhisattva
Bodhisattva


Joined: 23 Jul 2004
Posts: 8706
Location: ~Brussels - Belgique

PostPosted: Thu Mar 22, 2012 12:05 pm    Post subject: Reply with quote

I will test it soon or later ;)
_________________
Kind regards,
Xavier Miller
Back to top
View user's profile Send private message
miscdebris
n00b
n00b


Joined: 30 Mar 2005
Posts: 70

PostPosted: Thu Mar 22, 2012 6:40 pm    Post subject: Reply with quote

Let me know. If it's not working, I'll get it fixed up.
_________________
Dynamic DISTCC_HOSTS & MAKEOPTS Generation for Portage
Back to top
View user's profile Send private message
xaviermiller
Bodhisattva
Bodhisattva


Joined: 23 Jul 2004
Posts: 8706
Location: ~Brussels - Belgique

PostPosted: Thu Mar 22, 2012 9:47 pm    Post subject: Reply with quote

I will have some time this week-end. I will let you know.

EDIT: I will simplfy your script to my needs. The solution is using /etc/portage/bashrc.

Here is my script
Code:
#!/bin/bash

if ! ping -c 1 -q -w 1 MY_DISTCC_SERVER > /dev/null 2>&1
then
    #disable DISTCC, reduce MAKEOPTS
    export MAKEOPTS="-j3"
    export FEATURES="candy sandbox parallel-fetch -distcc buildpkg"
fi


Thank you for pointing out the key file ;)
_________________
Kind regards,
Xavier Miller
Back to top
View user's profile Send private message
lazy_bum
l33t
l33t


Joined: 16 Feb 2005
Posts: 691

PostPosted: Wed Feb 20, 2013 9:26 am    Post subject: Reply with quote

miscdebris wrote:
Let me know. If it's not working, I'll get it fixed up.

It seems to work fine after some minor improvements (ok, i'm a bit lost in my /etc/portage/bashrc right now and this should be verifed), but I got a weird bug with sudo:
Code:
>>> Source configured.
Checking localhost/1... Verified.  Checking Processes... 1 Processes.
/etc/portage/bashrc: line 95: -j2 SAMPLES=+1: syntax error in expression (error token is "SAMPLES=+1")

sudo ebuild has a MAKEOPTS declaration:
Code:
wloczykij ~ # grep MAKEOPTS /usr/portage/app-admin/sudo/sudo-1.8.6_p6.ebuild
MAKEOPTS+=" SAMPLES="

_________________
roslin uberlay | grubelek
Back to top
View user's profile Send private message
miscdebris
n00b
n00b


Joined: 30 Mar 2005
Posts: 70

PostPosted: Thu Feb 21, 2013 1:48 am    Post subject: Reply with quote

lazy_bum wrote:
miscdebris wrote:
Let me know. If it's not working, I'll get it fixed up.

It seems to work fine after some minor improvements (ok, i'm a bit lost in my /etc/portage/bashrc right now and this should be verifed), but I got a weird bug with sudo:
Code:
>>> Source configured.
Checking localhost/1... Verified.  Checking Processes... 1 Processes.
/etc/portage/bashrc: line 95: -j2 SAMPLES=+1: syntax error in expression (error token is "SAMPLES=+1")

sudo ebuild has a MAKEOPTS declaration:
Code:
wloczykij ~ # grep MAKEOPTS /usr/portage/app-admin/sudo/sudo-1.8.6_p6.ebuild
MAKEOPTS+=" SAMPLES="


While completely untested (I don't run Gentoo anymore), I believe I've fixed it.

I replaced most of the MAKEOPTS with BUILD_PROCESSES. It's better coding that way anyway.
_________________
Dynamic DISTCC_HOSTS & MAKEOPTS Generation for Portage
Back to top
View user's profile Send private message
lazy_bum
l33t
l33t


Joined: 16 Feb 2005
Posts: 691

PostPosted: Sat Mar 23, 2013 9:37 pm    Post subject: Reply with quote

Thanks, seems to work like it should. (:
_________________
roslin uberlay | grubelek
Back to top
View user's profile Send private message
miscdebris
n00b
n00b


Joined: 30 Mar 2005
Posts: 70

PostPosted: Tue Mar 26, 2013 9:43 pm    Post subject: Reply with quote

Awesome.

Anyone can let me know if there are problems, and I'll try to fix them.
_________________
Dynamic DISTCC_HOSTS & MAKEOPTS Generation for Portage
Back to top
View user's profile Send private message
Frautoincnam
Apprentice
Apprentice


Joined: 19 May 2017
Posts: 290

PostPosted: Fri May 19, 2017 5:28 am    Post subject: Reply with quote

I have been using this script for a long time, but it seems to not work perfectly anymore.
2 kinds of error :
1) dyn_distcc not yet sourced but my portage logs contains :
Code:
distcc[21350] ERROR: compile (null) on localhost failed
distcc[21349] ERROR: compile /var/tmp/portage/dev-qt/qtwebkit-4.8.7/work/qt-everywhere-opensource-src-4.8.7/config.tests/unix/db2/db2.cpp on localhost failed


2) when dyn_distcc sourced, it continues to try to use distcc on host not connected AND not in DISTCC_HOSTS (medion.mydomain is in my /etc/distcc/hosts but not connected)
Code:
distcc[9348] ERROR: compile (null) on localhost failed
distcc[9347] ERROR: compile /var/tmp/portage/dev-qt/qtwebkit-4.8.7/work/qt-everywhere-opensource-src-4.8.7/config.tests/unix/alsa/alsatest.cpp on localhost failed
 * ||||||||||||| dyn_distcc.sh sourced
 * ||||||||||||| dyn_distcc.sh MAKEOPTS=-j5 DISTCC_HOSTS=localhost/2 serveur.mydomain/2
HOSTS: localhost/2 serveur.mydomain/2, MAKEOPTS: -j5
distcc[25492] ERROR: nonblocking connect to 192.168.0.7:3632 failed: No route to host
distcc[25492] Warning: failed to distribute /var/tmp/ccache/tmp/YarrPatter.stdout.cored.25476.r4Pd1o.ii to medion.mydomain/4, running locally instead


Surely a change in portage.
Back to top
View user's profile Send private message
miscdebris
n00b
n00b


Joined: 30 Mar 2005
Posts: 70

PostPosted: Wed May 24, 2017 4:36 pm    Post subject: Reply with quote

Frautoincnam wrote:
I have been using this script for a long time, but it seems to not work perfectly anymore.
2 kinds of error :
1) dyn_distcc not yet sourced but my portage logs contains :
Code:
distcc[21350] ERROR: compile (null) on localhost failed
distcc[21349] ERROR: compile /var/tmp/portage/dev-qt/qtwebkit-4.8.7/work/qt-everywhere-opensource-src-4.8.7/config.tests/unix/db2/db2.cpp on localhost failed


2) when dyn_distcc sourced, it continues to try to use distcc on host not connected AND not in DISTCC_HOSTS (medion.mydomain is in my /etc/distcc/hosts but not connected)
Code:
distcc[9348] ERROR: compile (null) on localhost failed
distcc[9347] ERROR: compile /var/tmp/portage/dev-qt/qtwebkit-4.8.7/work/qt-everywhere-opensource-src-4.8.7/config.tests/unix/alsa/alsatest.cpp on localhost failed
 * ||||||||||||| dyn_distcc.sh sourced
 * ||||||||||||| dyn_distcc.sh MAKEOPTS=-j5 DISTCC_HOSTS=localhost/2 serveur.mydomain/2
HOSTS: localhost/2 serveur.mydomain/2, MAKEOPTS: -j5
distcc[25492] ERROR: nonblocking connect to 192.168.0.7:3632 failed: No route to host
distcc[25492] Warning: failed to distribute /var/tmp/ccache/tmp/YarrPatter.stdout.cored.25476.r4Pd1o.ii to medion.mydomain/4, running locally instead


Surely a change in portage.


Wow, It's just now breaking.

I'll spin up a couple VMs this weekend and take a look.
_________________
Dynamic DISTCC_HOSTS & MAKEOPTS Generation for Portage
Back to top
View user's profile Send private message
Frautoincnam
Apprentice
Apprentice


Joined: 19 May 2017
Posts: 290

PostPosted: Sun Dec 03, 2017 7:40 pm    Post subject: Reply with quote

miscdebris wrote:
I'll spin up a couple VMs this weekend and take a look.

No news ? :(
Back to top
View user's profile Send private message
miscdebris
n00b
n00b


Joined: 30 Mar 2005
Posts: 70

PostPosted: Sat Apr 07, 2018 5:27 pm    Post subject: Reply with quote

I'd call this script unmaintained. I've not used Gentoo for 10 years now. If someone wants to work on it, they are more than welcome to.
_________________
Dynamic DISTCC_HOSTS & MAKEOPTS Generation for Portage
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Goto page Previous  1, 2
Page 2 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum