[TIP] Using psyco to speed up emerge

[jpc82]

emerge -pUD world went from 10sec to 8sec
emerge -p depclean went from 7sec to 5 sec

[papabean]

What effect, if any, does this have on emerge sync?
_________________
-- The world is full of tough guys. It doesn't need me to be one too.

[MK]

Hm, tried it and it does improve speed a little

emerge -up world from 5.5s to 4.2s
emerge -s psyco from 1.8s to 1.3s
emerge -S psyco from 36s to 28s

Helps a little so I'll keep it

[alec]

[papabean]

[Pink]

I haven't benchmarked it, but it does seem to make a difference here - even if it is only a few seconds, it's got to be worth it.

[knarf]

With :

[Species]

same speedup effect as described on my laptop

without psyco:

[Gil-galad55]

Since this is an I/O bound process, most likely those people with significant time differences have either small world files (less I/O required) or slower processors, where the more efficient code helps out. As the world file increases, I can see the two times converging as I/O dominates.
_________________
a^2 + b^2 = c^2
"To strive, to seek, to find, and not to yield." Tennyson

[guard0]

i doubt it would be of much worth as a USE flag, but as a FEATURES flag (where you put distcc, ccache, sandbox, etc) since it would primarily be used for portage utilities...
_________________
Linux on an AMD processor: an OS for people who dont use deoderant with a CPU for people who can't afford deoderant

[aridhol]

For you speedfreaks it might be interested to know you can use mySQL to do your searches:

https://forums.gentoo.org/viewtopic.php?t=175461
_________________
72 of Pitcairn Islands 49 inhabitants use Seti@Home
"If you buy a DVD you have a copy. If you want a backup copy you buy another one."
"Anyone who is capable of getting themselves made President should on no account be allowed to do the job."

[madmango]

time emerge -peD world


without: 5.997 sec
with: 5.977 sec

wOw! Amazing .2 second decrease!
_________________
word.

[polle]

I get this error:

File "/usr/bin/emerge", line 12
except ImportError:
^
SyntaxError: invalid syntax

I tried to copy and paste from the above but still get that error
(used nano to edit the file /usr/bin/emerge and tried with and without a space before except)

[fca]

unfortunately this doesn't work on a Pax protected system, The psyco compiler gets killed then.

[c0balt]

Hi,
couldnt this be added to portage officially?
afaik the code doesnt brake anything if psyco isnt installed.
everytime theres a new portage package one has to add the lines manually, though thats not that often its annoying and i tend to forget

[blu3bird]

emere -up world:

[thinko]

I think you guys haven't correctly configured psyco.. when I use it with emerge, I see a significant benefit every time.

ex: emerge -pDuv world
Without Psyco:

[Pythonhead]

All these tests are pretty meaningless. I notice everyone is timing the psyco version second. All this stuff is getting cached, so whenever you run a second test, it should be faster, psyco or not:

I boot up my system and run emerge -ep world:

real 0m51.199s
user 0m15.540s
sys 0m1.467s

Then run it again immediately:

real 0m25.222s
user 0m15.376s
sys 0m1.192s

(neither test using psyco)

There was already a bug filed asking to put psyco in portage (where requests go, not these forums, by the way) and it was declined:

https://bugs.gentoo.org/show_bug.cgi?id=45793

Also, psyco also uses an enormous amount of memory, so wouldn't be great for everyone.

psyco may help a tiny bit for searching portage, but its almost all disk i/o that is the bottleneck. Thats why people aren't getting much if any speedups with the mysql portage backend (last I checked).

[neysx]

Psyco can improve performances significantly depending on CPU/IO/World file.

On a Via C3-800
#1 w/psyco:
real 0m30.547s
user 0m12.717s
sys 0m1.980s

#2 w/ psyco again (cached data):
real 0m15.492s
user 0m12.352s
sys 0m1.694s

#3 wo/psyco (data still in cache):
real 0m21.210s
user 0m17.691s
sys 0m1.541s

Another run wo/psyco yields the same values.

Same test on an old P100 (2x with psyco, 1x without)
real 1m54.831s
user 1m38.690s
sys 0m7.410s

real 1m45.879s
user 1m38.610s
sys 0m6.620s

real 2m25.927s
user 2m18.590s
sys 0m6.510s

On my 2xMp2400+ (huge world file)
with psyco
real 1m25.650s
user 1m4.695s
sys 0m10.188s

without
real 1m31.772s
user 1m12.129s
sys 0m10.334s

Generally speaking, using psyco does not make much sense on fast modern machines but it has its uses on old equipment.

[fbd]

[v0m1t]

emerge -s xmms with psyco
real 0m11.637s
user 0m4.909s
sys 0m0.480s

emerge -s xmms without psyco
real 0m8.575s
user 0m5.106s
sys 0m0.454s



Both tests with cached results.

[redshift]

With portage 2.0.51_rc9, this seems to give me constant segfaults. Before emerging rc9 today (from rc7) I never had problems, and psyco did give a little boost.
_________________
Tom

[Trevoke]

Same issue here. New portage no like psyco.
_________________
Votre moment detente
What is the nature of conflict?

[Jtb]

Just tried it on a fast machine (AMD64 3000+ with 1GB but 32bit Gentoo):

time emerge search psyco
with:
real 0m9.545s
user 0m0.778s
sys 0m0.191s

without:
real 0m7.229s
user 0m0.946s
sys 0m0.165s


time emerge -S psyco
with:
real 1m0.649s
user 0m16.814s
sys 0m3.649s

without:
real 1m11.777s
user 0m29.205s
sys 0m3.637s


time emerge -ep world
without:
real 0m44.441s
user 0m13.307s
sys 0m1.066s

with:
real 0m16.807s
user 0m8.227s
sys 0m0.968s


Reboots between with and without:
emerge search psyco, emerge -S psyco [reboot] emerge search psyco, emerge -S psyco [reboot emerge -ep world [reboot] emerge -ep world
_________________
Jens

.. God is real - unless declared integer!

[Viha]

Segfaulted here on emerge clean (portage 2.0.51_rc9).