using Pyston instead of Python for Portage ?

kernelOfTruth

Hi there,

would be using Pyston instead of Python as a "backend" be an option to accelerate Portage ?

http://www.phoronix.com/scan.php?page=news_item&px=MTc4ODQ
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004

Naib · Posted: Tue Sep 16, 2014 8:26 pm Post subject:

portage has a pypy use flag which is a JIT compiler
_________________

kernelOfTruth · Posted: Tue Sep 16, 2014 9:12 pm Post subject:

Good grief !

Never was aware and questioned what that use-flag did - had it disabled all the time :cry:

Thanks for the hint Naib

_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004

mrbassie · l33t Joined: 31 May 2013 Posts: 772 Location: over here

kernelOfTruth · Posted: Thu Sep 18, 2014 11:42 pm Post subject:

mrbassie · l33t Joined: 31 May 2013 Posts: 772 Location: over here

Still can't get it to work.

I didn't have a /etc/portage/profile directory so I tried creating it and package.use.mask, did an env-update and source /etc/profile, portage still doesn't set the flag. I already have pypy emerged but it isn't shown by eselect python list.

grep -iR pypy /usr/portage/profiles/

kernelOfTruth · Posted: Fri Sep 19, 2014 11:51 pm Post subject:

restored stage4 backup, system filesystem was showing countless errors - not sure why ...

no need to re-quote the /usr/portage/profiles/

it was just to signify that there are some potential problems with pypy & portage, therefore it's masked

so not sure how well it'll work in total

anyways - let's continue:

mrbassie · l33t Joined: 31 May 2013 Posts: 772 Location: over here

Still can't get it to work, pypy is on my system (with jit) but eselect only shows pythons 2 and 3.

if I do

kernelOfTruth · Posted: Thu Sep 25, 2014 3:12 am Post subject:

it probably works (or used to work) without eselect python

but now the pypy use-flag is also gone for me since a few days

not sure who or what broke it

at least according to gentoo's x86 cvs the change occured during 11th or 12th September (with the portage-9999 live ebuild):

http://sources.gentoo.org/cgi-bin/viewvc.cgi/gentoo-x86/sys-apps/portage/portage-9999.ebuild?view=log
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004

kernelOfTruth · **emerge =portage-2.2.12* -pv wrote:**

argh - got the syntax wrong :lol:

Naib · Posted: Thu Sep 25, 2014 10:02 pm Post subject:

try hacking it to see if it is just an oversight
_________________

kernelOfTruth · Posted: Sat Oct 25, 2014 8:26 pm Post subject:

well, attempted it and ... failed :lol:

the thing is: I updated & changed to newer portage version and couldn't really notice a difference beside:

it seemed to run faster (without pypy !)

so the pypy-backed portage probably wasn't working properly ?

I'm already using portage with the sqlite backend and some tweaks to eix, etc. that should speed it up somewhat

nevertheless it would be nice if it was noticably faster

_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004

WWWW · Tux's lil' helper Joined: 30 Nov 2014 Posts: 143

from wikipedia about JIT: