Tweaked glibc 2.4 + 2.5 + snapshot ebuilds

Message

b33fc0d3 · Post by **b33fc0d3** » Sat Jul 01, 2006 11:50 am

Good work, building new version as we speak, just wondering if binutils overlay is gonna get a bump any time soon ?

b33fc0d3 · Post by **b33fc0d3** » Sat Jul 01, 2006 12:13 pm

x86_64-pc-linux-gnu-gcc pthread_mutex_init.c -c -std=gnu99 -DNDEBUG=1 -O2 -Wall -Winline -Wwrite-strings -fmerge-all-constants -fno-ident -march=athlon64 -pipe -Wstrict-prototypes -mpreferred-stack-boundary=2     -I../include -I/var/tmp/portage/glibc-2.4.90.20060701/work/build-x86-x86_64-pc-linux-gnu-nptl/nptl -I/var/tmp/portage/glibc-2.4.90.20060701/work/build-x86-x86_64-pc-linux-gnu-nptl -I../sysdeps/i386/elf -I../nptl/sysdeps/unix/sysv/linux/i386/i686 -I../nptl/sysdeps/unix/sysv/linux/i386 -I../sysdeps/unix/sysv/linux/i386 -I../ports/sysdeps/unix/sysv/linux -I../nptl/sysdeps/unix/sysv/linux -I../nptl/sysdeps/pthread -I../sysdeps/pthread -I../sysdeps/unix/sysv/linux -I../sysdeps/gnu -I../sysdeps/unix/common -I../sysdeps/unix/mman -I../sysdeps/unix/inet -I../ports/sysdeps/unix/sysv/i386 -I../sysdeps/unix/sysv/i386 -I../ports/sysdeps/unix/sysv -I../nptl/sysdeps/unix/sysv -I../sysdeps/unix/sysv -I../sysdeps/unix/i386 -I../ports/sysdeps/unix -I../nptl/sysdeps/unix -I../sysdeps/unix -I../sysdeps/posix -I../sysdeps/i386/i686/fpu -I../nptl/sysdeps/i386/i686 -I../sysdeps/i386/i686 -I../sysdeps/i386/i486 -I../nptl/sysdeps/i386/i486 -I../sysdeps/i386/fpu -I../nptl/sysdeps/i386 -I../sysdeps/i386 -I../sysdeps/wordsize-32 -I../sysdeps/ieee754/ldbl-96 -I../sysdeps/ieee754/dbl-64 -I../sysdeps/ieee754/flt-32 -I../sysdeps/ieee754 -I../sysdeps/generic/elf -I../sysdeps/generic -I../ports -I../nptl  -I.. -I../libio -I. -nostdinc -isystem /usr/lib/gcc/x86_64-pc-linux-gnu/4.1.1/include -isystem /usr/include -D_LIBC_REENTRANT -include ../include/libc-symbols.h   -DNOT_IN_libc=1 -DIS_IN_libpthread=1    -o /var/tmp/portage/glibc-2.4.90.20060701/work/build-x86-x86_64-pc-linux-gnu-nptl/nptl/pthread_mutex_init.o -MD -MP -MF /var/tmp/portage/glibc-2.4.90.20060701/work/build-x86-x86_64-pc-linux-gnu-nptl/nptl/pthread_mutex_init.o.dt -MT /var/tmp/portage/glibc-2.4.90.20060701/work/build-x86-x86_64-pc-linux-gnu-nptl/nptl/pthread_mutex_init.o
pthread_mutex_init.c: In function '__pthread_mutex_init':
pthread_mutex_init.c:84: error: 'PTHREAD_MUTEX_PRIO_INHERIT_NP' undeclared (first use in this function)
pthread_mutex_init.c:84: error: (Each undeclared identifier is reported only once
pthread_mutex_init.c:84: error: for each function it appears in.)
pthread_mutex_init.c:88: error: 'PTHREAD_MUTEX_PRIO_PROTECT_NP' undeclared (first use in this function)
make[2]: *** [/var/tmp/portage/glibc-2.4.90.20060701/work/build-x86-x86_64-pc-linux-gnu-nptl/nptl/pthread_mutex_init.o] Error 1
make[2]: *** Waiting for unfinished jobs....
make[2]: Leaving directory `/var/tmp/portage/glibc-2.4.90.20060701/work/glibc-2.4/nptl'
make[1]: *** [nptl/subdir_lib] Error 2
make[1]: Leaving directory `/var/tmp/portage/glibc-2.4.90.20060701/work/glibc-2.4'
make: *** [all] Error 2

nxsty, is this related to the patch ?

Martin.Jansa · Post by **Martin.Jansa** » Sat Jul 01, 2006 1:14 pm

b33fc0d3 wrote:nxsty, is this related to the patch ?

same error here

nesl247 · Post by **nesl247** » Sat Jul 01, 2006 1:16 pm

Everyone, the binutils overlay has been updated: http://distfiles.evolution-mission.org/ ... ay.tar.bz2

Nxsty, please update the first post to use this link instead of my old one. Thank you

nxsty · Post by **nxsty** » Sat Jul 01, 2006 1:29 pm

No that seems to be a different error. I'll see if I can reproduce it.

Should I add the new -Wl,--hash-style= patch btw?

freigeist · Post by **freigeist** » Sat Jul 01, 2006 3:01 pm

Should I add the new -Wl,--hash-style= patch btw?

That would be really nice! It seems that -Bdirect will never make its way into the main release but hash-style will...

abhay · Post by **abhay** » Sat Jul 01, 2006 5:08 pm

gawd...

I don't know how to handle this now. I have compiled my current world with nxsty's glibc-2.4.3-r3 and binutils-2.16.93 with

Code: Select all

LDFLAGS="-Wl,-O1 -Wl,--sort-common -Wl,--enable-new-dtags -Wl,-Bdirect -Wl,--as-needed -Wl,-hashvals -Wl,-zdynsort"

Add to that nxsty's Qt and hidden visibility for KDE and I have got probably the fastest system I have ever used. Now, I am hearing that Bdirect is going, --as-needed is not working, hashvals and zdynsort is changing and my head is spinning.

Can some one please help and tell me how to keep up with the sudden changes that has been made in the building of the system? If someone wants to suggest to go for everything stable, then I request you to please keep that suggestion to yourself. I need this speed and I am addicted to it so please help me in incorporating everything.

n0rbi666 · Post by **n0rbi666** » Sat Jul 01, 2006 5:54 pm

Martin.Jansa wrote:
b33fc0d3 wrote:nxsty, is this related to the patch ?
same error here

same here ....
emerge --info

Code: Select all

Portage 2.1.1_pre1-r5 (default-linux/x86/2006.0, gcc-4.1.1/vanilla, glibc-2.4.90.20060516-r0, 2.6.17-no2 i686)
=================================================================
System uname: 2.6.17-no2 i686 AMD Athlon(tm)
Gentoo Base System version 1.12.1
dev-lang/python:     2.4.3-r1
dev-python/pycrypto: 2.0.1-r5
dev-util/ccache:     [Not Present]
dev-util/confcache:  [Not Present]
sys-apps/sandbox:    1.2.18.1
sys-devel/autoconf:  2.13, 2.60
sys-devel/automake:  1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2
sys-devel/binutils:  2.16.93, 2.17
sys-devel/gcc-config: 2.0.0_rc1
sys-devel/libtool:   1.5.22
virtual/os-headers:  2.6.16
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-O2 -march=athlon-xp -fomit-frame-pointer -pipe -ftracer -fweb -frename-registers"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/kde/3.5/env /usr/kde/3.5/share/config /usr/kde/3.5/shutdown /usr/share/X11/xkb /usr/share/config"
CONFIG_PROTECT_MASK="/etc/env.d /etc/eselect/compiler /etc/gconf /etc/revdep-rebuild /etc/splash /etc/terminfo"
CXXFLAGS="-O2 -march=athlon-xp -fomit-frame-pointer -pipe -ftracer -fweb -frename-registers -fvisibility-inlines-hidden"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoconfig distlocks metadata-transfer parallel-fetch sandbox sfperms strict"
GENTOO_MIRRORS="http://distfiles.gentoo.org http://distro.ibiblio.org/pub/linux/distributions/gentoo"
LANG="pl_PL"
LC_ALL="pl_PL"
LDFLAGS="-Wl,-O1 -Wl,--sort-common -Wl,-Bdirect -Wl,-hashvals -Wl,-zdynsort"
LINGUAS="pl"
MAKEOPTS="-j2 -s"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude='/distfiles' --exclude='/local' --exclude='/packages'"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="x86 3dnow 3dnowext X aac alsa apm avi berkdb bitmap-fonts cairo cli crypt cups dbus dri eds emboss encode flac foomaticdb fortran gdbm gif gpm gtk gtk2 hal imlib ipv6 isdnlog jack java jpeg kde kdeenablefinal kdehiddenvisibility kdenewldflags lame libg++ libwww lirc mad mikmod mmx mmxext motif mp3 mpeg musepack ncurses nls nptl nptlonly ogg opengl oss pam pcre pdflib perl pic png pppd python qt qt3 qt4 quicktime readline reflection sdl session spell spl sse ssl tcpd truetype truetype-fonts type1-fonts udev userlocales vorbis xine xinerama xml xorg xv zlib elibc_glibc input_devices_keyboard input_devices_mouse input_devices_evdev kernel_linux linguas_pl lirc_devices_devinput userland_GNU video_cards_fglrx video_cards_ati video_cards_radeon"
Unset:  CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, PORTAGE_RSYNC_EXTRA_OPTS

nxsty · Post by **nxsty** » Sat Jul 01, 2006 6:45 pm

I added a patch to revert the commit the broke the build. It should work now.

nxsty · Post by **nxsty** » Sat Jul 01, 2006 6:49 pm

abhay wrote:gawd...
I don't know how to handle this now. I have compiled my current world with nxsty's glibc-2.4.3-r3 and binutils-2.16.93 with
Code: Select all
LDFLAGS="-Wl,-O1 -Wl,--sort-common -Wl,--enable-new-dtags -Wl,-Bdirect -Wl,--as-needed -Wl,-hashvals -Wl,-zdynsort"
Add to that nxsty's Qt and hidden visibility for KDE and I have got probably the fastest system I have ever used. Now, I am hearing that Bdirect is going, --as-needed is not working, hashvals and zdynsort is changing and my head is spinning.

Can some one please help and tell me how to keep up with the sudden changes that has been made in the building of the system? If someone wants to suggest to go for everything stable, then I request you to please keep that suggestion to yourself. I need this speed and I am addicted to it so please help me in incorporating everything.

Well, that's life on the bleeding edge.

--as-need and -Bdirect shouldn't interfere. But --as-needed was broken in some binutils 2.16.9X releases so you should upgrade to 2.17.

-hashvals and -zdynsort has been obsoleted by a new patch. I'll add it to my glibc overlay tomorrow. It also needs a patched binutils and prelink. See the other thread for that.

b33fc0d3 · Post by **b33fc0d3** » Sat Jul 01, 2006 6:59 pm

nxsty wrote: See the other thread for that.

Can you link me to that thread please ?

Non_E · Post by **Non_E** » Sat Jul 01, 2006 7:02 pm

b33fc0d3 wrote:
nxsty wrote: See the other thread for that.
Can you link me to that thread please ?

http://forums.gentoo.org/viewtopic-t-47 ... art-0.html

freigeist · Post by **freigeist** » Sat Jul 01, 2006 7:03 pm

I think nxsty is talking about this thread: http://forums.gentoo.org/viewtopic-t-475538.html

damn...Non_E was faster

b33fc0d3 · Post by **b33fc0d3** » Sun Jul 02, 2006 12:29 am

nxsty wrote:I added a patch to revert the commit the broke the build. It should work now.

Builds fine now.

I'm a bit lost, I have read the other thread but don't understand quite understand. The other thread (http://forums.gentoo.org/viewtopic-t-475538.html) adds "-Wl,--hash-style=" but removed -Bdirect. so can the binutils from the other overlay be used without the same overlay's glibc?

nxsty, do you plan on adding --hash-style and removing --hashvals and --zdynsort ?

abhay · Post by **abhay** » Sun Jul 02, 2006 5:49 am

nxsty wrote:Well, that's life on the bleeding edge.

Thats true but till now it has been relatively simple to manage stuff even at this level

Can you please tell me what changes I should do in my LDFLAGS while using it with your glibc and binutils overlay? I am not going to use any other stuff but from this thread until recommended otherwise. Here are a few of my questions: -

1) Will you support -Bdirect in your binutils overlay or do we have to move to the patched prelink? Last time I used prelink and -Bdirect together, the libraries developed undefined symbols and the whole system was screwed. Should I now remove -Bdirect from my LDFLAGS and re-compile everything?
2) Will --as-needed work with the new version of binutils? I had to apply a custom patch with 2.16.93 to get it working properly. Is it fixed now?
3) Will you continue to update binutils overlay or is it time to move to stuff from the other thread you are talking about?
4) What kind of performance hit or gain do you think will be there by moving away from -Bdirect to prelink?

Thanks for the earlier reply. I will be really thankful if you help me get out of this confusion.

roderick · Post by **roderick** » Sun Jul 02, 2006 6:05 am

I'm lost now too...

It seemed pretty simple before: update binutils and glibc, use bdirect, hashvals and dynsort.

Can someone please sum up what the new recommended is and what EXACTLY is needed to switch over?

freigeist · Post by **freigeist** » Sun Jul 02, 2006 6:45 am

Here is what I have understand so far:

There is a better algorithm that could replace -hashvals -zdynsort: --hash-style, if you want to test ist, drop hashvals and zdynsort and use -Wl,--hash-style=both in your LDFlags
There is currently no BDirect patch for hash-style patched binutils, the developers of --hast-style seem to not support BDirect, therefore you have to drop BDirect in your LDFlags
Because of the dropped BDirect you should use the patched prelink

Non_E · Post by **Non_E** » Sun Jul 02, 2006 7:54 am

roderick wrote:I'm lost now too...

It seemed pretty simple before: update binutils and glibc, use bdirect, hashvals and dynsort.

Can someone please sum up what the new recommended is and what EXACTLY is needed to switch over?

In fact you need not switch at the moment. These patches are imho in quite an early stage of development. Gergan Penkov stated yesterday that it is possible to adapt these patches to support Bdirect. Consider any potential speedup from these patches and slowdown caused by two days of recompiling the whole system. You may even need to recompile again if someone comes with Bdirect etc.

roderick · Post by **roderick** » Sun Jul 02, 2006 5:25 pm

Non_E wrote:
roderick wrote:I'm lost now too...

It seemed pretty simple before: update binutils and glibc, use bdirect, hashvals and dynsort.

Can someone please sum up what the new recommended is and what EXACTLY is needed to switch over?
In fact you need not switch at the moment. These patches are imho in quite an early stage of development. Gergan Penkov stated yesterday that it is possible to adapt these patches to support Bdirect. Consider any potential speedup from these patches and slowdown caused by two days of recompiling the whole system. You may even need to recompile again if someone comes with Bdirect etc.

Yeah. I'd rather wait. I have b een extremely happy with the bdirect, hashvals, and dynsort currently in place.

freigeist · Post by **freigeist** » Sun Jul 02, 2006 6:53 pm

glibc 2.4.90.20060701 breaks db for me...

enderandrew · Post by **enderandrew** » Tue Jul 04, 2006 1:53 am

nxsty wrote:I added a patch to revert the commit the broke the build. It should work now.

I'm now using my own modified version of this build. However, mine breaks in the same place as quoted above. Might I ask what change or revert you had to make to fix this?

weedy · Post by **weedy** » Tue Jul 04, 2006 4:56 am

very nice

nxsty · Post by **nxsty** » Tue Jul 04, 2006 9:38 am

enderandrew wrote:
nxsty wrote:I added a patch to revert the commit the broke the build. It should work now.
I'm now using my own modified version of this build. However, mine breaks in the same place as quoted above. Might I ask what change or revert you had to make to fix this?

This one:
http://sources.redhat.com/cgi-bin/cvswe ... =glibc&f=h

I'm away on vacation for about two weeks now so I wont be able to respond to thris thread or update my overlay. If you want to try the new hashstyle patches use nesl247's overlay instead which is based on mine.

nesl247 · Post by **nesl247** » Tue Jul 04, 2006 2:55 pm

I'll be posting an overlay link soon, hopefully nxsty will use it. It will include the --hash-style patches, but only when the hashstyle USE flag is enabled. This way only one ebuild needs to be maintained.

b33fc0d3 · Post by **b33fc0d3** » Tue Jul 04, 2006 3:42 pm

nesl247 wrote:I'll be posting an overlay link soon, hopefully nxsty will use it. It will include the --hash-style patches, but only when the hashstyle USE flag is enabled. This way only one ebuild needs to be maintained.

And which patches by default ?

And what about --hash-style + -bdirect ? Is that possible ?

Tweaked glibc 2.4 + 2.5 + snapshot ebuilds

Thread