2.6 Kernel (and headers) + NPTL Guide

Message

øxygen · Post by **øxygen** » Sun Mar 28, 2004 3:58 pm

I think you should reemerge your whole system after upgrading glibc and gcc to ~x86 and nptl. Else you probably get some assertions fails while starting normal programms e.g. xmms.

irf2003 · Post by **irf2003** » Sun Mar 28, 2004 6:45 pm

øxygen wrote:I think you should reemerge your whole system after upgrading glibc and gcc to ~x86 and nptl. Else you probably get some assertions fails while starting normal programms e.g. xmms.

there is no system to re-emerge, i am bootstrapping from
a stage1 tarbar, going ~arch, 2.6.x linux headers, and nptl.
the image built successfully, and it has been deployed on one of
the boxes for testing before mass deployment.
/lib/libc.so.6 yields:

Code: Select all

bash-2.05b# /lib/libc.so.6
GNU C Library stable release version 2.3.3, by Roland McGrath et al.
Copyright (C) 2004 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Compiled by GNU CC version 3.3.3 20040217 (Gentoo Linux 3.3.3, propolice-3.3-7).
Compiled on a Linux 2.6.3 system on 2004-03-26.
Available extensions:
        GNU libio by Per Bothner
        crypt add-on version 2.1 by Michael Glad and others
        NPTL 0.60 by Ulrich Drepper
        BIND-8.2.3-T5B
        NIS(YP)/NIS+ NSS modules 0.19 by Thorsten Kukuk
Thread-local storage support included.
Report bugs using the `glibcbug' script to <bugs@gnu.org>.

i will be using the nptl box this whole week to see how things go.
again many thanks to everyone who contributed to this thread
without which a move to nptl would never have been contemplated.

øxygen · Post by **øxygen** » Sun Mar 28, 2004 8:43 pm

sorry, my post shouldn't refer to yours, was just an general statement

cca93014 · Post by **cca93014** » Tue Mar 30, 2004 6:20 am

I cant seem to get the NPTL stuff to compile.

root@gentoo /usr/portage # ACCEPT_KEYWORDS="~x86" emerge glibc
Calculating dependencies ...done!
>>> emerge (1 of 1) sys-libs/glibc-2.2.5-r9 to /
>>> md5 src_uri

glibc-2.2.5.tar.bz2
>>> md5 src_uri

glibc-linuxthreads-2.2.5.tar.bz2
>>> Unpacking source...
>>> Unpacking glibc-2.2.5.tar.bz2 to /var/tmp/portage/glibc-2.2.5-r9/work

I have

USE="-gtk libgd nptl gd jpeg png gif xml tiff gd-external ssl apache2 -apache postgres -gnome -kde 3dnow mmx innodb -X -alsa"

in my make.conf, and

sys-kernel/linux-headers -*

in my /etc/portage/package.keywords. I'm running a 2.6.1 kernel:

root@gentoo /etc/portage # uname -a
Linux gentoo 2.6.1 #5 Wed Feb 4 12:33:51 GMT 2004 i686 Pentium III (Coppermine) GenuineIntel GNU/Linux

Any ideas?

Talornin · Post by **Talornin** » Tue Mar 30, 2004 11:44 pm

I recompiled glibc with nptl use flags. Everything seemed to work fine, xmms and other apps with several threads where using only one. I did get this error as many otheres do:
# /lib/libc-2.3.2.so
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!

But found from the article posted previously in this thread that "getconf GNU_LIBPTHREAD_VERSION" will return what threading libs you are using. So it seems that the inconsistency error is just cosmetical.

My problems started when I tried to run mplayer. Segfault (I did get a seg fault when closing xmms too, even after recompiling, but it didnt affect anything so I didnt bother to investigate more). No matter what version or with which cflags/user flags I used I gor the same error.

mplayer was the only app I couldnt get working, but recompiling of xorg xserver and XFree86 4.3 and 4.4 also failed (but the xorg xserver I had installed worked). After some time I decided to recompile glibc with -nptl and go back. I need mplayer and since the xservers did not want to recompile something is obviously not working right.

I usualy like new and bleeding edge things, but im gonna leave nptl for a while

Info: kernel 2.6.4 (bootsplash patched), glibc: 2.3.2-r9, GCC: 3.3.2-r5, Headers: 2.4.21

If anyone have any ideas on how I could solve/work around my problems id apprechiate any help and be happy to try again

bombcar · Post by **bombcar** » Wed Mar 31, 2004 4:13 am

I was getting that segfault in xmms too, so I went to xmms-1.2.9-r2.ebuild

(1.2.10 died for me, dunno why).

This was without nptl, mind you. I'll report back after this recompile of everything.

Kow · Post by **Kow** » Wed Mar 31, 2004 5:47 am

At the end of the ./configure progress you should see "Configuring in NPTL", it goes by fast when emerging so scroll the scrollbar up a little and look around where it makes the makefiles. At first I thought it wasnt either when it was downloading linux-threads, but it doesnt even touch the package after the downloading and extracting part.

cca93014 · Post by **cca93014** » Wed Mar 31, 2004 6:17 am

Hmmm. Still cant get it working. What version of the headers do I need? Do I need to be careful about where the /usr/src/symlink is pointing?

Any further ideas?

jonaswidarsson · Post by **jonaswidarsson** » Wed Mar 31, 2004 3:35 pm

umm...
I've got an interesting one:

Code: Select all

bash-2.05b# /lib/libc.so.6
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!
bash-2.05b# ldconfig
bash-2.05b# /lib/libc.so.6
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!
bash-2.05b#

And I have NOT tried to do anything with nptl yet.

Hmm...
I am in this thread because of this:
http://forums.gentoo.org/viewtopic.php?p=999779

I am wondering if just reemerging glibc will do for me...

irf2003 · Post by **irf2003** » Wed Mar 31, 2004 3:59 pm

cca93014 wrote:Hmmm. Still cant get it working. What version of the headers do I need? Do I need to be careful about where the /usr/src/symlink is pointing?

Any further ideas?

it is not clear where you are starting from.
for a smooth ride, boot from a 2004.0 cd, specify smp, so that you will boot with a 2.6 kernel, start from a stage1 tarbar, umask the 2.6
headers, modify your /etc/make.conf i.e. CHOST, C(XX)FLAGS,
ACCEPT_KEYWORDS="~x86" USE="nptl" and other use flags etc...
then do

Code: Select all

/usr/portage/scripts/bootstrap-2.6.sh
emerge system

as well as the usual stuff to complete the install of gentoo.
it is not a good idea to have "=sys-kernel/linux-headers -*" in
your /etc/portage/package.keywords, it is wiser to be more specific,
if you are sure that the masked linux headers
are known to work and not break many packages later on
then by all means add it to your /etc/portage/package.keywords
file. FYI I have the followings in package.keywords:
=sys-kernel/linux-headers-2.6.3-r1 -*
the reason, I find the 2.6.4 kernels broken, and I have
hard masked them.
hth
PS should you have any further problems, please peruse the forum,
if this should not resolve it, be specific and am sure that many
a gentooer on this or other threads will be eager to assits.
good luck, and happy gentooing

cca93014 · Post by **cca93014** » Thu Apr 01, 2004 12:27 am

Hi There,

Apologies; I should have stated that this is not a new machine build, but an upgrade of glibc. Is this doable? I am running kernel 2.6.1 at the moment...

Ben

BNoise · Post by **BNoise** » Thu Apr 01, 2004 12:38 am

wouldnt be better to do(i did it like this):

Code: Select all

/etc/portage/package.keywords
sys-libs/zlib ~x86
sys-kernel/linux-headers -*
sys-devel/gcc ~x86
x11-base/xfree ~x86
sys-libs/glibc ~x86
sys-devel/binutils ~x86
sys-devel/automake ~x86
app-emulation/wine ~x86

/etc/portage/package.mask
=sys-kernel/linux-headers-2.6.4

or is it the same?

bombcar · Post by **bombcar** » Thu Apr 01, 2004 5:50 am

NOTE!

The Assertion failed error you get when trying to execute:

Code: Select all

/lib/libc.so.6
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!

is a harmless bug in the latest unmasked version in portage!

It shouldn't hurt anything, but if you upgrade to the masked version of glibc it goes away.

irf2003 · Post by **irf2003** » Thu Apr 01, 2004 6:32 pm

cca93014 wrote:Hi There,

Apologies; I should have stated that this is not a new machine build, but an upgrade of glibc. Is this doable? I am running kernel 2.6.1 at the moment...

Ben

if it is doable, i am afraid i don't know how this may be done,
to re-iterate it is wiser to startt from scratch, you will have less
problems this way. in any case, you will have to re-emerge
your whole system, so you might as well start with bootstrapping.
you may want to backup whatever config files you hand crafted
for later use, this will save you from tinkering with them again.
should you have any other issues i would just like you to know
that we all are more than eager to help
hth
and the very best of luck.

sapphirecat · Post by **sapphirecat** » Thu Apr 01, 2004 7:44 pm

I did a stage 1 install from a working system with 2.6. (Changed root FS type, moved its partition, general cleanup, etc.) Problems I ran into:

valgrind appears broken with 2.6 headers, even ~x86.
strace works only with ~x86.
gtk-engines dependencies are stuffed up: http://bugs.gentoo.org/show_bug.cgi?id=24439

And for anyone wondering, NPTL cannot be built against 2.4 headers. The glibc ebuild cheats and pokes around in /usr/src/linux to find the 2.6 headers when building with NPTL. (This information courtesy rac in #gentoo.)

BNoise · Post by **BNoise** » Thu Apr 01, 2004 11:57 pm

cca93014 wrote:Hi There,

Apologies; I should have stated that this is not a new machine build, but an upgrade of glibc. Is this doable? I am running kernel 2.6.1 at the moment...

Ben

Yes its doable, i am running from an old instalation.

jonaswidarsson · Post by **jonaswidarsson** » Fri Apr 02, 2004 9:23 am

So, the glibc is used by other things. I just don't know to which extent or how it is used. I assume everything in the system depends on it, and that most things use it dynamically.

If so, it should be sufficient to rebuild glibc, and the rest of the system should gain performance from glibc's new behaviour.

Yet, it must be at least one case where the glibc cannot be dynamically used, in the kernel, because it is loaded before the root file system is mounted.

So that makes me believe I really have to rebuild the kernel to let everything gain performance.

Still there is two more possibilities:

If programs depend on glibc in a static way, they have to be rebuilt as soon as I rebuild the glibc with nptl support.

If the compilers output depend on the nptl features of glibc, every program using threads in the system has to be rebuilt to take advantage of the new threading characteristics.

Please, enlighten me.

I am trying to enable nptl from a fully installed system, and I won't reinstall.
I have recompiled glibc, and it seems working:

Code: Select all

bash-2.05b# getconf GNU_LIBPTHREAD_VERSION
NPTL 0.60
bash-2.05b#

I am about to rebuild the kernel again.

After that I hope there is not much more need to rebuild anything, for this matter.
EDIT:
BTW, I have not enabled ~arch anywhere yet.

Remenic · Post by **Remenic** » Fri Apr 02, 2004 9:50 am

It's not working really well for me... xmms crashes and so does mplayer. Will an 'emerge -e system' fix this?

Talornin · Post by **Talornin** » Fri Apr 02, 2004 5:00 pm

Wohoo!

Decided to try a fresh install and used bootstrap-2.6.sh and 2.6.4 headers. This time everything works like a charm! NPTL is enabeled and everything compiles and works great!

Not even segfault with xmms!

Maybe its better and safer to just do a fresh install than remerge glibc.

øxygen · Post by **øxygen** » Fri Apr 02, 2004 5:24 pm

Talornin wrote: Maybe its better and safer to just do a fresh install than remerge glibc.

i already recommended to recompile the whole world, that does also work

Talornin · Post by **Talornin** » Sat Apr 03, 2004 2:09 am

øxygen wrote:
Talornin wrote: Maybe its better and safer to just do a fresh install than remerge glibc.
i already recommended to recompile the whole world, that does also work

Well, I couldnt do that. Several packaged, Pango, Libglade, Mplayer to mention some, failed, If I where to emerge -e world Id have to sit and stare at the whole process to find which packaged that failed.

But whatever! Everything is working smooth for me now

irf2003 · Post by **irf2003** » Sat Apr 03, 2004 2:51 pm

øxygen wrote:
Talornin wrote: Maybe its better and safer to just do a fresh install than remerge glibc.
i already recommended to recompile the whole world, that does also work 8)

if i am not mistaken, emerge -e world will not do it.
you will end up with a semi-broken system, and it will be
suttle and hard to detect, you may later on get all sort of weird problem. it is analgous to changing the CHOST, and doing
say emerge -e world. the safest and easiest way to go about
it is with a clean stage1 bootstrap install
i stand to be corrected of course
hth

øxygen · Post by **øxygen** » Sat Apr 03, 2004 3:09 pm

I've done emerge -e system and after emerge -e world. Everything runs fine now.

Remenic · Post by **Remenic** » Sun Apr 04, 2004 10:41 am

If xmms, mplayer, glxgears or ANY opengl-supporting app segfaults, try re-emerging nvidia-glx. That fixed it for me. emerge -e is NOT needed.

Ultrix · Post by **Ultrix** » Sun Apr 04, 2004 9:18 pm

NPTL is now working for me. I did a fresh install, 2004.0 CD, the SMP kernel, and under the recomendation of this thread, I unmasked linux-headers-2.6.3-r1 and not 2.6.4. The only thing that I did not do was build my system with ARCH="~x86", everything was build as x86. I do get the cosmetic issue with libc.so.6, but "getconf GNU_LIBPTHREAD_VERSION" works fine. Mplayer and xmms both work fine, and I am having no problems otherwise.

I'm Running:
linux-headers-2.6.3-r1
gcc-3.3.2-r5
glibc-2.3.2-r9
gentoo-dev-sources 2.6.3-r2

2.6 Kernel (and headers) + NPTL Guide

Not working well for me