2.6 Kernel (and headers) + NPTL Guide

Message

OneOfMany · Post by **OneOfMany** » Sun Mar 07, 2004 8:07 pm

From SkiCat

I get an error back when I try to emerge glibc.

* You have "nptl" in your USE, but your kernel version or
* architecture does not support it!

Using kernel 2.6.3-r1 and linux-headers 2.6.3.

I'm seeing the same thing (with 2.6.1 headers and 2.6.3-r2 kernel). Any ideas why? I'm trying to fix a Seg violation on boot by recompiling glibc...

Could it be because I'm booting with the 2004.0 CD (which has a 2.4 kernel) to do the compile?

stonent · Post by **stonent** » Mon Mar 08, 2004 3:54 am

That error is appearing because you are running it on a system that does not have a 2.6.x kernel. Remember when you bootstrap it compiles things using whatever headers that you emerged, so if you compile stuff using a 2.6 set of headers with nptl but have chrooted from a 2.4.x boot, the apps are going to crash after they are compiled.

Also I tried using the old 2.6 live CD and things segfault in the middle of merging. The only thing so far seems to work is to boot from a system that already has a working 2.6 kernel and chroot the target and compile.

I wish the 2004.0 livecd had 2.6 kernels instead of 2.4.x

Also compiling without nptl using 2.6 headers seems to work ok when chrooting from a 2.4.x system. In that case, do the bootstrap-2.6.sh and get your system booting (i.e. bootstrap-2.6 emerge system, emerge your 2.6.x kernel, set up grub and reboot from the drive) then re-emerge glibc with nptl enabled or even better, emerge -D -e world to recompile everything. (May not really matter if glibc has been recompiled but I'm doing it just the same)

Sipi · Post by **Sipi** » Mon Mar 08, 2004 12:44 pm

Hi!

I've got a strange error after emerging glibc-2.3.3_pre20040207 with nptl enabled.
I've done this on two machine. On first one, everything works well. On second one (my home PC) everything went into ruin. Emerge went well, glibc installed. Everything works.
But after rebooting, devfsd didn't start, it complained about something devfs-se.so, which is part of selinux-small package, which doesn't exists now in portage, so I've removed it. But error is the same: it complains that libc.so.6 has undefined symbol, it is something GLIBC_2_xxxx, I don't remember exactly...

I had to manually copy back libc.so.6 (libc-2.3.3) from old install without nptl). I found that when it was in non-working state, in /lib there was libpthread-0.10.so AND libpthread-0.60.so. I had to delete the 0.60 one to fully repair the system. I thought that it is some stupid remaining file, but now I see that on the working nptl system there is ONLY 0.60, with softlink libpthread.so.0 pointing to it. No 0.10...

So, what is going on here? I was unable to install glibc with nptl (kernel is 2.6). I tried with kernel-headers 2.4 and now installed 2.6. No success.

Is there some stalled files in /lib which confuses the system?!?

Sipi

Kow · Post by **Kow** » Tue Mar 09, 2004 5:20 am

Everything is running fine here using the "official" kernel sources from kernel.org (2.6.4-rc2-bk1), glibc 2.3.3_pre20040207.ebuild compiled on a 2.6.3 kernel running with no errors, in fact I have less errors than what I used to have.

Also if you have Linux 2.4 headers installed the ebuild might have a problem understanding that it has to use 2.6 headers in your /usr/src directory and not the 2.4 headers...
If you are using NPTL I recommend using the 2.6 kernel header ebuilds and not keeping 2.4 and having glibc compile against the kernel headers straight from kernel.org as they have a few things here and there that cause things to break, specifically the sysctl.h patch, however there is a safeguard against this in the ebuilds but not everything else.

irf2003 · Post by **irf2003** » Tue Mar 09, 2004 11:05 am

stonent wrote:I wish the 2004.0 livecd had 2.6 kernels instead of 2.4.x

actually the 2004.0 livecd does have a 2.6x kernel
when booting, specify either
2.6 kernel with framebuffer

Code: Select all

smp

2.6 kernel no framebuffer

Code: Select all

smp-nofb

HTH

itkovian · Post by **itkovian** » Thu Mar 11, 2004 8:04 am

Hello,

If anybody has problems with KDE when glibc is compiled with nptl, then you should (it worked for me, your mileage may vary) simply re-emerge QT.

The complete story:

I compiled 2.6.3-rc3 from gentoo-dev-sources with the linuxthreads glibc, then rebooted. Then I emerged glibc with nptl use flag set. Then I emerged gcc, and re-emerged glibc with the nptl use flag set. It turned out KDE segfaulted at a futex call, other apps (self-compiled, SPECcpu, java, Firefox, ...) were doing just fine. Then I re-emerged QT, and lo' for now, all is working once more. I did use the latest glibc (2.3.3-pre-blub).

Hope this can help some people out.

Sharpy · Post by **Sharpy** » Sat Mar 13, 2004 8:42 am

NPTL seems especially useful when you're running programs which access lots of small files, for example pan and if you've ever tried to play Vegastrike you will see the difference. I've had no trouble with NPTL, except with xmms, refused to run for some reason.
Nvidia's drivers work just fine with NPTL.
I would recommend enabling NPTL.

rieger · Post by **rieger** » Wed Mar 17, 2004 4:09 pm

emerged glibc with nptl fine, systems seems to be running fine (mplayer, mozilla, everything works, except for WSAD...)

I even got the NPTL message when doing /lib/libc.so.6 works.

Then got interested and tried some other libX.so in the /lib dir
I did some random ones (libuuid.so, libnsl.so, libncurses.so)

everything returns a "segmentation fault"!

But my system is working fine (as it seems, xmms fails f.e.)

What to do with this, are only a very few lib's needed, or should I do a emerge system?

info: kernel 2.6.3

sirro · Post by **sirro** » Wed Mar 17, 2004 4:58 pm

rieger wrote:Then got interested and tried some other libX.so in the /lib dir
I did some random ones (libuuid.so, libnsl.so, libncurses.so)
everything returns a "segmentation fault"!

Are you shure, that they should return something else? The libs in a stage1-chroot returned the same for me. (my own libs too of course)

rieger wrote:What to do with this, are only a very few lib's needed, or should I do a emerge system?

If this is not expected behavior, than emerge system does not fix this, cause I actually have reemerged system...

rieger · Post by **rieger** » Wed Mar 17, 2004 6:39 pm

So from what I understand, the lib's return segfault's for your system too.

I can live with that, if it's normal behaviour.

Strange that

libc.so.6 returns

Code: Select all

GNU C Library stable release version 2.3.3, by Roland McGrath et al.
Copyright (C) 2004 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Compiled by GNU CC version 3.3.2 20031218 (Gentoo Linux 3.3.2-r5, propolice-3.3-7).
Compiled on a Linux 2.6.3 system on 2004-03-17.
Available extensions:
        GNU libio by Per Bothner
        crypt add-on version 2.1 by Michael Glad and others
        NPTL 0.60 by Ulrich Drepper
        BIND-8.2.3-T5B
        NIS(YP)/NIS+ NSS modules 0.19 by Thorsten Kukuk
Thread-local storage support included.
Report bugs using the `glibcbug' script to <bugs@gnu.org>.

and for as far as I know other .so or .so.[number] files return the segfaults....

Hey, this one /lib/libc-2.3.3.so, works too!

strange 'expected' behaviour, if you ask me

sirro · Post by **sirro** » Wed Mar 17, 2004 6:50 pm

What I mean is: Are these files really expeded to run stand-alone?

ok the libc*.o seems to be an exception (for information-purpose), but should these files really return something when called from the shell?

Meaulnes · Post by **Meaulnes** » Wed Mar 17, 2004 9:04 pm

I get an error back when I try to emerge glibc.

* You have "nptl" in your USE, but your kernel version or
* architecture does not support it!

I am also getting this. I did a stage one install using nptl and ~x86 where necessary. The bootstrap-2.6.sh seemd to work and when I do emerge -p linux-headers it tells me that i currently have linux-headers-2.6.4 installed and uname shows 2.6.4 for the kernel version. Even with the above error, I let the glibc recompile go through and /lib/libc.so.6 still didn't show NPTL. I did this this past weeknd on another machine and it worked nicely (not a single problem.) This time everything that everyone has talked about in this thread has happened. I am stumped ....

Here is an excerpt from my make.conf:

Code: Select all

USE="nptl"
ACCEPT_KEYWORDS="~x86"

Is there a POSIX option somewhere in the kernel that I missed?

Any help will be appreciated.

laffel · Post by **laffel** » Fri Mar 19, 2004 9:26 am

@Meaulnes

Same error here with linux-headers 2.6.x until I changed the CHOST variable to i686-pc-linux-gnu in /etc/make.conf and re-emerged glibc again.

Code: Select all

Available extensions:
        GNU libio by Per Bothner
        crypt add-on version 2.1 by Michael Glad and others
        NPTL 0.60 by Ulrich Drepper
        BIND-8.2.3-T5B
        NIS(YP)/NIS+ NSS modules 0.19 by Thorsten Kukuk
Thread-local storage support included.

Gentree · Post by **Gentree** » Fri Mar 19, 2004 9:39 pm

sebweb wrote:I have this :
# /lib/libc-2.3.2.so
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!
glibc compiled with ntpl use flag.
What does it mean ?

Yeah, can anyone tell us what this is all about ? I get a similiar thing when I tried /lib/libc.so.6 to check if I had NTPL.

I am doing a lot of system updating and kerenl mods and I want to know I'm not building on shakey foundations.

What's it all about?

Proton · Post by **Proton** » Fri Mar 19, 2004 10:49 pm

Gentree wrote:
sebweb wrote:I have this :
# /lib/libc-2.3.2.so
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!
glibc compiled with ntpl use flag.
What does it mean ?

Yeah, can anyone tell us what this is all about ? I get a similiar thing when I tried /lib/libc.so.6 to check if I had NTPL.

I am doing a lot of system updating and kerenl mods and I want to know I'm not building on shakey foundations.

What's it all about?

Same thing here, I've tried some glibc rebuilds and it always spits out that error...

Meaulnes · Post by **Meaulnes** » Fri Mar 19, 2004 11:03 pm

Well I finally did get it. I ended up starting the stage 1 again from the beginning. The weird thing is that nothing went wrong the second time. IPutils built fine, and everything sailed right through. I am pretty sure that I did everything exactly the some (but I was working on about 6 things during the first try, so it is hard to say). That 2 successful bulds out of three attempts ....

phitoo · Post by **phitoo** » Fri Mar 19, 2004 11:47 pm

Picked that up on Google from a Linux From Scratch mailing list:

<quote>
if you try running /tools/lib/libc.so.6, you'll see it won't work due to
some assertions failing. http://ttervo.vectorstar.net/nptl contains a patch,
which fixes this problem. This is merely a cosmetic issue, and is optional.
<\quote>

I'll wait for 2.3.3 to go stable. Hopefully it's been fixed in that branch.

Proton wrote:
Gentree wrote:
sebweb wrote:I have this :
# /lib/libc-2.3.2.so
Inconsistency detected by ld.so: rtld.c: 1252: dl_main: Assertion `_rtld_local._dl_rtld_map.l_prev->l_next == _rtld_local._dl_rtld_map.l_next' failed!
glibc compiled with ntpl use flag.
What does it mean ?

Yeah, can anyone tell us what this is all about ? I get a similiar thing when I tried /lib/libc.so.6 to check if I had NTPL.

I am doing a lot of system updating and kerenl mods and I want to know I'm not building on shakey foundations.

What's it all about?
Same thing here, I've tried some glibc rebuilds and it always spits out that error...

Bowyakka · Post by **Bowyakka** » Sat Mar 20, 2004 3:56 am

rieger wrote:
I even got the NPTL message when doing /lib/libc.so.6 works.

Then got interested and tried some other libX.so in the /lib dir
I did some random ones (libuuid.so, libnsl.so, libncurses.so)

everything returns a "segmentation fault"!

i get this too for most libs

i think this one is funny though

Code: Select all

/lib/libSegFault.so
Segmentation fault

yngwin · Post by **yngwin** » Sat Mar 20, 2004 11:57 am

Another success story here. I did a normal stage3 install, compiled the latest gentoo-dev-sources, reboot, add nptl useflag, emerge glibc, emerge gcc (to get the latest version), then emerge -e system. Worked fine! After that I did KDE, KOffice, OpenOffice-Ximian, Gimp2, wine - all compiled and work fine.

Gentree · Post by **Gentree** » Sat Mar 20, 2004 8:37 pm

Hi yngwin,

glad to hear you had a nice clean run. Sounds like a couple of problems I had in recently moving to 2.6 kernel have been sorted out in the ebuilds.

I'd be very interested to know if you have DMA on you drives. My system was fine under 2.4.2 but since I moved up to 2.6 both my disks come up without DMA

Could you check hdparm /dev/hda (or whatever) to see if you have dma active.

I have seen a few posts with the same pb, it seems we all have VIA based mobos. What's yours?

Thanks

Selecter · Post by **Selecter** » Mon Mar 22, 2004 5:07 pm

http://linuxdevices.com/articles/AT6753699732.html
It is written in this article that all apps should be compiled after compiled glibc with nptl

Gentree · Post by **Gentree** » Mon Mar 22, 2004 6:34 pm

Thanks for the link, that is a useful article.

In fact the DMA pb I was having was a due to a missgin kernel option . I detailed the solution in another thread.

I have rebuild most major packages but due to some annoying and difficult to resolve pbs with propolice I have been unable to do a full emerge system.

This may explain a few oddities where I am getting seg faults.

Thanks again for the link.

gungholady · Post by **gungholady** » Wed Mar 24, 2004 1:26 pm

I am also getting this. I did a stage one install using nptl and ~x86 where necessary. The bootstrap-2.6.sh seemd to work and when I do emerge -p linux-headers it tells me that i currently have linux-headers-2.6.4 installed and uname shows 2.6.4 for the kernel version. Even with the above error, I let the glibc recompile go through and /lib/libc.so.6 still didn't show NPTL. I did this this past weeknd on another machine and it worked nicely (not a single problem.) This time everything that everyone has talked about in this thread has happened. I am stumped ....

I tried the linux-headers-2.6.4 last night the recompile of glibc-2.3.3_pre20040207 did not complete. There were two errors. I checked http://bugs.gentoo.org and could find nothing there about this combination. I'll have to try it again to tell you just what the errors were. What do you have in your make.conf that could be different than mine that allowed glibc to finish compiling with these headers?

Here is the relevant portions of mine:

USE="X gtk gtk2 gnome alsa kde cups samba arts nptl qt doc tetex"
CHOST="i686-pc-linux-gnu"
CFLAGS="-march=pentium3 -O2 -funroll-loops -pipe"
ACCEPT_KEYWORDS="~x86"

gungholady · Post by **gungholady** » Wed Mar 24, 2004 3:54 pm

I couldn't recreate the errors I was getting last night when I re-emerged glibc after changing my linux-headers to 2.6.4. The only thing I know of that was different this morning compared to last night was an update for file. I got that update. Re-emerged linux-headers-2.6.4 and then did emerge glibc. Glibc compiled without a problem.

irf2003 · Post by **irf2003** » Sat Mar 27, 2004 7:37 pm

hey you guys have prompted me to jump into th nptl bandwagon.
i am building an image in a chrooted environment for mass deployment,
started with stage1 from the 2004.0 live cd, bootstraped
with ~x86, linux-headers-2.6.3-r1, and nptl.
everything went flowlessly so far, the only hick-ups
i had where not 2.6.x headers or npl related.
so far, kde, and mozilla have emerged, OOo1.1.1-rc1
currently emerging. I cannot wait to test ride the image
when it's all done.
from what i could descern, for a smoother ride, one has to
go ~arch ab initio.
will let you guys know how it goes.
better go out and have some fun while OOo compiles.
good luck to everyone, and many thanks for all the hints
provided in this thread.
happy gentooing