booting dmraid-volume (universalcd2006.0, ICH7) [SOLVED]

[xaarr]

I have problems installing gentoo-amd64 on a SATA-Raid-system.


the kernel can not find the root partition on boot.



System:
- Asus P5LD2 Deluxe Board
- 2 * SATA 250GB in Raid-1 (mirror) at intel ICH7
- booted gentoo universal-cd amd64 2006.0 with prompt: "gentoo dodmraid"

The Raid partitions:

1 ext3 /boot 100MB
2 fat32 win-boot 100MB
3 swap /swap 2048mb
4 ext
5 ntfs XPmain 20GB
6 ntfs XPtest 10GB
7 ext3 /(root) 20GB
8 fat32 daten *

after booting the universal-cd with "gentoo dodmraid" the partitions are ok:

/dev/sda
/dev/sda1
/dev/sda2
....
/dev/sdb
/dev/sdb1
/dev/sdb2
...
/dev/mapper/
control
isw_cgiffxxxxxx_Volume0
isw_cgiffxxxxxx_Volume01
isw_cgiffxxxxxx_Volume02
isw_cgiffxxxxxx_Volume03
isw_cgiffxxxxxx_Volume05
isw_cgiffxxxxxx_Volume06
isw_cgiffxxxxxx_Volume07
isw_cgiffxxxxxx_Volume08


i have installed gentoo described in the amd_64 handbook and additional tuturials about dmraid.

-install stage3 from cd, install portage from cd, copy distfiles from cd and so on
-"emerge dmraid"
-"emerge device-mapper"
-"emerge udev"
-"emerge coldplug"
-"emerge gentoo-sources"
-"emerge genkernel"
-make kernel with "genkernel --dmraid --menuconfig all"
added or changed from modul to static:
- SCSI device support
- legacy /proc/scsi/ support
- SCSI disk support
- SCSI generic support
- SCSI low-level driver
- Serial ATA support
- intel ICH6 support
- raid support
- Raid-1 support
- Device Mapper support
- ATA/ATAPI/MFM/RLL support
- intel ich6 chipset support
-create initrd with german HowTo: http://de.gentoo-wiki.com/Installieren_von_Gentoo_mit_NVRAID_unter_Nutzung_von_dmraid
-install grub like the HowTo

Grub boot's fine, the kernel is booting, but can not find the real_root partition /dev/mapper/isw_xxxxxxxx_Volume07.

The dmraid says on booting: no block devices found.

If i entered "shell" i can only find the "control" file in the /dev/mapper/ dir.
The /dev/sda and sdb nodes are not present, like booting the universal cd.


Info: After 2 days of testing and reading HowTo's i have made a "emerge --sync" and a "emerge gentoo-sources" and get a new kernel "r7" with the same problems.



my grub.conf:

timeout 30
default 0
fallback 1

# For booting GNU/Linux
title=Gentoo Linux (2.6.15-gentoo-r7)
root (hd0,0)
kernel /kernel-genkernel-x86_64-2.6.15-gentoo-r7 root=/dev/ram0 init=/linuxrc real_root=/dev/mapper/isw_cgiffcadej_Volume07 dodmraid vga=791 splash=silent
initrd /initramfs-genkernel-x86_64-2.6.15-gentoo-r7

title Gentoo
root (hd0,0)
kernel /kernel-genkernel-x86_64-2.6.15-gentoo-r5 root=/dev/ram0 init=/linuxrc real_root=/dev/mapper/isw_cgiffcadej_Volume07 dodmraid vga=791 splash=silent
initrd (hd0,0)/initrd


title Windows
rootnoverify (hd0,1)
makeactive
chainloader +1



my Kernel-Config File: http://www.xaarr.net/kernel-config


Any ideas whats going wrong ?

PS: sorry for my bad englisch.

best regards,
daniel.

[NeddySeagoon]

xaarr,

Genkernel has probably left out the low level SATA drivers for your dmraid chip, or not put dmraid into the initrd.
You will do better 'hand rolling' a kernel for any slightly out of the ordinary.
Include as [*] not [M] anthing needed to boot, then no initrd is required.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.

[xaarr]

hello,

thanks for your tip.

i have generated the kernel by hand without initrd.

my screen switches to black, after selecting the kernel in grub.

here are the steps i have made:

- boot universal-cd 2006.0 with "gentoo dodmraid"
dmesg-greped-info:
(command line is root=/dev/ram0 init=/linuxrc dokeymap looptype=squashfs loop=/image.squashfs cdroot initrd=gentoo.igz vga=791 splash=silent,theme:livecd-2006.0 CONSOLE=/dev/tty1 quiet BOOT_IMAGE=gentoo dodmraid)
Kernel command line: root=/dev/ram0 init=/linuxrc dokeymap looptype=squashfs loop=/image.squashfs cdroot initrd=gentoo.igz vga=791 splash=silent,theme:livecd-2006.0 CONSOLE=/dev/tty1 quiet BOOT_IMAGE=gentoo dodmraid

check-for-running sata-driver for conected on:
livecd ~ # ls /dev/sd*
/dev/sda /dev/sda2 /dev/sda4 /dev/sda6 /dev/sda8 /dev/sdb1 /dev/sdb3 /dev/sdb5 /dev/sdb7
/dev/sda1 /dev/sda3 /dev/sda5 /dev/sda7 /dev/sdb /dev/sdb2 /dev/sdb4 /dev/sdb6 /dev/sdb8

check-for-raid-is-working:
livecd ~ # ls /dev/mapper/
control isw_cgiffcadej_Volume01 isw_cgiffcadej_Volume03 isw_cgiffcadej_Volume06 isw_cgiffcadej_Volume08
isw_cgiffcadej_Volume0 isw_cgiffcadej_Volume02 isw_cgiffcadej_Volume05 isw_cgiffcadej_Volume07



- config inet (eth1 on my machine) (only needed for install over ssh!)
test-inet-connection:
livecd ~ # ping bushsucks.com
64 bytes from bushsucks.com (198.76.195.86): icmp_seq=1 ttl=116 time=161 ms

- create filesystem on partitions
livecd ~ # mkfs.ext3 /dev/mapper/isw_cgiffcadej_Volume01
livecd ~ # mkfs.ext3 /dev/mapper/isw_cgiffcadej_Volume07
livecd ~ # mkswap /dev/mapper/isw_cgiffcadej_Volume03 && swapon /dev/mapper/isw_cgiffcadej_Volume03

- create the new root-fs
livecd ~ # mount /dev/mapper/isw_cgiffcadej_Volume07 /mnt/gentoo/
livecd ~ # mkdir /mnt/gentoo/boot
livecd ~ # mount /dev/mapper/isw_cgiffcadej_Volume01 /mnt/gentoo/boot/

- decompress stage3
livecd ~ # cd /mnt/gentoo/
livecd gentoo # tar xvjpf /mnt/cdrom/stages/stage3-amd64-2006.0.tar.bz2

- decompress portage
livecd gentoo # tar xvjf /mnt/cdrom/snapshots/portage-20060123.tar.bz2 -C /mnt/gentoo/usr/

- copy source code archives
livecd gentoo # mkdir /mnt/gentoo/usr/portage/distfiles
livecd gentoo # cp /mnt/cdrom/distfiles/* /mnt/gentoo/usr/portage/distfiles/

- edit /mnt/gentoo/etc/make.conf
CFLAGS="-march=nocona -O2 -pipe"
CHOST="x86_64-pc-linux-gnu"
CXXFLAGS="${CFLAGS}"
MAKEOPTS="-j2"

- chroot
livecd ~ # mount -t proc none /mnt/gentoo/proc/
livecd ~ # mount -o bind /dev/ /mnt/gentoo/dev/
livecd ~ # cp /etc/resolv.conf /mnt/gentoo/etc/
livecd ~ # chroot /mnt/gentoo/ /bin/bash
livecd / # env-update
livecd / # source /etc/profile
livecd / # PS1="(chroot) $PS1"

- creating portage cache
(chroot) livecd / # emerge --metadata

- set timezone
(chroot) livecd / # cp /usr/share/zoneinfo/MET /etc/localtime

- installing the kernel
(chroot) livecd / # USE="-doc symlink" emerge gentoo-sources
(chroot) livecd / # ls -la /usr/src/
total 12
drwxr-xr-x 3 root root 4096 Apr 3 21:44 .
drwxr-xr-x 13 root root 4096 Apr 3 20:07 ..
-rw-r--r-- 1 root root 0 Feb 9 00:13 .keep
lrwxrwxrwx 1 root root 22 Apr 3 21:44 linux -> linux-2.6.15-gentoo-r5
drwxr-xr-x 19 root root 4096 Apr 3 21:44 linux-2.6.15-gentoo-r5

- installing needed? tools
(chroot) livecd linux # echo "sys-fs/dmraid ~x86" >> /etc/portage/package.keywords
(chroot) livecd linux # emerge ccache && emerge dmraid && emerge coldplug && emerge hotplug && emerge udev && emerge device-mapper && echo "return: $?"
(chroot) livecd linux # rc-update add coldplug boot

- sysinfo:
livecd ~ # lspci
00:00.0 Host bridge: Intel Corporation 945G/GZ/P/PL Express Memory Controller Hub (rev 81)
00:01.0 PCI bridge: Intel Corporation 945G/GZ/P/PL Express PCI Express Root Port (rev 81)
00:1b.0 Audio device: Intel Corporation 82801G (ICH7 Family) High Definition Audio Controller (rev 01)
00:1c.0 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port 1 (rev 01)
00:1c.4 PCI bridge: Intel Corporation 82801GR/GH/GHM (ICH7 Family) PCI Express Port 5 (rev 01)
00:1c.5 PCI bridge: Intel Corporation 82801GR/GH/GHM (ICH7 Family) PCI Express Port 6 (rev 01)
00:1d.0 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI #1 (rev 01)
00:1d.1 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI #2 (rev 01)
00:1d.2 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI #3 (rev 01)
00:1d.3 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI #4 (rev 01)
00:1d.7 USB Controller: Intel Corporation 82801G (ICH7 Family) USB2 EHCI Controller (rev 01)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev e1)
00:1f.0 ISA bridge: Intel Corporation 82801GB/GR (ICH7 Family) LPC Interface Bridge (rev 01)
00:1f.1 IDE interface: Intel Corporation 82801G (ICH7 Family) IDE Controller (rev 01)
00:1f.2 RAID bus controller: Intel Corporation 82801GR/GH (ICH7 Family) Serial ATA Storage Controller RAID (rev 01)
00:1f.3 SMBus: Intel Corporation 82801G (ICH7 Family) SMBus Controller (rev 01)
01:03.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22/A IEEE-1394a-2000 Controller (PHY/Link)
01:04.0 Mass storage controller: Integrated Technology Express, Inc. ITE 8211F Single Channel UDMA 133 (ASUS 8211 (ITE IT8212 ATA RAID Controller)) (rev 11)
02:00.0 RAID bus controller: Silicon Image, Inc. SiI 3132 Serial ATA Raid II Controller (rev 01)
03:00.0 Ethernet controller: Marvell Technology Group Ltd. 88E8053 PCI-E Gigabit Ethernet Controller (rev 15)
05:00.0 VGA compatible controller: nVidia Corporation NV43 [GeForce 6600 GT] (rev a2)
livecd ~ # lsmod
Module Size Used by
ipv6 215936 14
yealink 10368 0
parport_pc 30952 0
parport 27148 1 parport_pc
floppy 57512 0
pcspkr 2184 0
sky2 32384 0
aiptek 16128 0
sk98lin 132704 0
eth1394 16784 0
dm_mirror 15744 2
dm_mod 38864 5 dm_mirror
pdc_adma 7940 0
sata_mv 15108 0
ata_piix 8580 0
ahci 10884 2
sata_qstor 8196 0
sata_vsc 6916 0
sata_uli 6276 0
sata_sis 6788 0
sata_sx4 11652 0
sata_nv 7684 0
sata_via 7428 0
sata_svw 6660 0
sata_sil24 9476 0
sata_sil 8196 0
sata_promise 9732 0
libata 39696 15 pdc_adma,sata_mv,ata_piix,ahci,sata_qstor,sata_vsc,sata_uli,sata_sis,sata_sx4,sata_nv,sata_via,sata_svw,sata_sil24,sata_sil,sata_promise
sbp2 20100 0
ohci1394 27596 0
ieee1394 64120 3 eth1394,sbp2,ohci1394
sl811_hcd 11008 0
ohci_hcd 16772 0
uhci_hcd 27168 0
usb_storage 56512 0
usbhid 30624 0
ehci_hcd 25608 0
usbcore 92328 9 yealink,aiptek,sl811_hcd,ohci_hcd,uhci_hcd,usb_storage,usbhid,ehci_hcd

- configure the kernel
(chroot) livecd / # cd /usr/src/linux
(chroot) livecd linux # make menuconfig

Processor type and features
Processor family (Intel EM64T) --->
< > /dev/cpu/microcode - Intel CPU microcode support
<*> /dev/cpu/*/msr - Model-specific register support
<*> /dev/cpu/*/cpuid - CPU information support
[*] MTRR (Memory Type Range Register) support
[*] Symmetric multi-processing support
[*] SMT (Hyperthreading) scheduler support
Preemption Model (No Forced Preemption (Server)) --->
[*] Preempt The Big Kernel Lock
[*] Non Uniform Memory Access (NUMA) Support
[ ] Old style AMD Opteron NUMA detection
[*] ACPI NUMA detection
[ ] NUMA emulation
Memory model (Discontiguous Memory) --->
(32) Maximum number of CPUs (2-256)
[*] Support for hot-pluggable CPUs (EXPERIMENTAL)
[*] PM timer
[*] Provide RTC interrupt
[*] IOMMU support
--- Machine check support
[*] Intel MCE features
[ ] AMD MCE features
[ ] kexec system call (EXPERIMENTAL)
[*] Enable seccomp to safely compute untrusted bytecode
Timer frequency (250 HZ) --->

Bus options (PCI etc.)
--- PCI support
[*] Support mmconfig PCI config space access
[*] Unordered IO mapping access
[*] PCI Express support
[*] Message Signaled Interrupts (MSI and MSI-X)
[ ] Legacy /proc/pci interface
[ ] PCI Debugging
PCCARD (PCMCIA/CardBus) support --->
PCI Hotplug Support --->

Device Drivers
? Plug and Play support --> [ ]
Block devices
<*> Normal floppy disk support
< > Compaq SMART2 support
< > Compaq Smart Array 5xxx support
< > Mylex DAC960/DAC1100 PCI RAID Controller support
< > Micro Memory MM5415 Battery Backed RAM support (EXPERIMENTAL)
<*> Loopback device support
< > Cryptoloop Support
< > Network block device support
< > Promise SATA SX8 support
< > Low Performance USB Block driver
<*> RAM disk support
(16) Default number of RAM disks
(4096) Default RAM disk size (kbytes)
[*] Initial RAM disk (initrd) support
< > Packet writing on CD/DVD media
< > ATA over Ethernet support
ATA/ATAPI/MFM/RLL support (!only selected items listet here!)
<*> ATA/ATAPI/MFM/RLL support
<*> Enhanced IDE/MFM/RLL disk/cdrom/tape/floppy support
--- Please see Documentation/ide.txt for help/info on IDE drives
<*> Include IDE/ATA-2 DISK support
[*] Use multi-mode by default
<*> Include IDE/ATAPI CDROM support
--- IDE chipset support/bugfixes
<*> generic/default IDE chipset support
[*] PCI IDE chipset support
[*] Generic PCI bus-master DMA support
[ ] Force enable legacy 2.0.X HOSTS to use DMA
[*] Use PCI DMA by default when available
<*> Intel PIIXn chipsets support

SCSI device support
<*> RAID Transport Class
--- SCSI device support
[ ] legacy /proc/scsi/ support
--- SCSI support type (disk, tape, CD-ROM)
<*> SCSI disk support
< > SCSI tape support
< > SCSI OnStream SC-x0 tape support
< > SCSI CDROM support
<*> SCSI generic support
< > SCSI media changer support
--- Some SCSI devices (e.g. CD jukebox) support multiple LUNs
[ ] Probe all LUNs on each SCSI device
[ ] Verbose SCSI error reporting (kernel size +=12K)
[ ] SCSI logging facility
SCSI Transport Attributes --->
SCSI low-level drivers --->
<*> Serial ATA (SATA) support ¦ ¦
<*> Intel PIIX/ICH SATA support
Multi-device support (RAID and LVM)
[*] Multiple devices driver support (RAID and LVM)
<*> RAID support
<*> RAID-1 (mirroring) mode
<*> Device mapper support


(chroot) livecd linux # make && make modules_install
(chroot) livecd linux # cp arch/x86_64/boot/bzImage /boot/kernel-x86_64-2.6.15-gentoo-r5

- edit fstab
/dev/mapper/isw_cgiffcadej_Volume01 /boot ext3 noauto,noatime 1 2
/dev/mapper/isw_cgiffcadej_Volume07 / ext3 noatime 0 1
/dev/mapper/isw_cgiffcadej_Volume03 none swap sw 0 0
/dev/cdroms/cdrom0 /mnt/cdrom iso9660 noauto,ro 0 0
/dev/fd0 /mnt/floppy auto noauto 0 0
proc /proc proc defaults 0 0
shm /dev/shm tmpfs nodev,nosuid,noexec 0 0

- make some configs
(chroot) livecd linux # nano /etc/conf.d/hostname
(chroot) livecd linux # nano /etc/conf.d/domainname
(chroot) livecd linux # nano /etc/conf.d/net
(chroot) livecd linux # ln -s /etc/init.d/net.eth0 /etc/init.d/net.eth1
(chroot) livecd linux # rc-update add net.eth1 default
(chroot) livecd linux # nano /etc/hosts
(chroot) livecd linux # passwd root
(chroot) livecd linux # nano /etc/conf.d/keymaps
(chroot) livecd linux # nano /etc/conf.d/clock

- install needed deamons
(chroot) livecd linux # emerge syslog-ng && rc-update add syslog-ng default
(chroot) livecd linux # emerge vixie-cron && rc-update add vixie-cron default
(chroot) livecd linux # emerge slocate

- install grub
(chroot) livecd linux # emerge grub
my /boot/grub/grub.conf:
timeout 30
default 0
fallback 1

# For booting GNU/Linux Gentoo
title Gentoo
root (hd0,0)
kernel /kernel-x86_64-2.6.15-gentoo-r5 root=/dev/mapper/isw_cgiffcadej_Volume07 dodmraid vga=791 splash=silent

title Windows
rootnoverify (hd0,1)
makeactive
chainloader +1

install grub in mbr:
(chroot) livecd linux # grub --device-map=/dev/null
grub> device (hd0,0) /dev/mapper/isw_cgiffcadej_Volume01
device (hd0,0) /dev/mapper/isw_cgiffcadej_Volume01
grub> device (hd0) /dev/mapper/isw_cgiffcadej_Volume0
device (hd0) /dev/mapper/isw_cgiffcadej_Volume0
grub> root (hd0,0)
root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
setup (hd0)
Checking if "/boot/grub/stage1" exists... yes
Checking if "/boot/grub/stage2" exists... yes
Checking if "/boot/grub/e2fs_stage1_5" exists... yes
Running "embed /boot/grub/e2fs_stage1_5 (hd0)"... 16 sectors are embedded.
succeeded
Running "install /boot/grub/stage1 (hd0) (hd0)1+16 p (hd0,0)/boot/grub/stage2 /boot/grub/menu.lst"... succeeded
Done.
grub> quit

- exit, unmount, reboot, bet to the guy in the sky

-on boot, select Gentoo in Grub
-screen switches to black with a small green line in the top
-if i press a key, the Floppy-led goes on


ok, something goes wrong. ;(

i try tomorrow to add a initrd with the mdraid-scripts, or any other ideas ?

best regards,
daniel.

[heipei]

hi there,

i have exactly the same problem. i followed the guide for installing grub with a bios raid (dmraid) and even used the strange genkernel as described in the guide. yet when booting my fresh kernel it cant find the device under /dev/mapper for some reason.
_________________
hackvalue.de/heipei

[xaarr]

hi,

i have not solved the problem - because i have not the time.

some trys: kernel not booting or root partition not found

i can't install ubuntu-6.06-berta-2, too.


i must run win with linux in vmware. ;(

if you find a right way to install gentoo, lets know...

PS: All i need is a stable distribution with XGL-Desktop.

best regards,
Daniel.

[heipei]

[xaarr]

Hi,

has you used genkernel ?

you has additional the udev param in the kernel entry - i not.

has you hotplug/coldplug in the kernel ?

ok - i test it again in the evening....

thanx for the hope....

Daniel.

[heipei]

yep, i have used genkernel as described in this guide: http://gentoo-wiki.com/HOWTO_Install_Gentoo_with_NVRAID_using_dmraid which was really helpfull. genkernel also generates the initramfs
_________________
hackvalue.de/heipei

[NeddySeagoon]

xaarr,

You have a few odd entries in your kernel - do you really have a NUMA system with 32 CPUs ?
If so, why are you using (BIOS also called) fake raid ?

There are a number of issues with your grub.conf too.
First, you must have an initrd file to boot from dmraid devices, since dmraid is not provided in the kernel. Device Mapper there is for something quite different.

The nVidia guide that heipei pointed you at will be very close to waht you need. You have need the Intel SATA raid driver in place of teh nVidia one.
_________________
Regards,

NeddySeagoon

Computer users fall into two groups:-
those that do backups
those that have never had a hard drive fail.

[xaarr]

Hello,

my new test-install is failed:

my /boot/ dir:
[grub]
initramfs-genkernel-x86_64-2.6.15-gentoo-r5dast
kernel-genkernel-x86_64-2.6.15-gentoo-r5dast
System.map-genkernel-x86_64-2.6.15-gentoo-r5dast


/boot/grub/grub.conf:

title Gentoo first kernel 2.6.15
root (hd0,0)
kernel (hd0,0)/kernel-genkernel-x86_64-2.6.15-gentoo-r5dast root=/dev/ram0 init=/linuxrc real_root=/dev/mapper/isw_cgiffcadej_Volume07 dodmraid vga=791 splash=verbose ramdisk=8192 udev
initrd (hd0,0)/initramfs-genkernel-x86_64-2.6.15-gentoo-r5dast


No "/linuxrc" found, i used "genkernel --dmraid --udev --menuconfig all" !
is linuxrc executed after mount the root-fs or before ?

on first reboot: No Root-FS found on boot.

if i use "shell": the /dev/mapper/ has only the control-file, no /dev/sd* or /dev/hd* drives.

i think the intel-sata driver is not loaded ?

what can be wrong ?

my kernel-config: http://www.xaarr.net/gen-config.txt

has you the same hardware ? can i have your kernel-config ? [my mail: gentoo-forum@the-domain-one-row-above.net]

PS: i have "emerge grub" after compiling the kernel, can this be wrong ?
PPS: 2 houres break, then i compile the kernel again and check kernel-config again...

thanks,
Daniel.

[NeddySeagoon]

xaarr,

Hmm. Heres a few words on your kernel.

[cyrillic]

I think ICH6 and ICH7 SATA controllers want to use the ahci module instead of the ata_piix module.

This could be why the harddrives are not detected.

[xaarr]

hello,

thanx NeddySeagoon and cyrillic !

i have made the changes and it works

My NET-card is not aviabled and /boot are not mounted after booting, but for this i search in the forum.

thanx and an nice day,
Daniel.