Failing to boot custom configured kernel

[zen_desu]

Okay I can see the mistake: You took the current output of "efibootmgr" of your distkernel and made with this data the entry for your kernel ... BUT ... there is a difference:

Code: Select all

root=UUID="963bf51

root=UUID=963bf

You must do a efibootmgr -c ...... -u "root=UUID=.....ro initrd=\EFI\..... ....... . ....... "
and NOT a
efibootmgr -c ...... -u "root=UUID="....." ro initrd=\EFI\..... ....... . ....... "

Oh god, that's probably it. Let me rebuild the kernel and EFI file and try again.

for what it's worth, ugrd will build in root info from the system which built it, that info is used if the passed root= is unusable. (so root= is optional unless using that initramfs for a system other than the one it was built on)

[pietinger]

Oh god, that's probably it. [...]

It is. Believe me. After root= never comes a "

In this example I use root=/dev/sda3 and the same is true:
https://wiki.gentoo.org/wiki/User:Pieti ... Using_UEFI

[pietinger]

After inspecting all other kernel command line parameter I would like to ask, if you really want to deactivate hyperthreading (-> nosmt) ?
Edit: Sorry, Alderlake is not affected by mds, so you can delete it completely (mds=full,nosmt)

Some other are not necessary if your kernel is already hardened like these: slab_nomerge iommu=force iommu.passthrough=0 iommu.strict=1 ...

And here: "lsm=landlock,yama,integrity,apparmor,bpf" I miss "lockdown"



I have all my parms in my kernel:

Code: Select all

CONFIG_CMDLINE="root=PARTUUID=6979eed7-ffaf-425e-8ac7-2832f6d15e0a ro loglevel=8 lsm.debug ima_appraise=off quiet hardened_usercopy=1 page_alloc.shuffle=1 pti=on"

and YES, I must use root=PARTUUID=... because I dont use an initramfs and then this is true:
https://wiki.gentoo.org/wiki/User:Pieti ... %3DUUID%3D

[alecStewart1]

After inspecting all other kernel command line parameter I would like to ask, if you really want to deactivate hyperthreading (-> nosmt) ?
Edit: Sorry, Alderlake is not affected by mds, so you can delete it completely (mds=full,nosmt)

Some other are not necessary if your kernel is already hardened like these: slab_nomerge iommu=force iommu.passthrough=0 iommu.strict=1 ...

And here: "lsm=landlock,yama,integrity,apparmor,bpf" I miss "lockdown"



I have all my parms in my kernel:

Code: Select all

CONFIG_CMDLINE="root=PARTUUID=6979eed7-ffaf-425e-8ac7-2832f6d15e0a ro loglevel=8 lsm.debug ima_appraise=off quiet hardened_usercopy=1 page_alloc.shuffle=1 pti=on"

and YES, I must use root=PARTUUID=... because I dont use an initramfs and then this is true:
https://wiki.gentoo.org/wiki/User:Pieti ... %3DUUID%3D

Good to know.

Unfortunately, I get the same exact error. I'm wondering if there is some module I'm missing, as gentoo-kernel-bin works fine.

EDIT: Here's what I have in /etc/default/uefi-mkconfig now with the changes you suggested, pietinger

Code: Select all

ENTRY_LABEL_LIMIT=false
KERNEL_CONFIG="%entry_id %linux_name Linux %kernel_version ; root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15"

[alecStewart1]

Here's

sudo dmesg | grep 'nvm'

Code: Select all

[    2.908602] nvme nvme0: pci function 0000:04:00.0
[    2.919959] nvme nvme0: D3 entry latency set to 10 seconds
[    2.924237] nvme nvme0: 16/0/0 default/read/poll queues
[    2.927106]  nvme0n1: p1 p2 p3
[   12.003566]  drm_display_helper intel_cstate iTCO_wdt snd intel_pmc_bxt mei_hdcp mei_pxp iTCO_vendor_support mtd spd5118 cec xpad igc mei_me soundcore intel_pmc_core drm_buddy ff_memless joydev intel_uncore rfkill mei i2c_i801 spi_intel_pci pmt_telemetry pmt_class i2c_smbus spi_intel intel_vsec mxm_wmi pcspkr dm_multipath wmi_bmof serial_multi_instantiate acpi_pad acpi_tad zfs(PO) spl(O) overlay squashfs nls_utf8 hfsplus hid_logitech_hidpp uas hid_logitech_dj usb_storage crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ghash_clmulni_intel sha512_ssse3 sha256_ssse3 nvme sha1_ssse3 nvme_core nvme_auth video wmi pinctrl_alderlake loop
[   12.005874] Loading firmware: iwlwifi-so-a0-gf-a0.pnvm
[   26.250502] nvme nvme0: using unchecked data buffer
[  410.863520] BTRFS: device fsid 963bf518-69b3-41af-8366-617ba5aa3ef5 devid 1 transid 1028307 /dev/nvme0n1p3 (259:3) scanned by mount (5122)
[  410.864084] BTRFS info (device nvme0n1p3): first mount of filesystem 963bf518-69b3-41af-8366-617ba5aa3ef5
[  410.864132] BTRFS info (device nvme0n1p3): using crc32c (crc32c-intel) checksum algorithm
[  410.864150] BTRFS info (device nvme0n1p3): using free-space-tree

Maybe this indicates some module I'm missing?[/b]

[alecStewart1]

Not adding

Code: Select all

root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5

Doesn't fix the error either.

There's something that gentoo-kernel-bin has that I'm missing, there has to be.

[alecStewart1]

Here's the diff for my current .config for the gentoo 6.14.2 and the one that comes with gentoo-kernel-dist:

diff -Naru /usr/src/linux-6.14.2-gentoo/.config /efi/EFI/Gentoo/config-6.14.2-gentoo-dist

http://dpaste.com/2X8S28VB8

[pietinger]

Unfortunately, I get the same exact error. I'm wondering if there is some module I'm missing, as gentoo-kernel-bin works fine. [...]

IF it is the same exact error THEN there is a problem with the UEFI entry (and not the kernel or its modules).

What does "efibootmgr -u" says now?

How have you made the new entry (with a tool or manually yourself)?

What happens if you do this command and then try to boot into "Test":

Code: Select all

efibootmgr -c -d /dev/nvme0n1 -p 1 -L "Test" -l "\EFI\boot\bootx64.efi" -u "root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img"

[alecStewart1]

Unfortunately, I get the same exact error. I'm wondering if there is some module I'm missing, as gentoo-kernel-bin works fine. [...]

IF it is the same exact error THEN there is a problem with the UEFI entry (and not the kernel or its modules).

What does "efibootmgr -u" says now?

The *-dist entry is from gentoo-kernel-dist, the other is the one I'm failing to boot into.

Code: Select all

BootCurrent: 01FE
Timeout: 0 seconds
BootOrder: 0002,01FF,01FE,0200
Boot0002* Boot x64      HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\boot\bootx64.efi root=UUID="963bf518-69b3-41af-8366-617ba5aa3ef5" ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img
Boot01FE* UMC 1 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo-dist.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo-dist.img
Boot01FF* UMC 2 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo.img
Boot0200* UEFI:  Patriot Memory PMAP, Partition 2       PciRoot(0x0)/Pci(0x14,0x0)/USB(10,0)/HD(2,GPT,3c14bf9d-d220-4e30-9902-40b3f5d1d6eb,0x23c,0x1680)

How have you made the new entry (with a tool or manually yourself)?
[/code]

With a tool. installkernel will call uefi-mkconfig.

equery u installkernel

Code: Select all

[ Legend : U - final flag setting for installation]
[        : I - package is installed with flag     ]
[ Colors : set, unset                             ]
 * Found these USE flags for sys-kernel/installkernel-57:
 U I
 - - dracut       : Generate an initramfs or UKI on each kernel installation
 + + efistub      : EXPERIMENTAL: Update UEFI configuration on each kernel installation
 - - grub         : Re-generate grub.cfg on each kernel installation, used grub.cfg is overridable with GRUB_CFG env var
 - - refind       : Install a Gentoo icon for rEFInd alongside the (unified) kernel image, used icon is overridable with REFIND_ICON env var
 - - systemd      : Use systemd's kernel-install to install kernels, overridable with SYSTEMD_KERNEL_INSTALL env var
 - - systemd-boot : Use systemd-boot's native layout by default
 + + ugrd         : Generate an initramfs using UGRD on each kernel installation
 - - uki          : Install UKIs to ESP/EFI/Linux for EFI stub booting and/or bootloaders with support for auto-discovering UKIs
 - - ukify        : Build an UKI with systemd's ukify on each kernel installation

eix uefi-mkconfig

Code: Select all

[I] sys-boot/uefi-mkconfig
     Available versions:  (~)2.3 (~)3.3 (~)3.4
     Installed versions:  3.4(12:28:58 PM 12/23/2024)
     Homepage:            https://github.com/Biosias/uefi-mkconfig
     Description:         Automatic management of UEFI entries

cat /etc/default/uefi-mkconfig

Code: Select all

ENTRY_LABEL_LIMIT=false
KERNEL_CONFIG="%entry_id %linux_name Linux %kernel_version ; ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15"

What happens if you do this command and then try to boot into "Test":

Code: Select all

efibootmgr -c -d /dev/nvme0n1 -p 1 -L "Test" -l "\EFI\boot\bootx64.efi" -u "root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img"

Let try and see.

[alecStewart1]

Same error.

If it helps, the error is something like

Code: Select all

failed to find/mount device root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 with /proc/cmdline -t auto -o default,ro

efibootmgr -u

Code: Select all

BootCurrent: 01FE
Timeout: 0 seconds
BootOrder: 01FF,01FE,0000,0200
Boot0000* Bootx64 (Gentoo)      HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\boot\bootx64.efi root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img
Boot01FE* UMC 1 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo-dist.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo-dist.img
Boot01FF* UMC 2 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo.img
Boot0200* UEFI:  Patriot Memory PMAP, Partition 2       PciRoot(0x0)/Pci(0x14,0x0)/USB(10,0)/HD(2,GPT,3c14bf9d-d220-4e30-9902-40b3f5d1d6eb,0x23c,0x1680)

Here's my /etc/fstab, just to show the UUID is correct.

Code: Select all

UUID=80B6-D58B                                          /efi              vfat          defaults,noatime        0 2
UUID=d9140877-8a15-476b-ac49-c02864d69449               none              swap          sw                      0 0
UUID=963bf518-69b3-41af-8366-617ba5aa3ef5               /                 btrfs         compress=zstd:9,clear_cache,nodiscard,noatime                   0 1
tmpfs

It's starting to feel like there's something wrong with the initramfs...but that wouldn't make sense because then the gentoo-kernel-bin wouldn't work.

[alecStewart1]

Is to possible things are booting too fast, and I should make use of rootdelay in my kernel commandline parameters?

[pingtoo]

could you review and may be help to clarify context?

your post

efibootmgr -u

Code: Select all

BootCurrent: 01FE
Timeout: 0 seconds
BootOrder: 01FF,01FE,0000,0200
Boot0000* Bootx64 (Gentoo)      HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\boot\bootx64.efi root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img
Boot01FE* UMC 1 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo-dist.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo-dist.img
Boot01FF* UMC 2 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo.img
Boot0200* UEFI:  Patriot Memory PMAP, Partition 2       PciRoot(0x0)/Pci(0x14,0x0)/USB(10,0)/HD(2,GPT,3c14bf9d-d220-4e30-9902-40b3f5d1d6eb,0x23c,0x1680)

Those two entries with "Gentoo Linux 6.14.2" have no reference to root=963bf518-69b3-41af-8366-617ba5aa3ef5 reference. whereas the entry "Bootx64 (Gentoo)" do have root=963bf518-69b3-41af-8366-617ba5aa3ef5, And you said

Code: Select all

failed to find/mount device root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 with /proc/cmdline -t auto -o default,ro

So which entry you tried and got that error?

And what exactly Same error refer to?

Sometimes when trying too hard will put yourself in to a corner and hard to find way out. May be a review and share some context will help to see where is problem. A context I mean for example content of ESP, commands used and more detail of errors will help paint a better picture.

[alecStewart1]

could you review and may be help to clarify context?

your post

efibootmgr -u

Code: Select all

BootCurrent: 01FE
Timeout: 0 seconds
BootOrder: 01FF,01FE,0000,0200
Boot0000* Bootx64 (Gentoo)      HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\boot\bootx64.efi root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img
Boot01FE* UMC 1 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo-dist.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo-dist.img
Boot01FF* UMC 2 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo.img
Boot0200* UEFI:  Patriot Memory PMAP, Partition 2       PciRoot(0x0)/Pci(0x14,0x0)/USB(10,0)/HD(2,GPT,3c14bf9d-d220-4e30-9902-40b3f5d1d6eb,0x23c,0x1680)

Those two entries with "Gentoo Linux 6.14.2" have no reference to root=963bf518-69b3-41af-8366-617ba5aa3ef5 reference. whereas the entry "Bootx64 (Gentoo)" do have root=963bf518-69b3-41af-8366-617ba5aa3ef5, And you said

Code: Select all

failed to find/mount device root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 with /proc/cmdline -t auto -o default,ro

So which entry you tried and got that error?

And what exactly Same error refer to?

Sometimes when trying too hard will put yourself in to a corner and hard to find way out. May be a review and share some context will help to see where is problem. A context I mean for example content of ESP, commands used and more detail of errors will help paint a better picture.

In that output of efibootmgr -u, the first entry (Bootx64) is the manually created EFI entry using:

Code: Select all

efibootmgr -c -d /dev/nvme0n1 -p 1 -L "Bootx64 (Gentoo)" -l "\EFI\boot\bootx64.efi" -u " root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\boot\initramfs.cpio initrd=\EFI\boot\amd-uc.img initrd=\EFI\boot\intel-uc.img"

The other two were created by installkernel. That refers to the vmlinuz and initramfs that was created when I was manually configuring the kernel, which I explain more below.

The first (Boot01FE* UMC 1 Gentoo Linux 6.14.2, vmlinuz-6.14.2-gentoo-dist.efi) was created by the normal dist-kernel process, which eventually uses ugrd to create the initramfs, and uefi-mkconfig to create the EFI entry. I am currently on this boot entry, and as you can see it does not have root= in it.

The second (Boot01FF* UMC 2 Gentoo Linux 6.14.2,vmlinuz-6.14.2-gentoo.efi) was created from installkernel (which still uses ugrd and uefi-mkconfig whenever I ran make install after building the kernel 6.14.2 from gentoo-sources with the config I've provided earlier, installing the built modules, and then the make install.

I used the following for building the kernel:

Code: Select all

make LLVM=1 LLVM_IAS=1 LTO_CLANG_THIN=1 LD="ld.lld" AR="llvm-ar" NM="llvm-nm" RANLIB="llvm-ranlib" STRIP="llvm-strip" OBJCOPY="llvm-objcopy" OBJDUMP="llvm-objdump" LDFLAGS="-fuse-ld=mold -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,--strip-debug -Wl,--icf=safe -Wl,-z,rewrite-endbr -flto=thin" KLDFLAGS="-fuse-ld=mold -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,--strip-debug -Wl,--icf=safe -Wl,-z,rewrite-endbr -flto=thin" KCFLAGS="-O2 -march=alderlake -pipe -mno-cldemote -mno-kl -mno-sgx -mno-widekl -mshstk -fstack-protector-strong -fomit-frame-pointer -flto=thin -mllvm=-polly -mllvm=-polly-vectorizer=stripmine -mllvm=-polly-omp-backend=LLVM -mllvm=-polly-parallel -mllvm=-polly-num-threads=9 -mllvm=-polly-scheduling=dynamic -fzero-call-used-regs=used" -j12

I ran what I assume is standard for manually building and installing the kernel:

Code: Select all

make LLVM=1 LLVM_IAS=1 LTO_CLANG_THIN=1 LD="ld.lld" AR="llvm-ar" NM="llvm-nm" RANLIB="llvm-ranlib" STRIP="llvm-strip" OBJCOPY="llvm-objcopy" OBJDUMP="llvm-objdump" LDFLAGS="-fuse-ld=mold -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,--strip-debug -Wl,--icf=safe -Wl,-z,rewrite-endbr -flto=thin" KLDFLAGS="-fuse-ld=mold -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,--strip-debug -Wl,--icf=safe -Wl,-z,rewrite-endbr -flto=thin" KCFLAGS="-O2 -march=alderlake -pipe -mno-cldemote -mno-kl -mno-sgx -mno-widekl -mshstk -fstack-protector-strong -fomit-frame-pointer -flto=thin -mllvm=-polly -mllvm=-polly-vectorizer=stripmine -mllvm=-polly-omp-backend=LLVM -mllvm=-polly-parallel -mllvm=-polly-num-threads=9 -mllvm=-polly-scheduling=dynamic -fzero-call-used-regs=used" -j12

make -j12 modules_install

make -j12 install

Here is the custom config I used:

http://dpaste.com/3R4H59MEA

The error I get when trying to boot into this customized kernel (not what was created from gentoo-kernel-bin) is what I mentioned earlier:

Code: Select all

* Failed to find/mount device root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 using /proc/cmdline -t auto -o default,ro 
mount: /target_rootfs: can't find UUID=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5
 * Failed to mount root partition
 * Press enter to break, waiting: 1.0

There's also an error alongside that, but I think it related to this one. I couldn't snap a picture in time, but it's something like:

Code: Select all

deferred probe pending: snd_hda_intel: couldn't bind with audio component

The following is what's in /etc/default/uefi-mkconfig which is what uefi-mkconfig uses when it is called by installkernel to create an EFI entry. This works with gentoo-kernel-bin, but not when I manually customize and build the kernel myself.

Code: Select all

ENTRY_LABEL_LIMIT=false
KERNEL_CONFIG="%entry_id %linux_name Linux %kernel_version ; rootdelay=10 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15"

[pietinger]

So which entry you tried and got that error?

You can see this in the first line of "efibootmgr" ->

Code: Select all

BootCurrent: 01FE
Timeout: 0 seconds
BootOrder: 01FF,01FE,0000,0200

and also in the BootOrder.


alecStewart1,

was there an error when you tried to do my command I have given you?

... because ... there is NO NEW ENTRY in the output of "efibootmgr". At the moment you 4 entries:

Code: Select all

BootOrder: 01FF,01FE,0000,0200

and only the OLD one (0000) is pointing to your \EFI\boot\bootx64.efi
the other two (01FE and 01FF) are pointing to \EFI\Gentoo\vmlinuz-6.14.2-gentoo-dist.efi

So I guess you have bootet again into 0000 Bootx64 (Gentoo)

Maybe ... only maybe ... your UEFI has a problem with two \bootx64.efi ... because this is a very special name ... EVERY UEFI must recognize a \EFI\boot\bootx64.efi even WITHOUT an dedicated UEFI entry (THIS is used for booting from an removable device like USB-stick) ... AND ... it is highly recommended to NOT USE it [*]

Now ... please ... do exactly what I suggest:

1. We delete the entry 0000 with

Code: Select all

efibootmgr -b 0 -B

(check it with "efibootmgr)

2. MOVE your (new) kernel (and its associated initramfs and firmware files) INTO a new directory callled "MY" and rename bootx64.efi to mykernel.efi. For this you must mount your ESP to /efi

Code: Select all

mkdir /efi
mount /dev/nvme0n1p1 /efi
mkdir -p /efi/EFI/MY
mv /efi/EFI/boot/* /efi/EFI/MY/.
mv /efi/EFI/MY/bootx64.efi  /efi/EFI/MY/mykernel.efi
rmdir  /efi/EFI/boot/

3. create a new UEFI entry manually - and check immediately if that was successfull

Code: Select all

efibootmgr -c -d /dev/nvme0n1 -p 1 -L "My" -l "\EFI\MY\mykernel.efi" -u "root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\MY\initramfs.cpio initrd=\EFI\MY\amd-uc.img initrd=\EFI\MY\intel-uc.img"

efibootmgr -u

4. Do you see a NEW UEFI entry? If yes, do a reboot (and save the output before). If no, I would like to see it.

DONT TRY TO USE ANY AUTOMAGIC TOOL (I suspect it does not work correctly)

*) See also: https://wiki.gentoo.org/wiki/User:Pieti ... FI_entries

[alecStewart1]

Now ... please ... do exactly what I suggest:

1. We delete the entry 0000 with

Code: Select all

efibootmgr -b 0 -B

(check it with "efibootmgr)

2. MOVE your (new) kernel (and its associated initramfs and firmware files) INTO a new directory callled "MY" and rename bootx64.efi to mykernel.efi. For this you must mount your ESP to /efi

Code: Select all

mkdir /efi
mount /dev/nvme0n1p1 /efi
mkdir -p /efi/EFI/MY
mv /efi/EFI/boot/* /efi/EFI/MY/.
mv /efi/EFI/MY/bootx64.efi  /efi/EFI/MY/mykernel.efi
rmdir  /efi/EFI/boot/

3. create a new UEFI entry manually - and check immediately if that was successfull

Code: Select all

efibootmgr -c -d /dev/nvme0n1 -p 1 -L "My" -l "\EFI\MY\mykernel.efi" -u "root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\MY\initramfs.cpio initrd=\EFI\MY\amd-uc.img initrd=\EFI\MY\intel-uc.img"

efibootmgr -u

4. Do you see a NEW UEFI entry? If yes, do a reboot (and save the output before). If no, I would like to see it.

DONT TRY TO USE ANY AUTOMAGIC TOOL (I suspect it does not work correctly)

*) See also: https://wiki.gentoo.org/wiki/User:Pieti ... FI_entries

After doing what you suggested:

efibootmgr -u

Code: Select all

BootCurrent: 01FE
Timeout: 0 seconds
BootOrder: 0000,01FF,01FE,0200
Boot0000* My    HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\MY\mykernel.efiroot=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\MY\initramfs.cpio initrd=\EFI\MY\amd-uc.img initrd=\EFI\MY\intel-uc.img
Boot01FE* UMC 1 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo-dist.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo-dist.img
Boot01FF* UMC 2 Gentoo Linux 6.14.2     HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\Gentoo\vmlinuz-6.14.2-gentoo.efi ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off pti=on page_poison=1 page_alloc.shuffle=1 hardened_usercopy=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,lockdown,yama,loadpin,safesetid,selinux,smack,tomoyo,apparmor,ipe,bpf driver=free amdgpu.modeset=1 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\Gentoo\amd-uc.img initrd=\EFI\Gentoo\intel-uc.img initrd=\EFI\Gentoo\initramfs-6.14.2-gentoo.img
Boot0200* UEFI:  Patriot Memory PMAP, Partition 2       PciRoot(0x0)/Pci(0x14,0x0)/USB(10,0)/HD(2,GPT,3c14bf9d-d220-4e30-9902-40b3f5d1d6eb,0x23c,0x1680)

The exact entry is:

Code: Select all

Boot0000* My    HD(1,GPT,d5d977e1-f515-574f-8949-caf8f2c41559,0x800,0x80000)/\EFI\MY\mykernel.efiroot=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5 ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\MY\initramfs.cpio initrd=\EFI\MY\amd-uc.img initrd=\EFI\MY\intel-uc.img 

[pietinger]

Ant the result after booting is exactly the same?

If yes, then the initramfs (\EFI\MY\initramfs.cpio) is defect (but not the kernel). How was it build? With dracut or ugrd?

If ugrd we need @zen_desu (Developer of it), because I am not an expert for it (yes, the easiest method to boot a manually configured kernel is to NOT USE any initramfs; just putting everything the kernel needs to boot statically into it ).

[pietinger]

Oh my god ... I just have seen this ->

Code: Select all

mount: /target_rootfs: can't find UUID=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5

UUID=UUID=... will surely not work. It seems that the init-script of the initramfs makes a mistake when parsing the kernel command line ...

We REALLY need @zen_desu

[pietinger]

I have pinged him at IRC ... but ... until then ... we could try another approach ... He said here:
viewtopic-p-8859314.html#8859314
that the parm root= is optional ... so we could do a 2nd UEFI entry with NO root= parameter. If you want to try it:

Code: Select all

efibootmgr -c -d /dev/nvme0n1 -p 1 -L "My2" -l "\EFI\MY\mykernel.efi" -u "ro quiet init_on_alloc=1 init_on_free=1 spectre_v2=on spec_store_bypass_disable=seccomp randomize_kstack_offset=on random.trust_cpu=off slab_nomerge pti=on page_poison=1 page_alloc.shuffle=1 mds=full,nosmt iommu=force iommu.passthrough=0 iommu.strict=1 mce=0 vsyscall=none rng_core.default_quality=512 apparmor=1 security=apparmor lsm=landlock,yama,integrity,apparmor,bpf driver=free amdgpu.modeset=1 snd-usb-audio.quirk_alias=0db0419c:0b051917 video=DP-1:2560x1440@165 zswap.enabled=1 zswap.compressor=zstd zswap.zpool=zsmalloc zswap.max_pool_percent=15 initrd=\EFI\MY\initramfs.cpio initrd=\EFI\MY\amd-uc.img initrd=\EFI\MY\intel-uc.img"

(In every case every intiramfs must recognoize a root=UUID=... correct)

[zen_desu]

How are you building the initramfs image? Did you edit the config.toml, and are you letting installkernel run it?

The kernel command line parsing has been updated recently, it may be worth trying the 9999, but I'm not sure why the "backup" root options (should be the same as the build system's info) aren't working. It should fail to mount the root using the root= provided by the command line if parsing is broken there, but as long as you're booting the same system which built the image, the backup parameters should get you booted.

[alecStewart1]

How are you building the initramfs image? Did you edit the config.toml, and are you letting installkernel run it?

installkernel does what it does. I never edited the config.toml.

If it helps, here's the output of running ugrd manually:

Code: Select all

INFO     | Processing module: ugrd.base.base
INFO     | Processing module: ugrd.base.core
INFO     | Processing module: ugrd.fs.mounts
INFO     | Adding library path: /usr/lib64
INFO     | Processing module: ugrd.base.cmdline
INFO     | Processing module: ugrd.base.banner
INFO     | Processing module: ugrd.kmod.kmod
INFO     | Processing module: ugrd.kmod.standard_mask
INFO     | Processing module: ugrd.fs.cpio
INFO     | Processing module: ugrd.base.checks
INFO     | Loading config file: /etc/ugrd/config.toml
INFO     | -- | Running ugrd v2.0.0
INFO     | -- | Running build tasks
INFO     | Detected init at: /sbin/init
INFO     | Source path for libgcc_s: /usr/lib/gcc/x86_64-pc-linux-gnu/14/libgcc_s.so.1
INFO     | Using default shell: /bin/sh
WARNING  | Virtual block devices unavailable, disabling device mapper autodetection.
INFO     | [/dev/nvme0n1p3] Auto-enabling kernel modules for device: nvme
INFO     | [/dev/nvme0n1p3] Autodetected mount type from device: btrfs
INFO     | [root] Autodetected mount source: uuid=963bf518-69b3-41af-8366-617ba5aa3ef5
INFO     | [mounts] Updating mount: root
INFO     | Auto-enabling module: btrfs
INFO     | Processing module: ugrd.fs.btrfs
INFO     | Detected kernel version: 6.14.2-gentoo-dist
INFO     | Autodetected kernel modules: nvme, xe, i915, snd_sof_pci_intel_cnl, intel_vsec, snd_sof_pci_intel_tgl, snd_hda_intel, mei_me, iwlwifi, igc, amdgpu, snd_soc_avs
INFO     | Build directory does not exist, skipping cleaning: /tmp/initramfs_build
INFO     | Processing module: ugrd.kmod.novideo
INFO     | Processing module: ugrd.kmod.nosound
INFO     | Processing module: ugrd.kmod.nonetwork
INFO     | Setting shebang to: #!/bin/sh -l
WARNING  | Host path is a directory, skipping symlink creation: /bin
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /sbin
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /usr/sbin
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /lib
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /lib64
WARNING  | Set `merge_usr = false` to disable /usr merge.
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/arch/x86/crypto/sha256-ssse3.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/arch/x86/crypto/sha256-ssse3.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/common/nvme-auth.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/common/nvme-auth.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme-core.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme-core.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/platform/x86/intel/intel-vsec.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/platform/x86/intel/intel-vsec.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei-me.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei-me.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/net/ethernet/intel/igc/igc.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/net/ethernet/intel/igc/igc.ko
INFO     | Regenerating kernel module metadata files.
INFO     | -- | Generating init functions
INFO     | Init kernel modules: nvme, intel_vsec, mei_me, igc
INFO     | Included kernel modules: mei, sha256, nvme_core, nvme_auth
WARNING  | Ignored kernel modules: spi_intel_pci, i2c_i801, amdgpu, i915, snd_hda_intel, iwlwifi, xe, snd_sof_pci_intel_cnl, snd_sof_pci_intel_tgl, snd_soc_avs
WARNING  | No initramfs fstab found, skipping mount_fstab.
INFO     | Wrote file: /tmp/initramfs_build/etc/profile
INFO     | Included functions: check_var, setvar, readvar, wait_enter, prompt_user, retry, klog, edebug, einfo, ewarn, eerror, rd_fail, rd_restart, _find_init, mount_default_root, parse_cmdline_bool, parse_cmdline_str, mount_base, export_exports, parse_cmdline, print_banner, load_modules, mount_root, do_switch_root
INFO     | Wrote file: /tmp/initramfs_build/init
INFO     | -- | Packing build
INFO     | [XZ] Compressing the CPIO data, original size: 13.54 MiB
INFO     | Wrote 4.11 MiB to: /tmp/initramfs_out/ugrd-6.14.2-gentoo-dist.cpio.xz
INFO     | -- | Running checks

Weird thing: ugrd is compressing the CPIO data with XZ, but at one point I set in my kernel config to use ZSTD. This is what it is currently, though, as I thought I should probably enable XZ compression:

rg 'FW_LOADER' /usr/src/linux-6.14.2-gentoo/.config

Code: Select all

1656:CONFIG_FW_LOADER=y
1657:CONFIG_FW_LOADER_PAGED_BUF=y
1659:# CONFIG_FW_LOADER_USER_HELPER is not set
1660:CONFIG_FW_LOADER_COMPRESS=y
1661:CONFIG_FW_LOADER_COMPRESS_XZ=y
1662:CONFIG_FW_LOADER_COMPRESS_ZSTD=y

The kernel command line parsing has been updated recently, it may be worth trying the 9999, but I'm not sure why the "backup" root options (should be the same as the build system's info) aren't working. It should fail to mount the root using the root= provided by the command line if parsing is broken there, but as long as you're booting the same system which built the image, the backup parameters should get you booted.

I've been on 9999. Still fails. I'll try removing root= and see what happens.

EDIT 1:

Why is GCC being referred to when I've built my kernel and modules with Clang/LLVM?

Code: Select all

Source path for libgcc_s: /usr/lib/gcc/x86_64-pc-linux-gnu/14/libgcc_s.so.1 

EDIT 2:

Does this "nosound" module mean the initframs is built without sound support? Or it is harmless? Because I have been having issue with sound lately...

I mean, I assume not since there's novideo as well and I have video...

Code: Select all

 INFO     | Processing module: ugrd.kmod.nosound 

[zen_desu]

How are you building the initramfs image? Did you edit the config.toml, and are you letting installkernel run it?

installkernel does what it does. I never edited the config.toml.

If it helps, here's the output of running ugrd manually:

Code: Select all

INFO     | Processing module: ugrd.base.base
INFO     | Processing module: ugrd.base.core
INFO     | Processing module: ugrd.fs.mounts
INFO     | Adding library path: /usr/lib64
INFO     | Processing module: ugrd.base.cmdline
INFO     | Processing module: ugrd.base.banner
INFO     | Processing module: ugrd.kmod.kmod
INFO     | Processing module: ugrd.kmod.standard_mask
INFO     | Processing module: ugrd.fs.cpio
INFO     | Processing module: ugrd.base.checks
INFO     | Loading config file: /etc/ugrd/config.toml
INFO     | -- | Running ugrd v2.0.0
INFO     | -- | Running build tasks
INFO     | Detected init at: /sbin/init
INFO     | Source path for libgcc_s: /usr/lib/gcc/x86_64-pc-linux-gnu/14/libgcc_s.so.1
INFO     | Using default shell: /bin/sh
WARNING  | Virtual block devices unavailable, disabling device mapper autodetection.
INFO     | [/dev/nvme0n1p3] Auto-enabling kernel modules for device: nvme
INFO     | [/dev/nvme0n1p3] Autodetected mount type from device: btrfs
INFO     | [root] Autodetected mount source: uuid=963bf518-69b3-41af-8366-617ba5aa3ef5
INFO     | [mounts] Updating mount: root
INFO     | Auto-enabling module: btrfs
INFO     | Processing module: ugrd.fs.btrfs
INFO     | Detected kernel version: 6.14.2-gentoo-dist
INFO     | Autodetected kernel modules: nvme, xe, i915, snd_sof_pci_intel_cnl, intel_vsec, snd_sof_pci_intel_tgl, snd_hda_intel, mei_me, iwlwifi, igc, amdgpu, snd_soc_avs
INFO     | Build directory does not exist, skipping cleaning: /tmp/initramfs_build
INFO     | Processing module: ugrd.kmod.novideo
INFO     | Processing module: ugrd.kmod.nosound
INFO     | Processing module: ugrd.kmod.nonetwork
INFO     | Setting shebang to: #!/bin/sh -l
WARNING  | Host path is a directory, skipping symlink creation: /bin
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /sbin
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /usr/sbin
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /lib
WARNING  | Set `merge_usr = false` to disable /usr merge.
WARNING  | Host path is a directory, skipping symlink creation: /lib64
WARNING  | Set `merge_usr = false` to disable /usr merge.
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/arch/x86/crypto/sha256-ssse3.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/arch/x86/crypto/sha256-ssse3.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/common/nvme-auth.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/common/nvme-auth.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme-core.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme-core.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/nvme/host/nvme.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/platform/x86/intel/intel-vsec.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/platform/x86/intel/intel-vsec.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei-me.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/misc/mei/mei-me.ko
INFO     | [xz] Decompressed /lib/modules/6.14.2-gentoo-dist/kernel/drivers/net/ethernet/intel/igc/igc.ko.xz -> /tmp/initramfs_build/lib/modules/6.14.2-gentoo-dist/kernel/drivers/net/ethernet/intel/igc/igc.ko
INFO     | Regenerating kernel module metadata files.
INFO     | -- | Generating init functions
INFO     | Init kernel modules: nvme, intel_vsec, mei_me, igc
INFO     | Included kernel modules: mei, sha256, nvme_core, nvme_auth
WARNING  | Ignored kernel modules: spi_intel_pci, i2c_i801, amdgpu, i915, snd_hda_intel, iwlwifi, xe, snd_sof_pci_intel_cnl, snd_sof_pci_intel_tgl, snd_soc_avs
WARNING  | No initramfs fstab found, skipping mount_fstab.
INFO     | Wrote file: /tmp/initramfs_build/etc/profile
INFO     | Included functions: check_var, setvar, readvar, wait_enter, prompt_user, retry, klog, edebug, einfo, ewarn, eerror, rd_fail, rd_restart, _find_init, mount_default_root, parse_cmdline_bool, parse_cmdline_str, mount_base, export_exports, parse_cmdline, print_banner, load_modules, mount_root, do_switch_root
INFO     | Wrote file: /tmp/initramfs_build/init
INFO     | -- | Packing build
INFO     | [XZ] Compressing the CPIO data, original size: 13.54 MiB
INFO     | Wrote 4.11 MiB to: /tmp/initramfs_out/ugrd-6.14.2-gentoo-dist.cpio.xz
INFO     | -- | Running checks

Weird thing: ugrd is compressing the CPIO data with XZ, but at one point I set in my kernel config to use ZSTD. This is what it is currently, though, as I thought I should probably enable XZ compression:

rg 'FW_LOADER' /usr/src/linux-6.14.2-gentoo/.config

Code: Select all

1656:CONFIG_FW_LOADER=y
1657:CONFIG_FW_LOADER_PAGED_BUF=y
1659:# CONFIG_FW_LOADER_USER_HELPER is not set
1660:CONFIG_FW_LOADER_COMPRESS=y
1661:CONFIG_FW_LOADER_COMPRESS_XZ=y
1662:CONFIG_FW_LOADER_COMPRESS_ZSTD=y

The kernel command line parsing has been updated recently, it may be worth trying the 9999, but I'm not sure why the "backup" root options (should be the same as the build system's info) aren't working. It should fail to mount the root using the root= provided by the command line if parsing is broken there, but as long as you're booting the same system which built the image, the backup parameters should get you booted.

I've been on 9999. Still fails. I'll try removing root= and see what happens.

EDIT 1:

Why is GCC being referred to when I've built my kernel and modules with Clang/LLVM?

Code: Select all

Source path for libgcc_s: /usr/lib/gcc/x86_64-pc-linux-gnu/14/libgcc_s.so.1 

EDIT 2:

Does this "nosound" module mean the initframs is built without sound support? Or it is harmless? Because I have been having issue with sound lately...

I mean, I assume not since there's novideo as well and I have video...

Code: Select all

 INFO     | Processing module: ugrd.kmod.nosound 

This looks fine to me, can you share the full log when it fails?

The kmod masks are to prevent those kernel modules from being included in the initramfs, if you don't need sound, video, and network capabilities within the initramfs, it's usually best to not include them in the initramfs. They should be loaded later. Likely by udev or similar, but if you're not using udev, you must tell the system to load them on boot.

v2 (9999) supports zstd compression if you adjust the `cpio_compression`in the settings. You need the dev-python/zstandard package to use this. Currently it only supports zstd, xz, or no compression.

ugrd finds libgcc because that is needed by userspace tools within the initramfs in many cases, and may not be explicitly linked. If you're sure you don't need this, you can set `find_libgcc = false` in your config.toml.

Are you on a split-usr profile still? That should be fine, but is a bit atypical. The warnings can essentially be ignored, and you can set `merge_usr = false` if you want it to avoid making any usr symlinks in the image, unless absolutely necessary.

[alecStewart1]

This looks fine to me, can you share the full log when it fails?

No because things fails at boot and I have no way of capturing that failure. ugrd isn't failing, just the initramfs it creates is incorrect.

The best I got is

Code: Select all

* Failed to mount the root partition using /proc/cmdline -t auto -o default,ro root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5
mount: /target_rootfs: can't find UUID=963bf518-69b3-41af-8366-617ba5aa3ef5
 * Failed to mount root partition
 * Press enter to break, waiting: 1.0

v2 (9999) supports zstd compression if you adjust the `cpio_compression`in the settings. You need the dev-python/zstandard package to use this. Currently it only supports zstd, xz, or no compression.

Ah, that's not in config.toml with v2 (9999).

ugrd finds libgcc because that is needed by userspace tools within the initramfs in many cases, and may not be explicitly linked. If you're sure you don't need this, you can set `find_libgcc = false` in your config.toml.

My Clang, LLVM and associated tools and libraries are all bootstrapped, so I likely don't...maybe.

Are you on a split-usr profile still? That should be fine, but is a bit atypical. The warnings can essentially be ignored, and you can set `merge_usr = false` if you want it to avoid making any usr symlinks in the image, unless absolutely necessary.

"Still?" I didn't know that was abnormal.

My profile is:

Code: Select all

[58]  default/linux/amd64/23.0/split-usr/hardened (stable) *

[zen_desu]

This looks fine to me, can you share the full log when it fails?

No because things fails at boot and I have no way of capturing that failure. ugrd isn't failing, just the initramfs it creates is incorrect.

The best I got is

Code: Select all

* Failed to mount the root partition using /proc/cmdline -t auto -o default,ro root=UUID=963bf518-69b3-41af-8366-617ba5aa3ef5
mount: /target_rootfs: can't find UUID=963bf518-69b3-41af-8366-617ba5aa3ef5
 * Failed to mount root partition
 * Press enter to break, waiting: 1.0

v2 (9999) supports zstd compression if you adjust the `cpio_compression`in the settings. You need the dev-python/zstandard package to use this. Currently it only supports zstd, xz, or no compression.

Ah, that's not in config.toml with v2 (9999).

ugrd finds libgcc because that is needed by userspace tools within the initramfs in many cases, and may not be explicitly linked. If you're sure you don't need this, you can set `find_libgcc = false` in your config.toml.

My Clang, LLVM and associated tools and libraries are all bootstrapped, so I likely don't...maybe.

Are you on a split-usr profile still? That should be fine, but is a bit atypical. The warnings can essentially be ignored, and you can set `merge_usr = false` if you want it to avoid making any usr symlinks in the image, unless absolutely necessary.

"Still?" I didn't know that was abnormal.

My profile is:

Code: Select all

[58]  default/linux/amd64/23.0/split-usr/hardened (stable) *

Yes, merged-usr is the "default" for all profile types for 23.0. Split-usr should work, but is a bit non-standard in the sense that it deviates from the defaults.

It's failing to use the default/recovery root info as well, if this is the case, the build validation is missing something. Once you press enter, it should show a lot of debug info, such as loaded modules, what block devices it can see, etc. Can you share this?

It should look something like this: https://i.imgur.com/VPw7JgK.png

https://github.com/desultory/ugrd/pull/275 small update, should help with config clarity. I'm not sure what is missing, but the info on the fail screen should let you know if it's seeing an devices, and if the kmods were loaded properly.

[alecStewart1]

I do have to keep coming back to this because I feel like it wasn't answered:

Why does gentoo-kernel-bin work, but not the one I've manually built?

I'm fine with investigating ugrd some...but it works with gentoo-kernel-bin. It seems like there's something wrong or missing in my custom config compared to the one provided by gentoo-kernel-bin.

Is this a dumb question?

[zen_desu]

I do have to keep coming back to this because I feel like it wasn't answered:

Why does gentoo-kernel-bin work, but not the one I've manually built?

I'm fine with investigating ugrd some...but it works with gentoo-kernel-bin. It seems like there's something wrong or missing in my custom config compared to the one provided by gentoo-kernel-bin.

Is this a dumb question?

Not a dumb question, just real hard to answer without seeing what resolves this.

if you build a kernel with _identical_ config to what is in gentoo-kernel-bin, it should work the same. Something must differ somewhere.