Gentoo Forums :: View topic - IOMMU wrong w/ C7H mobo

IOMMU wrong w/ C7H mobo

View unanswered posts
View posts from last 24 hours

Gentoo Forums Forum Index

Kernel & Hardware

View previous topic :: View next topic

Author

Message

taskman
n00b
n00b

Joined: 29 Nov 2018
Posts: 39

Posted: Thu Mar 14, 2019 2:57 am Post subject: IOMMU wrong w/ C7H mobo

I assume my kernel has some wrong settings enabled or disabled.
I compiled 3 different kernels already, but still I can't get the IOMMU-groups right.

ATM I am using this config.

This is what I get ...

Code:

[~] lsiommu.sh
IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 0 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 0 00:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 0 01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd Device [144d:a808]
IOMMU Group 0 02:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43d0] (rev 01)
IOMMU Group 0 02:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c8] (rev 01)
IOMMU Group 0 02:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c6] (rev 01)
IOMMU Group 0 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 0 03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 0 03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 0 03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 0 03:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 0 03:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 0 06:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 0 07:00.0 Network controller [0280]: Realtek Semiconductor Co., Ltd. Device [10ec:b822]
IOMMU Group 0 08:00.0 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 0 08:00.1 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 0 08:00.2 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 0 08:00.3 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 0 09:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:2142]
IOMMU Group 1 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 2 00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 2 00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 2 00:03.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 2 0a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP102 [GeForce GTX 1080 Ti] [10de:1b06] (rev a1)
IOMMU Group 2 0a:00.1 Audio device [0403]: NVIDIA Corporation GP102 HDMI Audio Controller [10de:10ef] (rev a1)
IOMMU Group 2 0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation GM200 [GeForce GTX TITAN X] [10de:17c2] (rev a1)
IOMMU Group 2 0b:00.1 Audio device [0403]: NVIDIA Corporation GM200 High Definition Audio [10de:0fb0] (rev a1)
IOMMU Group 3 00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 4 00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 4 00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B [1022:1454]
IOMMU Group 4 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:145a]
IOMMU Group 4 0c:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Device [1022:1456]
IOMMU Group 4 0c:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] USB 3.0 Host controller [1022:145f]
IOMMU Group 5 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 5 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B [1022:1454]
IOMMU Group 5 0d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:1455]
IOMMU Group 5 0d:00.2 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 5 0d:00.3 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Device [1022:1457]
IOMMU Group 6 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 59)
IOMMU Group 6 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 7 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1460]
IOMMU Group 7 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1461]
IOMMU Group 7 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1462]
IOMMU Group 7 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1463]
IOMMU Group 7 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1464]
IOMMU Group 7 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1465]
IOMMU Group 7 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6 [1022:1466]
IOMMU Group 7 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 [1022:1467]

I can't through put my second gpu this way
and my pci-nics also wont split in different iommu groups.

Code:

[~] dmesg | grep -iE "amd-vi|vfio|iommu"
[ 0.000000] Command line: BOOT_IMAGE=/@/kernels/4.20.12-gentoo-C7HWIFI.09/vmlinuz root=ZFS=rpool/ROOT/gentoo by=id elevator=noop logo.nologo triggers=zfs iommu=pt iommu=1 quiet
[ 0.000000] Kernel command line: BOOT_IMAGE=/@/kernels/4.20.12-gentoo-C7HWIFI.09/vmlinuz root=ZFS=rpool/ROOT/gentoo by=id elevator=noop logo.nologo triggers=zfs iommu=pt iommu=1 quiet
[ 0.335882] AMD-Vi: IOMMU performance counters supported
[ 0.336078] iommu: Adding device 0000:00:01.0 to group 0
[ 0.336090] iommu: Using direct mapping for device 0000:00:01.0
[ 0.336099] iommu: Adding device 0000:00:01.1 to group 0
[ 0.336109] iommu: Adding device 0000:00:01.3 to group 0
[ 0.336152] iommu: Adding device 0000:00:02.0 to group 1
[ 0.336163] iommu: Using direct mapping for device 0000:00:02.0
[ 0.336207] iommu: Adding device 0000:00:03.0 to group 2
[ 0.336217] iommu: Using direct mapping for device 0000:00:03.0
[ 0.336227] iommu: Adding device 0000:00:03.1 to group 2
[ 0.336236] iommu: Adding device 0000:00:03.2 to group 2
[ 0.336274] iommu: Adding device 0000:00:04.0 to group 3
[ 0.336284] iommu: Using direct mapping for device 0000:00:04.0
[ 0.336325] iommu: Adding device 0000:00:07.0 to group 4
[ 0.336335] iommu: Using direct mapping for device 0000:00:07.0
[ 0.336344] iommu: Adding device 0000:00:07.1 to group 4
[ 0.336386] iommu: Adding device 0000:00:08.0 to group 5
[ 0.336397] iommu: Using direct mapping for device 0000:00:08.0
[ 0.336407] iommu: Adding device 0000:00:08.1 to group 5
[ 0.336449] iommu: Adding device 0000:00:14.0 to group 6
[ 0.336459] iommu: Using direct mapping for device 0000:00:14.0
[ 0.336469] iommu: Adding device 0000:00:14.3 to group 6
[ 0.336530] iommu: Adding device 0000:00:18.0 to group 7
[ 0.336540] iommu: Using direct mapping for device 0000:00:18.0
[ 0.336550] iommu: Adding device 0000:00:18.1 to group 7
[ 0.336561] iommu: Adding device 0000:00:18.2 to group 7
[ 0.336570] iommu: Adding device 0000:00:18.3 to group 7
[ 0.336581] iommu: Adding device 0000:00:18.4 to group 7
[ 0.336590] iommu: Adding device 0000:00:18.5 to group 7
[ 0.336601] iommu: Adding device 0000:00:18.6 to group 7
[ 0.336610] iommu: Adding device 0000:00:18.7 to group 7
[ 0.336616] iommu: Adding device 0000:01:00.0 to group 0
[ 0.336621] iommu: Adding device 0000:02:00.0 to group 0
[ 0.336626] iommu: Adding device 0000:02:00.1 to group 0
[ 0.336631] iommu: Adding device 0000:02:00.2 to group 0
[ 0.336636] iommu: Adding device 0000:03:00.0 to group 0
[ 0.336641] iommu: Adding device 0000:03:01.0 to group 0
[ 0.336646] iommu: Adding device 0000:03:02.0 to group 0
[ 0.336651] iommu: Adding device 0000:03:03.0 to group 0
[ 0.336656] iommu: Adding device 0000:03:04.0 to group 0
[ 0.336661] iommu: Adding device 0000:03:09.0 to group 0
[ 0.336667] iommu: Adding device 0000:06:00.0 to group 0
[ 0.336671] iommu: Adding device 0000:07:00.0 to group 0
[ 0.336677] iommu: Adding device 0000:08:00.0 to group 0
[ 0.336682] iommu: Adding device 0000:08:00.1 to group 0
[ 0.336687] iommu: Adding device 0000:08:00.2 to group 0
[ 0.336692] iommu: Adding device 0000:08:00.3 to group 0
[ 0.336697] iommu: Adding device 0000:09:00.0 to group 0
[ 0.336701] iommu: Adding device 0000:0a:00.0 to group 2
[ 0.336706] iommu: Adding device 0000:0a:00.1 to group 2
[ 0.336711] iommu: Adding device 0000:0b:00.0 to group 2
[ 0.336715] iommu: Adding device 0000:0b:00.1 to group 2
[ 0.336720] iommu: Adding device 0000:0c:00.0 to group 4
[ 0.336725] iommu: Adding device 0000:0c:00.2 to group 4
[ 0.336730] iommu: Adding device 0000:0c:00.3 to group 4
[ 0.336735] iommu: Adding device 0000:0d:00.0 to group 5
[ 0.336740] iommu: Adding device 0000:0d:00.2 to group 5
[ 0.336745] iommu: Adding device 0000:0d:00.3 to group 5
[ 0.336903] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
[ 0.336903] AMD-Vi: Extended features (0xf77ef22294ada):
[ 0.336906] AMD-Vi: Interrupt remapping enabled
[ 0.336906] AMD-Vi: virtual APIC enabled
[ 0.336963] AMD-Vi: Lazy IO/TLB flushing enabled
[ 0.337145] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[ 0.673685] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[ 0.674495] VFIO - User Level meta-driver version: 0.3
[ 0.675427] vfio-pci 0000:0b:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
[ 0.687469] vfio_pci: add [10de:17c2[ffff:ffff]] class 0x000000/00000000
[ 0.699528] vfio_pci: add [10de:0fb0[ffff:ffff]] class 0x000000/00000000
[ 4.625076] vfio-pci 0000:0b:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none

When runnig the rescCD of fearedbliss then I get the following ...

Code:

IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
IOMMU Group 10 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
IOMMU Group 11 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1454]
IOMMU Group 12 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 59)
IOMMU Group 12 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 13 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1460]
IOMMU Group 13 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1461]
IOMMU Group 13 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1462]
IOMMU Group 13 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1463]
IOMMU Group 13 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1464]
IOMMU Group 13 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1465]
IOMMU Group 13 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1466]
IOMMU Group 13 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1467]
IOMMU Group 14 01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd Device [144d:a808]
IOMMU Group 15 02:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43d0] (rev 01)
IOMMU Group 15 02:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c8] (rev 01)
IOMMU Group 15 02:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c6] (rev 01)
IOMMU Group 15 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 15 03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 15 03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 15 03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 15 03:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 15 03:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43c7] (rev 01)
IOMMU Group 15 06:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 15 07:00.0 Network controller [0280]: Realtek Semiconductor Co., Ltd. Device [10ec:b822]
IOMMU Group 15 08:00.0 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 15 08:00.1 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 15 08:00.2 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 15 08:00.3 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU Group 15 09:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:2142]
IOMMU Group 16 0a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP102 [GeForce GTX 1080 Ti] [10de:1b06] (rev a1)
IOMMU Group 16 0a:00.1 Audio device [0403]: NVIDIA Corporation GP102 HDMI Audio Controller [10de:10ef] (rev a1)
IOMMU Group 17 0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation GM200 [GeForce GTX TITAN X] [10de:17c2] (rev a1)
IOMMU Group 17 0b:00.1 Audio device [0403]: NVIDIA Corporation GM200 High Definition Audio [10de:0fb0] (rev a1)
IOMMU Group 18 0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:145a]
IOMMU Group 19 0c:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Device [1022:1456]
IOMMU Group 1 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 20 0c:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:145f]
IOMMU Group 21 0d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:1455]
IOMMU Group 22 0d:00.2 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 23 0d:00.3 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Device [1022:1457]
IOMMU Group 2 00:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 3 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
IOMMU Group 4 00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
IOMMU Group 5 00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 6 00:03.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 7 00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
IOMMU Group 8 00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
IOMMU Group 9 00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1454]

Still no pci-nics splitting in different iommu groups, but at least I could passthrough the gpu.

What I am doing wrong ?
my other computer had no problems splitting iommu groups of my pci-nics, for example.

The major difference I have done is using systemd instead of openrc.
asus crosshair 7 hero wifi mobo w/ ryzen 2700 instead of asus aura gaming 970 pro Mobo w/ 8350 Bulldozer
Everything else is almost the same in the kernel-config, even some driver are similar (at least I think so).

HALP plx.

If any info is missing tell me, I will add it then.

taskman
n00b
n00b

Joined: 29 Nov 2018
Posts: 39

Posted: Thu Mar 14, 2019 3:43 am Post subject: IOMMU wrong w/ C7H mobo

double post, sorry

Display posts from previous:

	Gentoo Forums Forum Index Kernel & Hardware	All times are GMT
Page 1 of 1

Jump to:

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

Copyright 2001-2024 Gentoo Foundation, Inc. Designed by Kyle Manna © 2003; Style derived from original subSilver theme. | Hosting by Gossamer Threads Inc. © | Powered by phpBB 2.0.23-gentoo-p11 © 2001, 2002 phpBB Group
Privacy Policy