Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Dreadful E4500 U160 SCSI peformance on PCI I/O board
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Gentoo on Sparc
View previous topic :: View next topic  
Author Message
Tiberizzle
n00b
n00b


Joined: 20 Nov 2006
Posts: 9

PostPosted: Thu Dec 28, 2006 6:59 pm    Post subject: Dreadful E4500 U160 SCSI peformance on PCI I/O board Reply with quote

Linux supernova 2.6.17-gentoo-r8 #1 SMP Sat Dec 9 16:38:02 EST 2006 sparc64 sun4u TI UltraSparc II (BlackBird) GNU/Linux

Right now I'm using 4 disks on a single channel of an NetFinity EXP300 / Adaptec 39160 in Linux software RAID-5. I had planned to fill up the EXP300 and use both channels of the enclosure and RAID controller but I'm already running into bottlenecks with just the 4 drives I have caddies for now.

Single disk performs as expected:
Code:
supernova ~ # hdparm -t /dev/sdc

/dev/sdc:
 Timing O_DIRECT disk reads:  104 MB in  3.03 seconds =  34.36 MB/sec


MD array however performs very poorly:
Code:
supernova ~ # hdparm -t /dev/md0

/dev/md0:
 Timing O_DIRECT disk reads:  178 MB in  3.01 seconds =  59.11 MB/sec


Should be more like 120MB/sec, no?

The following seems to indicate that absolutely no IRQ load-balancing is occuring and the system does not seem to change behavior with
different values of /proc/irq/*/smp_affinity. "top" also reports only a single CPU logging time in system interrupt state and system state when
the RAID volume is being tested.

Code:
supernova ~ # cat /proc/interrupts
  0:    1868200          0          0          0          0          0          0          0          0          0          0          0  timer:dead
  5:      16950      21199      11227         15       3366          0          0          0          0          0          0          0  qla1280:e0, qla1280:84, eth0:a1, aic7xxx:c4, aic7xxx:c5
 12:       3881          0          0          0          0          0          0          0          0          0          0          0  SunZilog:b9
 15:          0          0          0          0          0          0          0          0          0          0          0          0  PSYCHO UE:ee, PSYCHO CE:ef, PSYCHO PCIERR:f0, PSYCHO PCIERR:f1, PSYCHO UE:ae, PSYCHO CE:af, PSYCHO PCIERR:b0, PSYCHO PCIERR:b1


Configuration details below:

Code:
supernova ~ # cat /proc/mdstat
Personalities : [linear] [raid0] [raid1] [raid10] [raid5] [raid4] [raid6] [multipath]
md0 : active raid5 dm-3[3] dm-2[2] dm-1[1] dm-0[0]
      106642944 blocks level 5, 512k chunk, algorithm 0 [4/4] [UUUU]

unused devices: <none>


Code:
supernova ~ # lspci -v
80:00.0 Host bridge: Sun Microsystems Computer Corp. Psycho PCI Bus Module
        Flags: bus master, 66MHz, medium devsel, latency 64

80:02.0 PCI bridge: Digital Equipment Corporation DECchip 21152 (rev 03) (prog-if 00 [Normal decode])
        Flags: bus master, medium devsel, latency 0
        Bus: primary=80, secondary=81, subordinate=81, sec-latency=0
        I/O behind bridge: 00001000-00001fff
        Memory behind bridge: 00100000-028fffff
        Capabilities: [dc] Power Management version 1

81:00.0 Bridge: Sun Microsystems Computer Corp. EBUS (rev 01)
        Flags: bus master, medium devsel, latency 80
        Memory at 1c501000000 (32-bit, non-prefetchable) [size=16M]
        Memory at 1c502000000 (32-bit, non-prefetchable) [size=8M]
        Expansion ROM at 1c503000000 [disabled] [size=16M]

81:00.1 Ethernet controller: Sun Microsystems Computer Corp. Happy Meal (rev 01)
        Flags: bus master, medium devsel, latency 80, IRQ 0082be20
        Memory at 1c502800000 (32-bit, non-prefetchable) [size=32K]
        Expansion ROM at 1c504000000 [disabled] [size=16M]

81:04.0 SCSI storage controller: QLogic Corp. ISP1020 Fast-wide SCSI (rev 05)
        Flags: bus master, medium devsel, latency 32, IRQ 0082be00
        I/O ports at 1c402001000 [size=256]
        Memory at 1c502808000 (32-bit, non-prefetchable) [size=4K]
        Expansion ROM at 1c502810000 [disabled] [size=64K]

0001:00:00.0 Host bridge: Sun Microsystems Computer Corp. Psycho PCI Bus Module
        Flags: bus master, medium devsel, latency 64

0001:00:01.0 Bridge: Sun Microsystems Computer Corp. EBUS (rev 01)
        Flags: bus master, medium devsel, latency 80
        Memory at 1c581000000 (32-bit, non-prefetchable) [size=16M]
        Memory at 1c582000000 (32-bit, non-prefetchable) [size=8M]
        Expansion ROM at 1c583000000 [disabled] [size=16M]

0001:00:01.1 Ethernet controller: Sun Microsystems Computer Corp. Happy Meal (rev 01)
        Flags: bus master, medium devsel, latency 255, IRQ 0082c1a0
        Memory at 1c582800000 (32-bit, non-prefetchable) [size=32K]
        Expansion ROM at 1c584000000 [disabled] [size=16M]

0002:80:00.0 Host bridge: Sun Microsystems Computer Corp. Psycho PCI Bus Module
        Flags: bus master, 66MHz, medium devsel, latency 64

0002:80:02.0 SCSI storage controller: Adaptec AHA-3960D / AIC-7899A U160/m (rev 01)
        Subsystem: Adaptec AHA-3960D U160/m
        Flags: bus master, 66MHz, medium devsel, latency 160, IRQ 0082c600
        BIST result: 00
        I/O ports at 1c602000400 [disabled] [size=256]
        Memory at 1c700002000 (64-bit, non-prefetchable) [size=4K]
        Expansion ROM at 1c700020000 [disabled] [size=128K]
        Capabilities: [dc] Power Management version 2

0002:80:02.1 SCSI storage controller: Adaptec AHA-3960D / AIC-7899A U160/m (rev 01)
        Subsystem: Adaptec AHA-3960D U160/m
        Flags: bus master, 66MHz, medium devsel, latency 160, IRQ 0082c620
        BIST result: 00
        I/O ports at 1c602000800 [disabled] [size=256]
        Memory at 1c700004000 (64-bit, non-prefetchable) [size=4K]
        Expansion ROM at 1c700040000 [disabled] [size=128K]
        Capabilities: [dc] Power Management version 2

0003:00:00.0 Host bridge: Sun Microsystems Computer Corp. Psycho PCI Bus Module
        Flags: bus master, medium devsel, latency 64

0003:00:03.0 SCSI storage controller: QLogic Corp. ISP1020 Fast-wide SCSI (rev 05)
        Flags: bus master, medium devsel, latency 32, IRQ 0082c980
        I/O ports at 1c602010400 [size=256]
        Memory at 1c780002000 (32-bit, non-prefetchable) [size=4K]
        Expansion ROM at 1c780010000 [disabled] [size=64K]


Code:
supernova ~ # dmesg
[    0.000000] PROMLIB: Sun IEEE Boot Prom 'OBP 3.2.28 2000/12/20 12:24'
[    0.000000] PROMLIB: Root node compatible:
[    0.000000] Linux version 2.6.17-gentoo-r8 (root@livecd) (gcc version 3.4.6 (Gentoo Linux 3.4.6)) #1 SMP Sat Dec 9 16:38:02 EST 2006
[    0.000000] ARCH: SUN4U
[    0.000000] Ethernet address: 08:00:20:ac:f9:c6
[    0.000000] On node 0 totalpages: 1571145
[    0.000000]   DMA zone: 1571145 pages, LIFO batch:15
[    0.000000] CENTRAL: Detected 8 slot Enterprise system. cfreg[68] cver[78]
[    0.000000] FHC(board 1): Version[1] PartID[fa0] Manuf[3e] (CENTRAL)
[    0.000000] FHC(board 0): Version[1] PartID[fa0] Manuf[3e] (JTAG Master)
[    0.000000] FHC(board 2): Version[1] PartID[fa0] Manuf[3e]
[    0.000000] FHC(board 3): Version[1] PartID[fa0] Manuf[3e]
[    0.000000] FHC(board 4): Version[1] PartID[fa0] Manuf[3e]
[    0.000000] FHC(board 6): Version[1] PartID[fa0] Manuf[3e]
[    0.000000] FHC(board 7): Version[1] PartID[fa0] Manuf[3e]
[    0.000000] FHC(board 1): Version[1] PartID[fa0] Manuf[3e]
[    0.000000] Built 1 zonelists
[    0.000000] Kernel command line: root=/dev/sda1
[    0.000000] PID hash table entries: 4096 (order: 12, 32768 bytes)
[    2.206438] Console: colour dummy device 80x25
[    2.269162] Dentry cache hash table entries: 2097152 (order: 11, 16777216 bytes)
[    2.379733] Inode-cache hash table entries: 1048576 (order: 10, 8388608 bytes)
[    2.961373] Memory: 12457168k available (2952k kernel code, 1064k data, 192k init) [fffff80000000000,00000002ffd04000]
[    3.040782] Calibrating delay using timer specific routine.. 800.44 BogoMIPS (lpj=1600882)
[    3.041212] Mount-cache hash table entries: 512
[    3.043512] CPU[0]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.067796] Using max_cache_size of 8MB
[    3.148784] Calibrating delay using timer specific routine.. 800.05 BogoMIPS (lpj=1600114)
[    3.150541] CPU[1]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.151251] CPU 1: synchronized TICK with master CPU (last diff -17 cycles,maxerr 701 cycles)
[    3.232783] Calibrating delay using timer specific routine.. 800.06 BogoMIPS (lpj=1600130)
[    3.234815] CPU[4]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.235496] CPU 4: synchronized TICK with master CPU (last diff -14 cycles,maxerr 709 cycles)
[    3.316784] Calibrating delay using timer specific routine.. 800.06 BogoMIPS (lpj=1600127)
[    3.319007] CPU[5]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.319686] CPU 5: synchronized TICK with master CPU (last diff -16 cycles,maxerr 702 cycles)
[    3.400783] Calibrating delay using timer specific routine.. 800.05 BogoMIPS (lpj=1600107)
[    3.403228] CPU[6]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.403941] CPU 6: synchronized TICK with master CPU (last diff -16 cycles,maxerr 710 cycles)
[    3.484784] Calibrating delay using timer specific routine.. 800.07 BogoMIPS (lpj=1600145)
[    3.487413] CPU[7]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.488074] CPU 7: synchronized TICK with master CPU (last diff -17 cycles,maxerr 708 cycles)
[    3.568783] Calibrating delay using timer specific routine.. 800.05 BogoMIPS (lpj=1600117)
[    3.571652] CPU[8]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.572350] CPU 8: synchronized TICK with master CPU (last diff -13 cycles,maxerr 701 cycles)
[    3.652784] Calibrating delay using timer specific routine.. 800.05 BogoMIPS (lpj=1600119)
[    3.655824] CPU[9]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.656483] CPU 9: synchronized TICK with master CPU (last diff -17 cycles,maxerr 709 cycles)
[    3.740784] Calibrating delay using timer specific routine.. 800.06 BogoMIPS (lpj=1600121)
[    3.744162] CPU[12]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.744819] CPU 12: synchronized TICK with master CPU (last diff -13 cycles,maxerr 707 cycles)
[    3.828784] Calibrating delay using timer specific routine.. 800.06 BogoMIPS (lpj=1600124)
[    3.832231] CPU[13]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.832881] CPU 13: synchronized TICK with master CPU (last diff -17 cycles,maxerr 704 cycles)
[    3.916783] Calibrating delay using timer specific routine.. 800.06 BogoMIPS (lpj=1600121)
[    3.920459] CPU[14]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    3.921191] CPU 14: synchronized TICK with master CPU (last diff -17 cycles,maxerr 710 cycles)
[    4.004784] Calibrating delay using timer specific routine.. 800.06 BogoMIPS (lpj=1600124)
[    4.008608] CPU[15]: Caches D[sz(16384):line_sz(32)] I[sz(16384):line_sz(32)] E[sz(8388608):line_sz(64)]
[    4.009344] CPU 15: synchronized TICK with master CPU (last diff -22 cycles,maxerr 714 cycles)
[    4.009366] Brought up 12 CPUs
[    4.009390] Total of 12 processors activated (9601.11 BogoMIPS).
[    9.755363] migration_cost=157965
[    9.758156] NET: Registered protocol family 16
[    9.783866] PCI: Probing for controllers.
[    9.787063] PCI: Found PSYCHO, control regs at 000001c400000000
[    9.787081] PSYCHO: Shared PCI config space at 000001c401000000
[    9.796764] PCI: Found PSYCHO, control regs at 000001c600000000
[    9.796795] PSYCHO: Shared PCI config space at 000001c601000000
[    9.807953] PCI1(PBMB): Bus running at 33MHz
[    9.810378] PCI1(PBMA): Bus running at 66MHz
[    9.812603] PCI0(PBMB): Bus running at 33MHz
[    9.816099] PSYCHO0 PBMA: 0000:81:00.1 IRQ Swivel 0000:81:00.1 [2:0] -> [2]
[    9.816276] PSYCHO0 PBMA: 0000:81:04.0 IRQ Swivel 0000:81:04.0 [1:4] -> [1]
[    9.816368] PCI0(PBMA): Bus running at 33MHz
[    9.816561] ebus: No EBus's found.
[    9.819770] SCSI subsystem initialized
[    9.828969] NET: Registered protocol family 2
[    9.865066] IP route cache hash table entries: 524288 (order: 9, 4194304 bytes)
[    9.884155] TCP established hash table entries: 524288 (order: 10, 8388608 bytes)
[    9.923758] TCP bind hash table entries: 65536 (order: 7, 1048576 bytes)
[    9.928736] TCP: Hash tables configured (established 524288 bind 65536)
[    9.928759] TCP reno registered
[    9.934179] Total HugeTLB memory allocated, 0
[    9.937331] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[    9.995740] Initializing Cryptographic API
[    9.995774] io scheduler noop registered
[    9.995841] io scheduler anticipatory registered (default)
[    9.995921] io scheduler deadline registered
[    9.996089] io scheduler cfq registered
[   10.009562] rtc_init: no PC rtc found
[   10.019644] SunZilog: 2 chips.
[   10.235878] zs2 at 0x000001fff8904004 (irq = 12,b9) is a SunZilog
[   10.338955] zs3 at 0x000001fff8904000 (irq = 12,b9) is a SunZilog
[   10.442076] ttyS0 at MMIO 0x0 (irq = 8570016) is a SunZilog
[   10.442324] Console: ttyS0 (SunZilog zs0)
[    0.659570] ttyS1 at MMIO 0x0 (irq = 8570016) is a SunZilog
[    0.724916] mice: PS/2 mouse device common for all mice
[    0.788266] RAMDISK driver initialized: 4 RAM disks of 4096K size 1024 blocksize
[    0.876928] loop: loaded (max 8 devices)
[    0.922807] nbd: registered device at major 43
[    0.979410] qla1280: QLA1040 found on PCI bus 0, dev 3
[    1.626685] scsi(0:0): Resetting SCSI BUS
[    1.787439] input: Sun Mouse as /class/input/input0
[    4.676951] scsi0 : QLogic QLA1040 PCI to SCSI Host Adapter
[    4.676962]        Firmware version:  7.65.06, Driver version 3.26
[    5.819752]   Vendor: TOSHIBA   Model: DVD-ROM SD-M1401  Rev: 1007
[    5.891612]   Type:   CD-ROM                             ANSI SCSI revision: 02
[    5.979822] scsi(0:0:6:0): Sync: period 10, offset 12
[    7.377912] qla1280: QLA1040 found on PCI bus 129, dev 4
[    8.112904] scsi(1:0): Resetting SCSI BUS
[   11.166902] scsi1 : QLogic QLA1040 PCI to SCSI Host Adapter
[   11.166912]        Firmware version:  7.65.06, Driver version 3.26
[   13.145838]   Vendor: IBM       Model: DDYST1835SUN18G   Rev: S96H
[   13.217672]   Type:   Direct-Access                      ANSI SCSI revision: 03
[   13.305875] scsi(1:0:12:0): Sync: period 10, offset 12, Wide
[   13.375822]   Vendor: IBM       Model: DDYST1835SUN18G   Rev: S96H
[   13.447721]   Type:   Direct-Access                      ANSI SCSI revision: 03
[   13.535907] scsi(1:0:13:0): Sync: period 10, offset 12, Wide
[   13.941490] SCSI device sda: 35378533 512-byte hdwr sectors (18114 MB)
[   14.018856] sda: Write Protect is off
[   14.061334] sda: Mode Sense: fb 00 00 08
[   14.062932] SCSI device sda: drive cache: write through
[   14.125195] SCSI device sda: 35378533 512-byte hdwr sectors (18114 MB)
[   14.203205] sda: Write Protect is off
[   14.245738] sda: Mode Sense: fb 00 00 08
[   14.247361] SCSI device sda: drive cache: write through
[   14.308279]  sda: sda1 sda2 sda3
[   14.360838] sd 1:0:12:0: Attached scsi disk sda
[   14.417066] SCSI device sdb: 35378533 512-byte hdwr sectors (18114 MB)
[   14.494462] sdb: Write Protect is off
[   14.536963] sdb: Mode Sense: fb 00 00 08
[   14.538546] SCSI device sdb: drive cache: write through
[   14.600772] SCSI device sdb: 35378533 512-byte hdwr sectors (18114 MB)
[   14.678887] sdb: Write Protect is off
[   14.721356] sdb: Mode Sense: fb 00 00 08
[   14.722980] SCSI device sdb: drive cache: write through
[   14.783885]  sdb: sdb1 sdb2 sdb3
[   14.834750] sd 1:0:13:0: Attached scsi disk sdb
[   14.889763] sr0: scsi3-mmc drive: 40x/40x cd/rw xa/form2 cdda tray
[   14.962315] Uniform CD-ROM driver Revision: 3.20
[   15.018026] sr 0:0:6:0: Attached scsi CD-ROM sr0
[   15.018339] sr 0:0:6:0: Attached scsi generic sg0 type 5
[   15.081286] sd 1:0:12:0: Attached scsi generic sg1 type 0
[   15.145937] sd 1:0:13:0: Attached scsi generic sg2 type 0
[   15.211126] rtc_sun_init: Registered Mostek RTC driver.
[   15.272791] md: linear personality registered for level -1
[   15.338419] md: raid0 personality registered for level 0
[   15.401976] md: raid1 personality registered for level 1
[   15.465522] md: raid10 personality registered for level 10
[   15.531159] md: raid5 personality registered for level 5
[   15.594711] md: raid4 personality registered for level 4
[   15.658312] raid5: automatically using best checksumming function: VIS
[   15.752952]    VIS       :   154.000 MB/sec
[   15.800983] raid5: using function: VIS (154.000 MB/sec)
[   15.929198] raid6: int64x1    206 MB/s
[   16.036988] raid6: int64x2    333 MB/s
[   16.144979] raid6: int64x4    411 MB/s
[   16.253209] raid6: int64x8    195 MB/s
[   16.295966] raid6: using algorithm int64x4 (411 MB/s)
[   16.356417] md: raid6 personality registered for level 6
[   16.419977] md: multipath personality registered for level -4
[   16.488738] md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
[   16.560630] md: bitmap version 4.39
[   16.602736] device-mapper: 4.6.0-ioctl (2006-02-17) initialised: dm-devel@redhat.com
[   16.697771] TCP bic registered
[   16.732243] NET: Registered protocol family 1
[   16.784331] NET: Registered protocol family 17
[   16.838764] md: Autodetecting RAID arrays.
[   16.886415] md: autorun ...
[   16.919731] md: ... autorun DONE.
[   16.971908] kjournald starting.  Commit interval 5 seconds
[   17.035758] EXT3-fs: mounted filesystem with ordered data mode.
[   17.106607] VFS: Mounted root (ext3 filesystem) readonly.
[    3.806482] EXT3 FS on sda1, internal journal
[    4.336859] sunhme.c:v2.02 8/24/03 David S. Miller (davem@redhat.com)
[    4.337951] eth0: HAPPY MEAL (PCI/CheerIO) 10/100BaseT Ethernet 08:00:20:ac:f9:c6
[    4.339177] eth1: HAPPY MEAL (PCI/CheerIO) 10/100BaseT Ethernet 08:00:20:ac:f9:c6
[    4.842275] Adding 999984k swap on /dev/sda2.  Priority:-1 extents:1 across:999984k
[    1.849114] eth0: Link is up using internal transceiver at 100Mb/s, Full Duplex.
[   13.627225] scsi2 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 7.0
[   13.627240]         <Adaptec 3960D Ultra160 SCSI adapter>
[   13.627250]         aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs
[   13.627262]
[    5.511845] scsi3 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 7.0
[    5.511861]         <Adaptec 3960D Ultra160 SCSI adapter>
[    5.511871]         aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs
[    5.511883]
[    8.083665]   Vendor: IBM-PSG   Model: ST336704LC    !#  Rev: B232
[    8.083816]   Type:   Direct-Access                      ANSI SCSI revision: 03
[    8.083881] scsi3:A:11:0: Tagged Queuing enabled.  Depth 32
[    8.083948]  target3:0:11: Beginning Domain Validation
[    8.089745]  target3:0:11: wide asynchronous
[    8.094316]  target3:0:11: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 63)
[    8.102910]  target3:0:11: Ending Domain Validation
[    8.105140] SCSI device sdc: 71096640 512-byte hdwr sectors (36401 MB)
[    8.106551] sdc: Write Protect is off
[    8.106577] sdc: Mode Sense: ab 00 10 08
[    8.107968] SCSI device sdc: drive cache: write through w/ FUA
[    8.109002] SCSI device sdc: 71096640 512-byte hdwr sectors (36401 MB)
[    8.110384] sdc: Write Protect is off
[    8.110409] sdc: Mode Sense: ab 00 10 08
[    8.111800] SCSI device sdc: drive cache: write through w/ FUA
[    8.111827]  sdc: sdc1
[    8.122277] sd 3:0:11:0: Attached scsi disk sdc
[    8.122495] sd 3:0:11:0: Attached scsi generic sg3 type 0
[    8.127801]   Vendor: IBM-PSG   Model: ST336704LC    !#  Rev: B230
[    8.127919]   Type:   Direct-Access                      ANSI SCSI revision: 03
[    8.127988] scsi3:A:12:0: Tagged Queuing enabled.  Depth 32
[    8.128016]  target3:0:12: Beginning Domain Validation
[    8.133776]  target3:0:12: wide asynchronous
[    8.138376]  target3:0:12: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 63)
[    8.149040]  target3:0:12: Ending Domain Validation
[    8.150031] SCSI device sdd: 71096640 512-byte hdwr sectors (36401 MB)
[    8.151402] sdd: Write Protect is off
[    8.151429] sdd: Mode Sense: ab 00 10 08
[    8.152796] SCSI device sdd: drive cache: write through w/ FUA
[    8.153789] SCSI device sdd: 71096640 512-byte hdwr sectors (36401 MB)
[    8.155123] sdd: Write Protect is off
[    8.155151] sdd: Mode Sense: ab 00 10 08
[    8.156503] SCSI device sdd: drive cache: write through w/ FUA
[    8.156531]  sdd: sdd1
[    8.166958] sd 3:0:12:0: Attached scsi disk sdd
[    8.167136] sd 3:0:12:0: Attached scsi generic sg4 type 0
[    8.171386]   Vendor: IBM-PSG   Model: ST336704LC    !#  Rev: B232
[    8.171513]   Type:   Direct-Access                      ANSI SCSI revision: 03
[    8.171574] scsi3:A:13:0: Tagged Queuing enabled.  Depth 32
[    8.171603]  target3:0:13: Beginning Domain Validation
[    8.177424]  target3:0:13: wide asynchronous
[    8.181813]  target3:0:13: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 63)
[    8.190484]  target3:0:13: Ending Domain Validation
[    8.191541] SCSI device sde: 71096640 512-byte hdwr sectors (36401 MB)
[    8.192937] sde: Write Protect is off
[    8.192964] sde: Mode Sense: ab 00 10 08
[    8.194396] SCSI device sde: drive cache: write through w/ FUA
[    8.195507] SCSI device sde: 71096640 512-byte hdwr sectors (36401 MB)
[    8.196933] sde: Write Protect is off
[    8.196960] sde: Mode Sense: ab 00 10 08
[    8.198452] SCSI device sde: drive cache: write through w/ FUA
[    8.198481]  sde: sde1
[    8.203856] sd 3:0:13:0: Attached scsi disk sde
[    8.204040] sd 3:0:13:0: Attached scsi generic sg5 type 0
[    8.208418]   Vendor: IBM-PSG   Model: ST336704LC    !#  Rev: B230
[    8.208602]   Type:   Direct-Access                      ANSI SCSI revision: 03
[    8.208698] scsi3:A:14:0: Tagged Queuing enabled.  Depth 32
[    8.208729]  target3:0:14: Beginning Domain Validation
[    8.214550]  target3:0:14: wide asynchronous
[    8.218915]  target3:0:14: FAST-80 WIDE SCSI 160.0 MB/s DT (12.5 ns, offset 63)
[    8.227440]  target3:0:14: Ending Domain Validation
[    8.228434] SCSI device sdf: 71096640 512-byte hdwr sectors (36401 MB)
[    8.229773] sdf: Write Protect is off
[    8.229800] sdf: Mode Sense: ab 00 10 08
[    8.231145] SCSI device sdf: drive cache: write through w/ FUA
[    8.232125] SCSI device sdf: 71096640 512-byte hdwr sectors (36401 MB)
[    8.233465] sdf: Write Protect is off
[    8.233491] sdf: Mode Sense: ab 00 10 08
[    8.234839] SCSI device sdf: drive cache: write through w/ FUA
[    8.234865]  sdf: sdf1
[    8.240714] sd 3:0:14:0: Attached scsi disk sdf
[    8.240910] sd 3:0:14:0: Attached scsi generic sg6 type 0
[    8.249500]   Vendor: IBM       Model: EXP300   S160     Rev: D014
[    8.249635]   Type:   Processor                          ANSI SCSI revision: 03
[    8.249702]  target3:0:15: Beginning Domain Validation
[    8.320284] (scsi3:A:15:0): refuses synchronous negotiation. Using asynchronous transfers
[    8.358185]  target3:0:15: Domain Validation skipping write tests
[    8.358206]  target3:0:15: Ending Domain Validation
[    8.358533]  3:0:15:0: Attached scsi generic sg7 type 3
[   17.071434] md: bind<dm-0>
[   17.087398] md: bind<dm-1>
[   17.100365] md: bind<dm-2>
[   17.113626] md: bind<dm-3>
[   17.125961] raid5: device dm-3 operational as raid disk 3
[   17.125982] raid5: device dm-2 operational as raid disk 2
[   17.125998] raid5: device dm-1 operational as raid disk 1
[   17.126014] raid5: device dm-0 operational as raid disk 0
[   17.129179] raid5: allocated 8358kB for md0
[   17.129205] raid5: raid level 5 set md0 active with 4 out of 4 devices, algorithm 0
[   17.129224] RAID5 conf printout:
[   17.129236]  --- rd:4 wd:4 fd:0
[   17.129250]  disk 0, o:1, dev:dm-0
[   17.129263]  disk 1, o:1, dev:dm-1
[   17.129277]  disk 2, o:1, dev:dm-2
[   17.129291]  disk 3, o:1, dev:dm-3
Back to top
View user's profile Send private message
Tiberizzle
n00b
n00b


Joined: 20 Nov 2006
Posts: 9

PostPosted: Thu Dec 28, 2006 7:17 pm    Post subject: Reply with quote

Also seems to be running into the same bottleneck sans the software RAID layer:

Code:
supernova ~ # hdparm -t /dev/sdc & hdparm -t /dev/sdd & hdparm -t /dev/sde & hdparm -t /dev/sdf
[1] 7502
[2] 7503
[3] 7504

/dev/sdc:

/dev/sdd:

/dev/sde:

/dev/sdf:
 Timing O_DIRECT disk reads:   Timing O_DIRECT disk reads:   Timing O_DIRECT disk reads:   Timing O_DIRECT disk reads:   
 40 MB in  3.01 seconds =  13.31 MB/sec
 52 MB in  3.03 seconds =  17.17 MB/sec
 52 MB in  3.04 seconds =  17.13 MB/sec
 46 MB in  3.08 seconds =  14.94 MB/sec
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo on Sparc All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum