| View previous topic :: View next topic |
| Author |
Message |
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
 Posted: Tue Jun 27, 2006 5:53 am Post subject: strange slow ext3 performance? |
 |
|
Hi
I have ext3 on my complete system. now I am experiencing a strange problem here. I can download things to almost the maximum network speeds (10MB/s) however, when I am uploading things to other computers, things literally crawl. I get ~30KB/s kinds of speeds. What is going on??
thanks
Saurabh
_________________
Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
| Back to top |
|
 |
lxg
Veteran
Joined: 12 Nov 2005
Posts: 1019
Location: Aachen, Germany
|
| Posted: Tue Jun 27, 2006 8:16 am Post subject: |
|
|
May I ask why you do think that a slow upload is determined by a slow filesystem? Especially as downloading is mostly writing operations, while uploading is mostly reading. That doesn't sound as if the filesystem would be the bottleneck (at least from your description).
edit: btw: | Quote: | | I have ext3 on my complete system. |
| Quote: | | AMD Athlon2400+, reiser4, gcc3.4.4, glibc2.3.4, 2.6.16-beyond2 |
wtf??? 
_________________
lxg.de – codebits and tech talk |
|
| Back to top |
|
|
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
| Posted: Tue Jun 27, 2006 8:48 am Post subject: |
|
|
I just thought that might be the case. I can't think of any other reason.
also, the below description is my personal pc, and the one I am working on, an ultrasparc10 is lab computer
_________________
Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
| Back to top |
|
|
lxg
Veteran
Joined: 12 Nov 2005
Posts: 1019
Location: Aachen, Germany
|
| Posted: Tue Jun 27, 2006 9:10 am Post subject: |
|
|
| sobers_2002 wrote: | | I just thought that might be the case. I can't think of any other reason. |
Ok, if you really think it's your file system, please give the output of
| Code: | hdparm /dev/hda #or whatever the device is
hdparm -tT /dev/hda |
With which parameters did you create/configure the ext3 filesystems with? Did you ever consider switching to a faster file system (don't mean to flame )?
While you're at it, you might want to do a network benchmark with netio or netpipe (hope they aren't masked for SPARC).
_________________
lxg.de – codebits and tech talk |
|
| Back to top |
|
|
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
| Posted: Tue Jun 27, 2006 10:04 am Post subject: |
|
|
The problem of switching over is extremely complex. The cd-drive is fried and I am not allowed to get a new one instead. So shifting over to something like reiserfs isn't going to be possible, atleast for now.
| Code: | hdparm /dev/hda
/dev/hda:
multcount = 0 (off)
IO_support = 0 (default 16-bit)
unmaskirq = 0 (off)
using_dma = 1 (on)
keepsettings = 0 (off)
readonly = 0 (off)
readahead = 256 (on)
geometry = 39535/16/63, sectors = 20404101120, start = 0
|
and | Code: | hdparm -tT /dev/hda
/dev/hda:
Timing O_DIRECT cached reads: 580 MB in 2.00 seconds = 289.69 MB/sec
Timing O_DIRECT disk reads: 32 MB in 3.03 seconds = 10.57 MB/sec
|
Similar is the case for hdb. Note that this is as good a performance is possible as the ide controller (cmd646) doesn't allow for more than 16.7 mb/s (or something like that)  .
I'll report the netio results asap
_________________
Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
| Back to top |
|
|
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
| Posted: Tue Jun 27, 2006 10:13 am Post subject: |
|
|
here are the netio results
| Code: | NETIO - Network Throughput Benchmark, Version 1.26
(C) 1997-2005 Kai Uwe Rommel
TCP connection established.
Packet size 1k bytes: 10078 KByte/s Tx, 10020 KByte/s Rx.
Packet size 2k bytes: 10074 KByte/s Tx, 10023 KByte/s Rx.
Packet size 4k bytes: 10083 KByte/s Tx, 10043 KByte/s Rx.
Packet size 8k bytes: 10079 KByte/s Tx, 10040 KByte/s Rx.
Packet size 16k bytes: 10089 KByte/s Tx, 9998 KByte/s Rx.
Packet size 32k bytes: 10126 KByte/s Tx, 9995 KByte/s Rx.
Done.
|
those are when netio was run in server mode on the machine, and below are when it was in client mode
| Code: | NETIO - Network Throughput Benchmark, Version 1.26
(C) 1997-2005 Kai Uwe Rommel
TCP connection established.
Packet size 1k bytes: 10064 KByte/s Tx, 10039 KByte/s Rx.
Packet size 2k bytes: 10072 KByte/s Tx, 10053 KByte/s Rx.
Packet size 4k bytes: 10083 KByte/s Tx, 10070 KByte/s Rx.
Packet size 8k bytes: 10062 KByte/s Tx, 10083 KByte/s Rx.
Packet size 16k bytes: 10052 KByte/s Tx, 10081 KByte/s Rx.
Packet size 32k bytes: 10068 KByte/s Tx, 10077 KByte/s Rx.
Done.
|
I suppose both aren't needed but then I just reported them anyway 
_________________
Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
| Back to top |
|
|
lxg
Veteran
Joined: 12 Nov 2005
Posts: 1019
Location: Aachen, Germany
|
| Posted: Tue Jun 27, 2006 10:52 am Post subject: |
|
|
Ok, those netio figures look pretty much altright; so I agree that networking seems to work fine.
The hdparm figures look ok, too; although one could tweak a bit more. I have been working the ideas of this O'Reilly's article on my harddisks, and actually got a noticably increased performance. As for tweaking the ext3 file system, you might want to check this tutorial; funny thing it's been written by a mod from these very forums.
_________________
lxg.de – codebits and tech talk |
|
| Back to top |
|
|
Weeve
Retired Dev
Joined: 30 Oct 2002
Posts: 641
|
| Posted: Tue Jun 27, 2006 3:21 pm Post subject: |
|
|
| lx0 wrote: | | Did you ever consider switching to a faster file system (don't mean to flame )? |
Currently, no filesystems other than ext2 or ext3 are supported on SPARC so this couldn't be an option if you wanted it to be.
I do agree that I don't see this as being the most likely culprit in the bottleneck here |
|
| Back to top |
|
|
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
| Posted: Tue Jun 27, 2006 4:12 pm Post subject: |
|
|
@Weeve: reiserfs is there isn't it? kernel has the option, and the reiserfsprogs installed just fine.
I'll try the ext3 tips, had seen them on this forum's post quite some time ago, but I don't think that'll help. All the same i'll give it a try .
Any other possibilities here, other than that??
thanks
Saurabh
_________________
Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
| Back to top |
|
|
Weeve
Retired Dev
Joined: 30 Oct 2002
Posts: 641
|
| Posted: Tue Jun 27, 2006 4:18 pm Post subject: |
|
|
Yes the kernel option is available and reiserfsprogs exists in the tree. However you'll notice it is masked and this is due to problems users on SPARCs have experienced in the past with massive corrpution and data loss in their patitions. Reports have shown good to bad reiserfs experiences on SPARCs to be a 50/50 split, so we decided to mask it.
If you do decide to try it, you take your fate into your own hands  |
|
| Back to top |
|
|
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
|
| Back to top |
|
|
Weeve
Retired Dev
Joined: 30 Oct 2002
Posts: 641
|
| Posted: Tue Jun 27, 2006 4:36 pm Post subject: |
|
|
| Notice that reiserfs4 is not in ANY kernel that is unmasked in any way, shape or form for SPARCs in Gentoo. As its not considered stable (last I knew) on the architecture it is primarily developed on, I would highly NOT recommend even attempting it on your machine. |
|
| Back to top |
|
|
|
Gentoo on Sparc
