View previous topic :: View next topic |
Author |
Message |
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
neuron Advocate
Joined: 28 May 2002 Posts: 2371
|
Posted: Mon Feb 16, 2009 10:12 am Post subject: |
|
|
DigitalCorpus wrote: | Accessing just source code or mostly source code? If you have a HDD partitioned for special purposes to help with performance and have just your source code on one I'd suggest backing it up and reformatting with the following additional options
Code: | fibration=dot_o_fibre,cluster=8K | This will organize the files better for compiling purposes and allow finer grained access to chunks/clusters of files which should help out a bit on performance |
Hm, it is mostly configuration files and source code in my home directory, I store all multimedia files elsewhere, whats the default cluster size? And if it's auto calculated, is there any way of finding out? Reducing it seems like a very obvius way of decreasing latency problems, but if the default is 4k I might hold back on it
DigitalCorpus wrote: | neuron wrote: | I'm using device mapper encryption however, could be they dont mix all that well. I realized ext4+luks seems to have way less latency issues than r4+luks does on my system. With ext4 I can barely notice, with r4 my mouse occasionally stops moving.
Note that these are drives on the same system, but different partitions, so the results are not directly comparable. |
Read a couple posts up. kernelOfTruth notes that r4+luks don't mix well. I don't have experience with that so I cannot comment on performance or stability. It would be reason to assume that adding additional encryption, especially software based will hurt performance a lot. I will add two more cents to say that from experience, if you have a crash on a Reiser4 + cryptcompress system, any files in that FS that are being accessed will be orphaned. If they are crucial files for boot or what have you, then hope you have a backup because it is painful to try and sort through them. Adding excryption on top of that could cause some more serious problems. |
I dont see a technical reason why using r4 on dm should be any different than any other filesystem, especially stability wise. I'm on 2.6.29-rc5, so I have barrier support etc on the underlaying device, and monitoring cpu usage while writing/reading I'm not maxing any of the cpu's out.
I'm very seriously considering dropping encryption on the volume, and symlinking specific files to an encrypted directory instead, I dont need most of that gpl code encrypted anyway |
|
Back to top |
|
|
neuron Advocate
Joined: 28 May 2002 Posts: 2371
|
Posted: Mon Feb 16, 2009 10:18 am Post subject: |
|
|
It occurred to me I haven't really run any tests since switching to that kernel, I'll do some work and see if I still have problems.
Still interested in ways to improve things ofc |
|
Back to top |
|
|
DigitalCorpus Apprentice
Joined: 30 Jul 2007 Posts: 283
|
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
Mr. Tao Tux's lil' helper
Joined: 20 Jul 2007 Posts: 147
|
Posted: Fri Feb 27, 2009 7:02 pm Post subject: Kernel BUG with zen 2.6.29-rc2 |
|
|
I've put R4 under some load with μTorrent and I've got lots of nasty looking messages in log. I will try 2.6.29_rc5-r1 asap, yet it may take some time before I could reboot this machine. I remember that I had better experience with R4 in similar conditions before. |
|
Back to top |
|
|
dusanc Apprentice
Joined: 19 Sep 2005 Posts: 248 Location: Serbia
|
Posted: Fri Feb 27, 2009 7:59 pm Post subject: |
|
|
Disk full?
What does fsck.reiser4(1.0.7) say?
Reproducible?
Can you please report your findings to reiserfs-devel@vger.kernel.org, Edward is interested in what might be causing this? _________________ Reiser4 Gentoo FAQ [25Dec2016] |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
Mr. Tao Tux's lil' helper
Joined: 20 Jul 2007 Posts: 147
|
Posted: Fri Feb 27, 2009 9:12 pm Post subject: |
|
|
kernelOfTruth wrote: | dusanc wrote: | Disk full?
What does fsck.reiser4(1.0.7) say?
Reproducible?
Can you please report your findings to reiserfs-devel@vger.kernel.org, Edward is interested in what might be causing this? |
but it also might be some bug triggered by wine and/or uTorrent
how was the memory or swap status at that time ?
still enough memory and swap available ? |
I'm sure there was cca ½ TB free disk space on given Reiser4 partition. Also RAM shouldn't be the problem here. Last time I checked (and these symptoms were already present), compcache was like 10 % full.
Since I can't fsck this partition remotely I'll post results during weekend. |
|
Back to top |
|
|
DigitalCorpus Apprentice
Joined: 30 Jul 2007 Posts: 283
|
Posted: Fri Feb 27, 2009 10:51 pm Post subject: |
|
|
Why would you use Reiser4 on a partition for torrenting? Yeah there are a lot of small reads and writes, but even if you have a connection like 30 Mbps, you shouldn't be seeing any performance increase. Plus R4 is great because of packing clusters with small files. Torrenting is usually fll of large (100MiB+) files and that is a known weak spot with R4. _________________ Atlas (HDTV PVR, HTTP & Media server)
http://mobrienphotography.com/ |
|
Back to top |
|
|
Mr. Tao Tux's lil' helper
Joined: 20 Jul 2007 Posts: 147
|
Posted: Sat Feb 28, 2009 12:36 pm Post subject: |
|
|
Here is output of fsck. Going to --build-fs now.
DigitalCorpus wrote: | Why would you use Reiser4 on a partition for torrenting? Yeah there are a lot of small reads and writes, but even if you have a connection like 30 Mbps, you shouldn't be seeing any performance increase. Plus R4 is great because of packing clusters with small files. Torrenting is usually fll of large (100MiB+) files and that is a known weak spot with R4. | I don't do any ubergeek tuning of R4 to achieve negligible performance gain nor do I have separate partition/drive for any specific purpose. I'd like to have R4 as general purpose FS. Yes, during years there were crashes, especially problem with loop files costed me few days, but I developed some relation . After listening to grinding HDs with eg ext3 it was love at first hear. |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
Mr. Tao Tux's lil' helper
Joined: 20 Jul 2007 Posts: 147
|
|
Back to top |
|
|
edward_ n00b
Joined: 28 Feb 2009 Posts: 4
|
Posted: Sat Feb 28, 2009 4:25 pm Post subject: |
|
|
DigitalCorpus wrote: | Why would you use Reiser4 on a partition for torrenting? Yeah there are a lot of small reads and writes, but even if you have a connection like 30 Mbps, you shouldn't be seeing any performance increase. Plus R4 is great because of packing clusters with small files. Torrenting is usually fll of large (100MiB+) files and that is a known weak spot with R4. |
Torrenting should be fine with compressed reiser4 partition.
if an application (like torrent) does expanded truncate of a
newly created file, then most likely that this file will be filled
by binary incompressible data, so FILE-level plugin dispatcher
passes management to the unix-file plugin forever, i.e. large
torrent files will be organized by extents (not by fragments)
and compression won't be involved. |
|
Back to top |
|
|
edward_ n00b
Joined: 28 Feb 2009 Posts: 4
|
Posted: Sat Feb 28, 2009 4:34 pm Post subject: |
|
|
Please, send all bugreports and related stuff to the reiserfs-devel
mailing list in the future. Let's keep it in one place..
Thanks. |
|
Back to top |
|
|
edward_ n00b
Joined: 28 Feb 2009 Posts: 4
|
Posted: Sat Feb 28, 2009 5:08 pm Post subject: |
|
|
Mr. Tao wrote: | Nice summary. I just would like to add that after experimenting with loop files on R4 a lot (different kernels and machines) I wouldn't recommend this for serious use (like portage or ccache). It always led to problems, sometimes fatal, at least for me. Typical symptoms are long syncs (in order of tenths of minutes) ocassionaly ending with on-loop fs corruption as fatal that it couldn't be recovered by fsck. Since I gave up and use separate partitions for used-to-be-in-loop-file content I'm very satisfied with Reiser4 |
Loopback functionality over compressed files is fixed in the latest
stuff by this patch:
http://userweb.kernel.org/~akpm/mmotm/broken-out/reiser4-adjust-to-the-new-aops.patch
Not everything is ok, though: I still have lockups under heavy load,
however, long sync and fs corruption problems should be gone. |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
|
Back to top |
|
|
Mr. Tao Tux's lil' helper
Joined: 20 Jul 2007 Posts: 147
|
Posted: Sat Feb 28, 2009 8:29 pm Post subject: |
|
|
kernelOfTruth wrote: | Hi Edward,
it's nice to see you here in the gentoo forums
thanks for your continued work on Reiser4 and reiserfs
| ++
Glad to hear about loops. I got new machine (which I haven't managed to install yet because Nvidia's MCP7A integrated LAN doesn't work with sysresccd) so probably I'm going to give it a try soon. |
|
Back to top |
|
|
DigitalCorpus Apprentice
Joined: 30 Jul 2007 Posts: 283
|
Posted: Sat Feb 28, 2009 8:37 pm Post subject: |
|
|
kernelOfTruth wrote: | Mr. Tao wrote: | After listening to grinding HDs with eg ext3 it was love at first hear. |
I feel you
for me it was the experiences with (especially) XFS and ext3 |
Depends on the drive too, but I know the feeling. I still use XFS though as it has provided better performance for the work I'm doing with HD TV. _________________ Atlas (HDTV PVR, HTTP & Media server)
http://mobrienphotography.com/ |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
Posted: Mon Mar 02, 2009 9:36 pm Post subject: |
|
|
some advice:
* if you use reiser4 on your / (root) partition - you shouldn't set fully preemptive kernel
only select voluntary preemption
-> don't use it
* preemptible rcu also isn't too well
-> might trigger hardlocks at boot-up (probably not anymore but who knows in the future)
-> don't use
both, if selected, might cause corruptions of your filesystem which are mostly fixable but easily omittable by obeying these steps
fully preemption often is triggering cbk cache BUGs for me _________________ https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004 |
|
Back to top |
|
|
edward_ n00b
Joined: 28 Feb 2009 Posts: 4
|
Posted: Tue Mar 03, 2009 6:46 pm Post subject: |
|
|
kernelOfTruth wrote: | some advice:
* if you use reiser4 on your / (root) partition - you shouldn't set fully preemptive kernel
only select voluntary preemption
-> don't use it
* preemptible rcu also isn't too well
-> might trigger hardlocks at boot-up (probably not anymore but who knows in the future)
-> don't use
both, if selected, might cause corruptions of your filesystem which are mostly fixable but easily omittable by obeying these steps
fully preemption often is triggering cbk cache BUGs for me |
Please make sure if it takes place with the latest stuff:
http://www.kernel.org/pub/linux/kernel/people/edward/reiser4/reiser4-for-2.6/reiser4-for-2.6.28.patch.gz
If so, please, catch and send the oops messages. |
|
Back to top |
|
|
tkhemili78 n00b
Joined: 31 Jul 2007 Posts: 38 Location: Eastern US
|
Posted: Wed Mar 04, 2009 4:10 pm Post subject: |
|
|
KernelOfTruth Wrote:
Quote: | It's a shame that reiser4 every now and then is being tried to be "killed" (no pun intended) just because of some personal hard feelings against Hans
did the filesystem do anything wrong ?
if you've read through all reiser4 documentation and compared it to the other filesystems of its time you'll recognize that it is/was sure ahead of its time including
lots of nicely thought out ideas which make it pretty efficient in several areas |
I completely agree, I really began to like what I saw in ver 4. I doubt it will ever leave the ground for too much opposition. Such bittersweet. Someone brilliant develops a new fs that is just groundbreaking, but then is sent to prison before it can be included in the kernel w/o patching.[/quote] |
|
Back to top |
|
|
yngwin Retired Dev
Joined: 19 Dec 2002 Posts: 4572 Location: Suzhou, China
|
Posted: Wed Mar 04, 2009 9:47 pm Post subject: |
|
|
kernelOfTruth wrote: | * if you use reiser4 on your / (root) partition - you shouldn't set fully preemptive kernel
* preemptible rcu also isn't too well
-> might trigger hardlocks at boot-up (probably not anymore but who knows in the future)
both, if selected, might cause corruptions of your filesystem which are mostly fixable but easily omittable by obeying these steps
fully preemption often is triggering cbk cache BUGs for me |
I have no such problems here, and have been using pre-empt for a long time now. _________________ "Those who deny freedom to others deserve it not for themselves." - Abraham Lincoln
Free Culture | Defective by Design | EFF |
|
Back to top |
|
|
kernelOfTruth Watchman
Joined: 20 Dec 2005 Posts: 6111 Location: Vienna, Austria; Germany; hello world :)
|
Posted: Wed Mar 04, 2009 10:41 pm Post subject: |
|
|
yngwin wrote: | kernelOfTruth wrote: | * if you use reiser4 on your / (root) partition - you shouldn't set fully preemptive kernel
* preemptible rcu also isn't too well
-> might trigger hardlocks at boot-up (probably not anymore but who knows in the future)
both, if selected, might cause corruptions of your filesystem which are mostly fixable but easily omittable by obeying these steps
fully preemption often is triggering cbk cache BUGs for me |
I have no such problems here, and have been using pre-empt for a long time now. |
hm, so it's perhaps because I'm using proprietary graphics drivers ?
amd catalyst drivers are causing me a much headache (no preemptible rcu, no fully preemption, no really working PAT, ...)
all of those is causing BUGs, hangs, whatever
this might be the reason reiser4 is suffering and causing problems
@edward:
I'll try vanilla + reiser4-patch in the weekend - if I find time - or during the next weeks
and will then post the error messages on reiserfs-devel / reiserfs mailing list if they still occur
currently I'm using zen-sources 2.6.28-zen10
thanks ! _________________ https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004 |
|
Back to top |
|
|
|