View previous topic :: View next topic |
Author |
Message |
mrsaccess n00b
Joined: 03 Sep 2005 Posts: 30 Location: Greece
|
Posted: Thu Feb 01, 2007 10:49 am Post subject: |
|
|
Hello, congratulations for this amazing piece of software you wrote!
I used it yesterday with very good results! The speedup was really big in apps that their libraries aren't usually loaded in my ram, ie wine and gtk apps. In kde apps (kde is my desktop so it's libraries are always in the ram) the speedup was small but noticeable. Also I noticed a nice speedup in apps that use the filesystem as a cache, for example digiKam which creates thumbnails of your photos in order to load faster.
Unfortunately I ran into a small -for my occasion- problem and I want to share it in case anyone else comes across it.
Before running shake I closed the X server and switched to a virtual terminal. From there I used shake to defrag my /:
My fstab line for / (and most of my partitions):
Code: | /dev/sda3 / reiserfs defaults,noatime,notail,user_xattr 0 1 |
Although noatime is used it worked well.
At some point of the process (I guess 1 to 2 hours after it started) the disk activity stopped entirely and my computer wouldn't accept any input except Alt+Fnumber to switch virtual terminals. Also it didn't respond to ssh connection attempts (but it responded to ping).
After a fair amount of waiting and since there wasn't any disk activity for many minutes I reset my computer.
Upon boot I had a kernel panic because the file /lib/libc.so.6, which is part of glibc, was corrupted. I guess that is what "froze" the pc in first place.
Luckily for me I had another machine with gentoo so I copied it's libc.so.6 to my machine and everything went fine. Till now I haven't noticed any other problems (emerging deep update world right now).
Unfortunately if someone hasn't another gentoo installation near will be in a difficult position as with a corrupted glibc you can't even chroot to your system from a livecd in order to fix things.
Hope my comments will help a bit. _________________ Hardware: The parts of your pc you can kick. |
|
Back to top |
|
|
98111 n00b
Joined: 23 Feb 2003 Posts: 41 Location: Lyon, France (aka un_brice )
|
Posted: Thu Feb 01, 2007 11:46 am Post subject: |
|
|
You're right. And the problem is serious.
I'm really sorry about damaged systems. Hopefully, it should'nt occur on all libc, but that do not excuse me.
The problem is that writing to /lib/libc-2.4.so crash the system. Even if you respect the correct order (take a write lock, then shake, then release)(imho the write lock should be refused).
Difficulty is that, in order to ensure I spot the bug, I wrote a short code wich done that . So my computer no longer boot.
If I remind well, older version of ld.so aquired a lock() on open libs. I don't know if the new behaviour is a bug or a feature, but shake need a workaround.
I have some ideas about it, but I first need to find a glibc guru. I must go now, but will do the update this evening (arround 19hour GMT).
I lack english words to ask you to forgive me. Thanks for your clear bugreport which allowed me to spot the problem. Also I hadn't the time to check for grammar and spelling... as you see
Shame on me |
|
Back to top |
|
|
mrsaccess n00b
Joined: 03 Sep 2005 Posts: 30 Location: Greece
|
Posted: Thu Feb 01, 2007 12:28 pm Post subject: |
|
|
I really appreciate your fast response to the problem report.
Don't worry for the "damage", no harm done! Besides I'm too happy with the result to care about libc.
PS. English isn't my native language so I have to worry about the mistakes I make instead noticing other people mistakes. _________________ Hardware: The parts of your pc you can kick. |
|
Back to top |
|
|
98111 n00b
Joined: 23 Feb 2003 Posts: 41 Location: Lyon, France (aka un_brice )
|
Posted: Thu Feb 01, 2007 9:41 pm Post subject: |
|
|
Version 0.29 (tarball, Changelog, ebuild) is available an include a quick and dirty workaround.
Will investigate more and make a 0.30 release ASAP. |
|
Back to top |
|
|
Dralnu Veteran
Joined: 24 May 2006 Posts: 1919
|
Posted: Thu Feb 01, 2007 10:27 pm Post subject: |
|
|
Something to think about would be to require the target fs to be unmounted (i.e. run it from a LiveCD). I would think there would be more problems running on a mounted FS then not, so that might be worth looking into. _________________ The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
Back to top |
|
|
getchoo n00b
Joined: 19 Sep 2006 Posts: 38 Location: Alberta, Canada
|
Posted: Thu Feb 08, 2007 5:48 am Post subject: |
|
|
I'd like to try this program, but it's giving me the following error:
Code: |
tux shake-0.29 # ls
COPYING GPL.txt distrib executive.c executive.o judge.h linux.c main.c msg.h
Changelog Makefile doc executive.h judge.c judge.o linux.h msg.c unattr.c
tux shake-0.29 # make
gcc -std=gnu99 -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 -D_XOPEN_SOURCE=600 -O2 -D_POSIX_C_SOURCE=200112L -Wall -pedantic-errors -Wcast-align -Wpointer-arith -Wbad-function-cast -DVERSION=\"0.29\" -DNDEBUG -c linux.c -o linux.o
linux.c:23:43: error: attr/attributes.h: No such file or directory
linux.c: In function 'set_ptime':
linux.c:42: warning: implicit declaration of function 'attr_setf'
linux.c:43: error: 'ATTR_DONTFOLLOW' undeclared (first use in this function)
linux.c:43: error: (Each undeclared identifier is reported only once
linux.c:43: error: for each function it appears in.)
linux.c: In function 'get_ptime':
linux.c:55: warning: implicit declaration of function 'attr_getf'
linux.c:55: error: 'ATTR_DONTFOLLOW' undeclared (first use in this function)
make: *** [linux.o] Error 1
|
|
|
Back to top |
|
|
98111 n00b
Joined: 23 Feb 2003 Posts: 41 Location: Lyon, France (aka un_brice )
|
Posted: Thu Feb 08, 2007 2:31 pm Post subject: |
|
|
getchoo wrote: | I'd like to try this program, but it's giving me the following error:
Code: | linux.c:23:43: error: attr/attributes.h: No such file or directory |
| Please install sys-apps/attr . You can also use the ebuild. |
|
Back to top |
|
|
Jkay Apprentice
Joined: 31 Dec 2002 Posts: 214 Location: thatched-roof cottages
|
Posted: Sun Feb 25, 2007 6:23 am Post subject: |
|
|
Hi. I haven't used Shake since last summer, so I grabbed 0.29 and shook:
/home
/var/db/pkg
/var/cache/edb
/usr/portage
Am I missing any other directory which Portage makes a mess in?
I only ran Shake in non-system dirs, for now ... until things settle, and we're non-alpha!! Just getting
Code: |
emerge --sync && emerge -uavDN world
|
to be a lot faster is good enough for now!!
Thanks again for the great work.
EDIT - I should mention that I have /var and /usr and /home and / all on separate hard drives or partitions. |
|
Back to top |
|
|
Dralnu Veteran
Joined: 24 May 2006 Posts: 1919
|
Posted: Sun Feb 25, 2007 8:41 am Post subject: |
|
|
Jkay wrote: | Hi. I haven't used Shake since last summer, so I grabbed 0.29 and shook:
/home
/var/db/pkg
/var/cache/edb
/usr/portage
Am I missing any other directory which Portage makes a mess in?
I only ran Shake in non-system dirs, for now ... until things settle, and we're non-alpha!! Just getting
Code: |
emerge --sync && emerge -uavDN world
|
to be a lot faster is good enough for now!!
Thanks again for the great work.
EDIT - I should mention that I have /var and /usr and /home and / all on separate hard drives or partitions. |
I think /var/tmp and /tmp get messed up real good at times. _________________ The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
Back to top |
|
|
psyqil Advocate
Joined: 26 May 2003 Posts: 2767
|
Posted: Sun Feb 25, 2007 5:58 pm Post subject: |
|
|
Dralnu wrote: | I think /var/tmp and /tmp get messed up real good at times. | I think those should be deleted rather than 'shaken'... |
|
Back to top |
|
|
Dralnu Veteran
Joined: 24 May 2006 Posts: 1919
|
Posted: Sun Feb 25, 2007 6:44 pm Post subject: |
|
|
psyqil wrote: | Dralnu wrote: | I think /var/tmp and /tmp get messed up real good at times. | I think those should be deleted rather than 'shaken'... |
True, but he asked what he missed that portage makes a mess with. If you don't reboot all the time (like some of us), it could make a very minor diff _________________ The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
Back to top |
|
|
sobers_2002 Veteran
Joined: 16 Mar 2004 Posts: 1128
|
Posted: Tue Mar 06, 2007 9:18 pm Post subject: |
|
|
Dralnu wrote: | Something to think about would be to require the target fs to be unmounted (i.e. run it from a LiveCD). I would think there would be more problems running on a mounted FS then not, so that might be worth looking into. |
that should be the case, but the problem reported by mrsaccess happened even when I ran it via livecd I tried it with v0.28 on reiser4. I am not sure about the performance increase because I was too afraid to experiment after that corruption . If it's fixed in v0.29 I'll try it again and report back.
and it really does help to have another box of gentoo around _________________ Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
Back to top |
|
|
Bones McCracker Veteran
Joined: 14 Mar 2006 Posts: 1611 Location: U.S.A.
|
Posted: Wed Mar 28, 2007 1:06 am Post subject: |
|
|
This looks interesting. I am looking forward to a stable version. |
|
Back to top |
|
|
mudrii l33t
Joined: 26 Jun 2003 Posts: 789 Location: Singapore
|
Posted: Fri Jul 13, 2007 4:15 am Post subject: |
|
|
Hei
Big Thx for grate pice of soft
Just waiting for 0.30 _________________ www.gentoo.ro |
|
Back to top |
|
|
Bones McCracker Veteran
Joined: 14 Mar 2006 Posts: 1611 Location: U.S.A.
|
Posted: Thu Jul 19, 2007 1:47 am Post subject: |
|
|
So what's the status? Have you "submitted it for inclusion in gentoo"? _________________
patrix_neo wrote: | The human thought: I cannot win.
The ratbrain in me : I can only go forward and that's it. |
|
|
Back to top |
|
|
AssociateX Tux's lil' helper
Joined: 19 Feb 2004 Posts: 134 Location: North Dakota
|
Posted: Sat Sep 15, 2007 2:53 pm Post subject: |
|
|
Trying it now... yippy, this is fun.
Is there a way to make the columns line up?
So the stuff for the following are really under them: IDEAL START END FRAGC CRUMBC AGE SHOCKED NAME
Thanks a ton! _________________ AssociateX
Gentoo rocks! |
|
Back to top |
|
|
tabascoz n00b
Joined: 14 May 2003 Posts: 45 Location: Rio de Janeiro
|
Posted: Sat Sep 15, 2007 11:48 pm Post subject: Shake and reiser4 2.6.22 |
|
|
Hi!
First, thanks for this great program !
I have been using shake with no problems in reiser4 until 2.6.22 series.
Shake gives errors like that in all files:
Code: | shake: /mnt/incoming//firmware/licencas/00059e80d0a1-v5_0-8186.dat: FIBMAP failed: Invalid argument |
I am using reiser4 + criptocompress + ragnarok-2.6.22-r1
i think this is a reiser4-related bug, in others partitions on the same system with ext3 i have no problems.
It can be fixed in a new version?
Thanks! |
|
Back to top |
|
|
hitachi Guru
Joined: 20 Feb 2006 Posts: 478 Location: Freiburg / Deutschland
|
Posted: Thu Oct 30, 2008 11:36 am Post subject: your file system needs you! |
|
|
And please remember: your file system needs you!
Like if you are using something on torrent, lets say downloading the debian bluray installation iso you might end up with one iso file separated in 79425794 pieces. Consider using cp the file from your scratch/torrents/ to where you want the file for future use instead of mv. Well I know you need to have the space on the disk an then to remove the original file but it might be worth it. |
|
Back to top |
|
|
albright Advocate
Joined: 16 Nov 2003 Posts: 2588 Location: Near Toronto
|
Posted: Fri Oct 31, 2008 2:13 am Post subject: |
|
|
sorry here's a dumb question: how do I tell the extent of
fragmentation of a whole directory or partition?
(I know that fsck shows this but can I run this on a live
mounted filesystem?) _________________ .... there is nothing - absolutely nothing - half so much worth
doing as simply messing about with Linux ...
(apologies to Kenneth Graeme) |
|
Back to top |
|
|
a.b. Apprentice
Joined: 23 Mar 2008 Posts: 218 Location: Anus Mundi, Germany
|
Posted: Fri Oct 31, 2008 2:16 am Post subject: |
|
|
albright wrote: |
(I know that fsck shows this but can I run this on a live
mounted filesystem?) |
|
|
Back to top |
|
|
albright Advocate
Joined: 16 Nov 2003 Posts: 2588 Location: Near Toronto
|
Posted: Fri Oct 31, 2008 2:45 am Post subject: |
|
|
Thanks for not just saying RTFM (which would have
been fair enough I must admit) _________________ .... there is nothing - absolutely nothing - half so much worth
doing as simply messing about with Linux ...
(apologies to Kenneth Graeme) |
|
Back to top |
|
|
albright Advocate
Joined: 16 Nov 2003 Posts: 2588 Location: Near Toronto
|
Posted: Fri Oct 31, 2008 3:30 pm Post subject: |
|
|
this is getting off topic, but ...
that -n option works on ide drive but on sata there is
no report of fragmentation:
Code: | wes64@gothmog ~ $ fsck -n -C /dev/sda5
fsck 1.41.2 (02-Oct-2008)
e2fsck 1.41.2 (02-Oct-2008)
Warning! /dev/sda5 is mounted.
Warning: skipping journal recovery because doing a read-only filesystem check.
/dev/sda5: clean, 473522/1531072 files, 2397328/3058366 blocks |
Also, everytime I run fsck -n on my ide notebook, it reports file system
errors (even after running fsck for real at bootup). I'm wondering if there
is a serious problem with this drive, or what.
Like this:
Code: | wesfuj@thorin ~ $ fsck -n -C /dev/hda4
fsck 1.41.2 (02-Oct-2008)
e2fsck 1.41.2 (02-Oct-2008)
Warning! /dev/hda4 is mounted.
Warning: skipping journal recovery because doing a read-only filesystem check.
/dev/hda4 contains a file system with errors, check forced.
Pass 1: Checking inodes, blocks, and sizes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
Free blocks count wrong (3551097, counted=3551093).
Fix? no
Free inodes count wrong for group #679 (15354, counted=15357).
Fix? no
Free inodes count wrong (13278975, counted=13278964).
Fix? no
/dev/hda4: ********** WARNING: Filesystem still has errors **********
/dev/hda4: 631041/13910016 files (9.1% non-contiguous), 24257418/27808515 blocks |
_________________ .... there is nothing - absolutely nothing - half so much worth
doing as simply messing about with Linux ...
(apologies to Kenneth Graeme) |
|
Back to top |
|
|
SlashBeast Retired Dev
Joined: 23 May 2006 Posts: 2922
|
Posted: Fri Oct 31, 2008 3:56 pm Post subject: |
|
|
I tried to use this soft but..
Code: | slashbeast@mizore build % ./shake ~/foo
./shake: /home/slashbeast/foo: FIBMAP failed: Operation not permitted |
Any idea? |
|
Back to top |
|
|
gimpel Advocate
Joined: 15 Oct 2004 Posts: 2720 Location: Munich, Bavaria
|
Posted: Fri Oct 31, 2008 4:17 pm Post subject: |
|
|
SlashBeast wrote: | I tried to use this soft but..
Code: | slashbeast@mizore build % ./shake ~/foo
./shake: /home/slashbeast/foo: FIBMAP failed: Operation not permitted |
Any idea? |
http://vleu.net/shake/ wrote: | How to use it ?
[...]
As root, call shake my_dir |
_________________ http://proaudio.tuxfamily.org/wiki - pro-audio software overlay
|
|
Back to top |
|
|
as.gentoo Guru
Joined: 07 Aug 2004 Posts: 319
|
Posted: Mon Aug 08, 2016 7:42 pm Post subject: |
|
|
Code: | $> shake --pretend foo.bin
shake: foo.bin: FIBMAP failed: Operation not permitted | Maybe "You have to execute shake as root" would be a more meaningful error message.
If it's root only, shouldn't it be placed into /usr/sbin?
Code: | $> which shake
/usr/bin/shake |
Well, the website says
Code: | […]
Short version
As root, call shake my_dir , and go do something usefull or pleasant until it completes.
[…] | IMHO the man page should point out that you can only use it as root! |
|
Back to top |
|
|
|