| View previous topic :: View next topic |
| Author |
Message |
mrsaccess
n00b
Joined: 03 Sep 2005
Posts: 23
Location: Greece
|
 Posted: Thu Feb 01, 2007 10:49 am Post subject: |
 |
|
Hello, congratulations for this amazing piece of software you wrote!
I used it yesterday with very good results! The speedup was really big in apps that their libraries aren't usually loaded in my ram, ie wine and gtk apps. In kde apps (kde is my desktop so it's libraries are always in the ram) the speedup was small but noticeable. Also I noticed a nice speedup in apps that use the filesystem as a cache, for example digiKam which creates thumbnails of your photos in order to load faster.
Unfortunately I ran into a small -for my occasion- problem and I want to share it in case anyone else comes across it.
Before running shake I closed the X server and switched to a virtual terminal. From there I used shake to defrag my /:
My fstab line for / (and most of my partitions):
| Code: | | /dev/sda3 / reiserfs defaults,noatime,notail,user_xattr 0 1 |
Although noatime is used it worked well.
At some point of the process (I guess 1 to 2 hours after it started) the disk activity stopped entirely and my computer wouldn't accept any input except Alt+Fnumber to switch virtual terminals. Also it didn't respond to ssh connection attempts (but it responded to ping).
After a fair amount of waiting and since there wasn't any disk activity for many minutes I reset my computer.
Upon boot I had a kernel panic because the file /lib/libc.so.6, which is part of glibc, was corrupted. I guess that is what "froze" the pc in first place.
Luckily for me I had another machine with gentoo so I copied it's libc.so.6 to my machine and everything went fine. Till now I haven't noticed any other problems (emerging deep update world right now).
Unfortunately if someone hasn't another gentoo installation near will be in a difficult position as with a corrupted glibc you can't even chroot to your system from a livecd in order to fix things.
Hope my comments will help a bit. 
_________________
Hardware: The parts of your pc you can kick. |
|
| Back to top |
|
 |
98111
n00b
Joined: 23 Feb 2003
Posts: 41
Location: Lyon, France (aka un_brice )
|
| Posted: Thu Feb 01, 2007 11:46 am Post subject: |
|
|
You're right. And the problem is serious.
I'm really sorry about damaged systems. Hopefully, it should'nt occur on all libc, but that do not excuse me.
The problem is that writing to /lib/libc-2.4.so crash the system. Even if you respect the correct order (take a write lock, then shake, then release)(imho the write lock should be refused).
Difficulty is that, in order to ensure I spot the bug, I wrote a short code wich done that  . So my computer no longer boot.
If I remind well, older version of ld.so aquired a lock() on open libs. I don't know if the new behaviour is a bug or a feature, but shake need a workaround.
I have some ideas about it, but I first need to find a glibc guru. I must go now, but will do the update this evening (arround 19hour GMT).
I lack english words to ask you to forgive me. Thanks for your clear bugreport which allowed me to spot the problem. Also I hadn't the time to check for grammar and spelling... as you see 
Shame on me |
|
| Back to top |
|
|
mrsaccess
n00b
Joined: 03 Sep 2005
Posts: 23
Location: Greece
|
| Posted: Thu Feb 01, 2007 12:28 pm Post subject: |
|
|
I really appreciate your fast response to the problem report.
Don't worry for the "damage", no harm done! Besides I'm too happy with the result to care about libc.
PS. English isn't my native language so I have to worry about the mistakes I make instead noticing other people mistakes.
_________________
Hardware: The parts of your pc you can kick. |
|
| Back to top |
|
|
98111
n00b
Joined: 23 Feb 2003
Posts: 41
Location: Lyon, France (aka un_brice )
|
| Posted: Thu Feb 01, 2007 9:41 pm Post subject: |
|
|
Version 0.29 (tarball, Changelog, ebuild) is available an include a quick and dirty workaround.
Will investigate more and make a 0.30 release ASAP. |
|
| Back to top |
|
|
Dralnu
Veteran
Joined: 24 May 2006
Posts: 1919
|
| Posted: Thu Feb 01, 2007 10:27 pm Post subject: |
|
|
Something to think about would be to require the target fs to be unmounted (i.e. run it from a LiveCD). I would think there would be more problems running on a mounted FS then not, so that might be worth looking into.
_________________
The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
| Back to top |
|
|
getchoo
n00b
Joined: 19 Sep 2006
Posts: 38
Location: Alberta, Canada
|
| Posted: Thu Feb 08, 2007 5:48 am Post subject: |
|
|
I'd like to try this program, but it's giving me the following error:
| Code: |
tux shake-0.29 # ls
COPYING GPL.txt distrib executive.c executive.o judge.h linux.c main.c msg.h
Changelog Makefile doc executive.h judge.c judge.o linux.h msg.c unattr.c
tux shake-0.29 # make
gcc -std=gnu99 -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 -D_XOPEN_SOURCE=600 -O2 -D_POSIX_C_SOURCE=200112L -Wall -pedantic-errors -Wcast-align -Wpointer-arith -Wbad-function-cast -DVERSION=\"0.29\" -DNDEBUG -c linux.c -o linux.o
linux.c:23:43: error: attr/attributes.h: No such file or directory
linux.c: In function 'set_ptime':
linux.c:42: warning: implicit declaration of function 'attr_setf'
linux.c:43: error: 'ATTR_DONTFOLLOW' undeclared (first use in this function)
linux.c:43: error: (Each undeclared identifier is reported only once
linux.c:43: error: for each function it appears in.)
linux.c: In function 'get_ptime':
linux.c:55: warning: implicit declaration of function 'attr_getf'
linux.c:55: error: 'ATTR_DONTFOLLOW' undeclared (first use in this function)
make: *** [linux.o] Error 1
|
 |
|
| Back to top |
|
|
98111
n00b
Joined: 23 Feb 2003
Posts: 41
Location: Lyon, France (aka un_brice )
|
| Posted: Thu Feb 08, 2007 2:31 pm Post subject: |
|
|
| getchoo wrote: | I'd like to try this program, but it's giving me the following error:
| Code: | | linux.c:23:43: error: attr/attributes.h: No such file or directory |
|
Please install sys-apps/attr . You can also use the ebuild. |
|
| Back to top |
|
|
Jkay
Apprentice
Joined: 31 Dec 2002
Posts: 214
Location: thatched-roof cottages
|
| Posted: Sun Feb 25, 2007 6:23 am Post subject: |
|
|
Hi. I haven't used Shake since last summer, so I grabbed 0.29 and shook:
/home
/var/db/pkg
/var/cache/edb
/usr/portage
Am I missing any other directory which Portage makes a mess in?
I only ran Shake in non-system dirs, for now ... until things settle, and we're non-alpha!! Just getting
| Code: |
emerge --sync && emerge -uavDN world
|
to be a lot faster is good enough for now!!
Thanks again for the great work.
EDIT - I should mention that I have /var and /usr and /home and / all on separate hard drives or partitions. |
|
| Back to top |
|
|
Dralnu
Veteran
Joined: 24 May 2006
Posts: 1919
|
| Posted: Sun Feb 25, 2007 8:41 am Post subject: |
|
|
| Jkay wrote: | Hi. I haven't used Shake since last summer, so I grabbed 0.29 and shook:
/home
/var/db/pkg
/var/cache/edb
/usr/portage
Am I missing any other directory which Portage makes a mess in?
I only ran Shake in non-system dirs, for now ... until things settle, and we're non-alpha!! Just getting
| Code: |
emerge --sync && emerge -uavDN world
|
to be a lot faster is good enough for now!!
Thanks again for the great work.
EDIT - I should mention that I have /var and /usr and /home and / all on separate hard drives or partitions. |
I think /var/tmp and /tmp get messed up real good at times.
_________________
The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
| Back to top |
|
|
psyqil
Advocate
Joined: 26 May 2003
Posts: 2767
|
| Posted: Sun Feb 25, 2007 5:58 pm Post subject: |
|
|
| Dralnu wrote: | | I think /var/tmp and /tmp get messed up real good at times. |
I think those should be deleted rather than 'shaken'... |
|
| Back to top |
|
|
Dralnu
Veteran
Joined: 24 May 2006
Posts: 1919
|
| Posted: Sun Feb 25, 2007 6:44 pm Post subject: |
|
|
| psyqil wrote: | | Dralnu wrote: | | I think /var/tmp and /tmp get messed up real good at times. |
I think those should be deleted rather than 'shaken'... |
True, but he asked what he missed that portage makes a mess with. If you don't reboot all the time (like some of us), it could make a very minor diff 
_________________
The day Microsoft makes a product that doesn't suck, is the day they make a vacuum cleaner. |
|
| Back to top |
|
|
sobers_2002
Veteran
Joined: 16 Mar 2004
Posts: 1128
|
| Posted: Tue Mar 06, 2007 9:18 pm Post subject: |
|
|
| Dralnu wrote: | | Something to think about would be to require the target fs to be unmounted (i.e. run it from a LiveCD). I would think there would be more problems running on a mounted FS then not, so that might be worth looking into. |
that should be the case, but the problem reported by mrsaccess happened even when I ran it via livecd  I tried it with v0.28 on reiser4. I am not sure about the performance increase because I was too afraid to experiment after that corruption . If it's fixed in v0.29 I'll try it again and report back.
and it really does help to have another box of gentoo around
_________________
Pdict - dockable dictionary client for linux
FREE97WIN: Use this code on Dreamhost and you get $97 off !! |
|
| Back to top |
|
|
BoneKracker
Veteran
Joined: 14 Mar 2006
Posts: 1270
Location: U.S.A.
|
| Posted: Wed Mar 28, 2007 1:06 am Post subject: |
|
|
| This looks interesting. I am looking forward to a stable version. |
|
| Back to top |
|
|
mudrii
l33t
Joined: 26 Jun 2003
Posts: 789
Location: Singapore
|
| Posted: Fri Jul 13, 2007 4:15 am Post subject: |
|
|
Hei
Big Thx for grate pice of soft
Just waiting for 0.30
_________________
www.gentoo.ro |
|
| Back to top |
|
|
BoneKracker
Veteran
Joined: 14 Mar 2006
Posts: 1270
Location: U.S.A.
|
| Posted: Thu Jul 19, 2007 1:47 am Post subject: |
|
|
So what's the status? Have you "submitted it for inclusion in gentoo"?
_________________
Obama killed bin Laden like Nixon was the first man on the Moon. |
|
| Back to top |
|
|
AssociateX
Tux's lil' helper
Joined: 19 Feb 2004
Posts: 134
Location: North Dakota
|
| Posted: Sat Sep 15, 2007 2:53 pm Post subject: |
|
|
Trying it now... yippy, this is fun.
Is there a way to make the columns line up?
So the stuff for the following are really under them: IDEAL START END FRAGC CRUMBC AGE SHOCKED NAME
Thanks a ton!
_________________
AssociateX
Gentoo rocks! |
|
| Back to top |
|
|
tabascoz
n00b
Joined: 14 May 2003
Posts: 37
Location: Rio de Janeiro
|
| Posted: Sat Sep 15, 2007 11:48 pm Post subject: Shake and reiser4 2.6.22 |
|
|
Hi!
First, thanks for this great program !
I have been using shake with no problems in reiser4 until 2.6.22 series.
Shake gives errors like that in all files:
| Code: | | shake: /mnt/incoming//firmware/licencas/00059e80d0a1-v5_0-8186.dat: FIBMAP failed: Invalid argument |
I am using reiser4 + criptocompress + ragnarok-2.6.22-r1
i think this is a reiser4-related bug, in others partitions on the same system with ext3 i have no problems.
It can be fixed in a new version?
Thanks! |
|
| Back to top |
|
|
hitachi
Guru
Joined: 20 Feb 2006
Posts: 461
|
| Posted: Thu Oct 30, 2008 11:36 am Post subject: your file system needs you! |
|
|
And please remember: your file system needs you!
Like if you are using something on torrent, lets say downloading the debian bluray installation iso you might end up with one iso file separated in 79425794 pieces. Consider using cp the file from your scratch/torrents/ to where you want the file for future use instead of mv. Well I know you need to have the space on the disk an then to remove the original file but it might be worth it.
_________________
Athlon 64 X2 3800+
Micro-ATX-Mainboard in einer OEM-Version von Asus mit Nvidias nForce4 (A8NE-FM/S).
PEG-Grafikkarte von Leadtek mit Nvidia GeForce 6600
3 GB RAM
350-Watt-Netzteil (von Fortron/Source)
4 x 500GB S-ATA HDD (raid1 und raid5) |
|
| Back to top |
|
|
albright
Veteran
Joined: 16 Nov 2003
Posts: 1763
Location: Near Toronto
|
| Posted: Fri Oct 31, 2008 2:13 am Post subject: |
|
|
sorry here's a dumb question: how do I tell the extent of
fragmentation of a whole directory or partition?
(I know that fsck shows this but can I run this on a live
mounted filesystem?)
_________________
.... there is nothing - absolutely nothing - half so much worth
doing as simply messing about with Linux ...
(apologies to Kenneth Graeme) |
|
| Back to top |
|
|
a.b.
Apprentice
Joined: 23 Mar 2008
Posts: 218
Location: Anus Mundi, Germany
|
| Posted: Fri Oct 31, 2008 2:16 am Post subject: |
|
|
| albright wrote: |
(I know that fsck shows this but can I run this on a live
mounted filesystem?) |
|
|
| Back to top |
|
|
albright
Veteran
Joined: 16 Nov 2003
Posts: 1763
Location: Near Toronto
|
| Posted: Fri Oct 31, 2008 2:45 am Post subject: |
|
|
Thanks for not just saying RTFM (which would have
been fair enough I must admit)
_________________
.... there is nothing - absolutely nothing - half so much worth
doing as simply messing about with Linux ...
(apologies to Kenneth Graeme) |
|
| Back to top |
|
|
albright
Veteran
Joined: 16 Nov 2003
Posts: 1763
Location: Near Toronto
|
| Posted: Fri Oct 31, 2008 3:30 pm Post subject: |
|
|
this is getting off topic, but ...
that -n option works on ide drive but on sata there is
no report of fragmentation:
| Code: | wes64@gothmog ~ $ fsck -n -C /dev/sda5
fsck 1.41.2 (02-Oct-2008)
e2fsck 1.41.2 (02-Oct-2008)
Warning! /dev/sda5 is mounted.
Warning: skipping journal recovery because doing a read-only filesystem check.
/dev/sda5: clean, 473522/1531072 files, 2397328/3058366 blocks |
Also, everytime I run fsck -n on my ide notebook, it reports file system
errors (even after running fsck for real at bootup). I'm wondering if there
is a serious problem with this drive, or what.
Like this:
| Code: | wesfuj@thorin ~ $ fsck -n -C /dev/hda4
fsck 1.41.2 (02-Oct-2008)
e2fsck 1.41.2 (02-Oct-2008)
Warning! /dev/hda4 is mounted.
Warning: skipping journal recovery because doing a read-only filesystem check.
/dev/hda4 contains a file system with errors, check forced.
Pass 1: Checking inodes, blocks, and sizes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
Free blocks count wrong (3551097, counted=3551093).
Fix? no
Free inodes count wrong for group #679 (15354, counted=15357).
Fix? no
Free inodes count wrong (13278975, counted=13278964).
Fix? no
/dev/hda4: ********** WARNING: Filesystem still has errors **********
/dev/hda4: 631041/13910016 files (9.1% non-contiguous), 24257418/27808515 blocks |
_________________
.... there is nothing - absolutely nothing - half so much worth
doing as simply messing about with Linux ...
(apologies to Kenneth Graeme) |
|
| Back to top |
|
|
SlashBeast
Moderator
Joined: 23 May 2006
Posts: 2540
Location: Zduńska Wola, Poland.
|
| Posted: Fri Oct 31, 2008 3:56 pm Post subject: |
|
|
I tried to use this soft but..
| Code: | slashbeast@mizore build % ./shake ~/foo
./shake: /home/slashbeast/foo: FIBMAP failed: Operation not permitted |
Any idea? |
|
| Back to top |
|
|
gimpel
Advocate
Joined: 15 Oct 2004
Posts: 2718
Location: Munich, Bavaria
|
| Posted: Fri Oct 31, 2008 4:17 pm Post subject: |
|
|
| SlashBeast wrote: | I tried to use this soft but..
| Code: | slashbeast@mizore build % ./shake ~/foo
./shake: /home/slashbeast/foo: FIBMAP failed: Operation not permitted |
Any idea? |
| http://vleu.net/shake/ wrote: | How to use it ?
[...]
As root, call shake my_dir |
_________________
http://proaudio.tuxfamily.org/wiki - pro-audio software overlay
|
|
| Back to top |
|
|
|
Documentation, Tips & Tricks
