FuseCompress - compressed filesystem overlay.

neuron · Advocate Joined: 28 May 2002 Posts: 2371

FuseCompress is a compression filesystem, simply mount and go and every file you store there will be compressed.

URL : http://www.miio.net/fusecompress/
svn url : http://svn.berlios.de/svnroot/repos/fusecompress/trunk
(the svn is a LOT more up to date than the latest release is, highly recomended).

This fuse filesystem is a merge between Milan Svoboda's fusecompress implementation and my (Anders Aagaard) lzofs implementation (https://forums.gentoo.org/viewtopic-t-388855-highlight-lzofs.html). It is a LOT more robust and "simpler" than my lzofs, and it survives far more tests than lzofs ever did.

To test:

neuron · Advocate Joined: 28 May 2002 Posts: 2371

Making usefull bugreports:
If something goes wrong the first thing you can do is check /var/log/syslog or the output from fusecomp. It should have some info on where it failed.

Another extreamly helpfull thing is to run it with core dumps enabled (if you manage to get it to crash):
ulimit -c unlimited
fusecomp /a /b
(and to turn coredumps off afterwards do ulimit -c 0)

This'll produce a core.$PID file, which we can get a lot of info from (if your interested yourself do gdb --core=`ls -1 core.*` fusecomp and write bt (backtrace))

drescherjm · Posted: Fri Nov 25, 2005 6:15 pm Post subject:

Is the new version incompatible with FuseCompress-0.6.1? When I tried to mount some data I was testing and I got a segmentation fault in fusecompress:

neuron · Advocate Joined: 28 May 2002 Posts: 2371

Is this the svn version? I'd REALLY use svn instead of 0.6.2, as a LOT of code changes has been done since then, and tons of code has been rewritten. So bugreports for 0.6.2 isn't worth much unfortunatly. If this is the svn, then mail me a coredump (aagaande@gmail.com) and then wipe the directory and see if you can reproduce it without having old files around. I'm not 100% sure if we're compatible with the older versions or not.

//edit, most likely we're not compatible, but it still shouldn't cause segfaults.

drescherjm · Posted: Fri Nov 25, 2005 6:35 pm Post subject:

This was the svn code from a few minutes ago.

Dumb question. I'm not getting a coredump, at least it is not in the current folder. How do I fix this??
_________________
John

My gentoo overlay
Instructons for overlay

neuron · Advocate Joined: 28 May 2002 Posts: 2371

see my post number two, you have to set ulimit first to allow it.

drescherjm · Posted: Fri Nov 25, 2005 6:45 pm Post subject:

Sorry, I missed that. :oops:

_________________
John

My gentoo overlay
Instructons for overlay

drescherjm · Posted: Fri Nov 25, 2005 7:06 pm Post subject:

I believe the error was caused by specifying ../.. in the path instead of an absolute path. The following did not crash (these are the same folders):

neuron · Advocate Joined: 28 May 2002 Posts: 2371

ah, brilliant, I'll add that to the original post

neuron · Advocate Joined: 28 May 2002 Posts: 2371

quite big changes in the svn. In the merge we had two database systems, they've now been merged to one. Which should increase performance a LOT (it does half as many searches). Also there is no thread polling in the background now, which should also increase performance considerably. That means files that arn't compressed (if your mounting over an old directory) wont be immediatly compressed. But the first time they are opened they will be.

neuron · Advocate Joined: 28 May 2002 Posts: 2371

new stable version out 0.8, a TON of chances has been done, this is getting quite usable

, no known bugs.

drescherjm · Posted: Fri Dec 16, 2005 4:08 pm Post subject:

Any way to select the compressor yet? Also is there a way to see the compression levels of the files with the fusecompress mounted?

I'd like to see a way to possibly schedule a cron job that would compress (possibly recompress) some files using the compessor I choose. In most cases this would be the one that is most likely to produce the tightest compression.
_________________
John

My gentoo overlay
Instructons for overlay

neuron · Advocate Joined: 28 May 2002 Posts: 2371

drescherjm · Posted: Fri Dec 16, 2005 4:34 pm Post subject:

drescherjm · Posted: Tue Jan 10, 2006 4:02 pm Post subject:

Please add log.h to the repository when you get a chance. Sorry if this was too quick after the latest update...

mauricev · Apprentice Joined: 22 Mar 2004 Posts: 197

Seems that this software is in active development, with a new version released just 2 weeks ago. Is anyone using it? If my understanding is correct, it's an overlay, so that means it doesn't actually implement a filesystem, but overlays an existing one. It's not clear if it supports all the common Linux filesystems (e.g., ext3, reiserfs, jfs, xfs) or not.

neuron · Advocate Joined: 28 May 2002 Posts: 2371

kernelOfTruth · Posted: Sun May 20, 2012 3:26 pm Post subject:

dig dig dig

anyone uses this filesystem ?

if yes - from what overlay ?

as a sideeffect that I currently can't buy bigger harddrives I'm forced to get a filesystem with reasonable performance and compression (preferrably lzma)

there's version 2.6 in the zugaina overlay (http://gpo.zugaina.org/sys-fs/fusecompress/ChangeLog)

but that looks rather old when comparing with 0.9.x (http://code.google.com/p/fusecompress/)

thanks !
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa

Hardcore Gentoo Linux user since 2004

neuron · Advocate Joined: 28 May 2002 Posts: 2371

Performance wize I'd strongly recomend going btrfs+lzma instead of fusecompress. Fusecompress is going through fuse (!), and the performance is therefor limited.

(On a side note, I wrote quite a bit of patches for 0.9 dealing with performance, and I used it on the portage tree and on usb storage with great success).

kernelOfTruth · Posted: Sun May 20, 2012 6:24 pm Post subject: