| View previous topic :: View next topic |
| Author |
Message |
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
 Posted: Fri Jun 15, 2007 9:03 am Post subject: New filesystem: Btrfs! |
 |
|
Hi,
Did anybody of you try Btrfs yet (it's still in early alpha stages, I know)? It's a filesystem that is being developed by Chris Mason, which has, or will have, about the same properties as ZFS (snapshots, checksums on data and metadata, fast filesystem checking, etc.)
I'm currently compiling kernel 2.6.21 (thats what it needs, 2.6.20 won't work), and will report back when I have it working.
See also:
http://oss.oracle.com/~mason/btrfs/
http://kerneltrap.org/node/8376
_________________
http://techfield.org
Last edited by frenkel on Sat May 16, 2009 10:59 am; edited 1 time in total |
|
| Back to top |
|
 |
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Fri Jun 15, 2007 9:40 am Post subject: |
|
|
I have it working. Didn't have any OOPS yet 
I put my portage tree on it, and it seems to work correctly. Performance isn't too bad either.
Let's hope this will develop into something like ZFS! |
|
| Back to top |
|
|
BlackEdder
Advocate
Joined: 26 Apr 2004
Posts: 2588
Location: Dutch enclave in Egham, UK
|
| Posted: Fri Jun 15, 2007 11:12 am Post subject: |
|
|
Keep us informed  |
|
| Back to top |
|
|
d2_racing
Bodhisattva
Joined: 25 Apr 2005
Posts: 13047
Location: Ste-Foy,Canada
|
| Posted: Fri Jun 15, 2007 11:33 am Post subject: |
|
|
| BlackEdder wrote: | | Keep us informed |
+1  |
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Fri Jun 15, 2007 11:58 am Post subject: |
|
|
| Ok, it's not as great yet as I thought. After an emerge --sync there appears to be some corruption (portage gives CacheCorruption errors.) Other than that, it works great, especially snapshotting is awesome to have at filesystem level |
|
| Back to top |
|
|
alexandervdm
n00b
Joined: 04 Jan 2007
Posts: 72
|
| Posted: Fri Jun 15, 2007 9:01 pm Post subject: |
|
|
Good thing data corruption is only a minor issue in filesystems.
J/k, keep up the good work  |
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Sun Jun 17, 2007 8:49 am Post subject: |
|
|
| Seems it was an mmap bug. The author is fixing it. |
|
| Back to top |
|
|
sschlueter
Guru
Joined: 26 Jul 2002
Posts: 578
Location: Dortmund, Germany
|
| Posted: Tue Jun 19, 2007 9:36 pm Post subject: |
|
|
| AforAlexander wrote: | | data corruption is only a minor issue in filesystems. |
Hilarious 
This definitely needs to become a famous signature quote |
|
| Back to top |
|
|
mudrii
l33t
Joined: 26 Jun 2003
Posts: 789
Location: Singapore
|
| Posted: Wed Jun 20, 2007 2:00 am Post subject: |
|
|
frenkel
you could try ZFS on FUSE
_________________
www.gentoo.ro |
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Wed Jun 20, 2007 7:10 am Post subject: |
|
|
| I don't like FUSE, and the ZFS implementation is very limited and slow. Btrfs is much better and faster, plus it's developed by Oracle. |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Thu Jun 21, 2007 9:46 am Post subject: |
|
|
| There is still some issue with corruption, so I can't look at that right now, we are first trying to find out where the corruption comes from. |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Sat Jun 23, 2007 6:36 pm Post subject: |
|
|
The corruptions bug was fixed, apparently it only showed up on 32bit systems, thats why the dev didn't find it at first.
Give it a try! |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
| Posted: Mon Jun 25, 2007 7:59 pm Post subject: |
|
|
is this fs actually writable ?
| Quote: | rsync -azurP --delete /usr/portage/ /test/
building file list ...
160400 files to consider
rsync: delete_file: rmdir "/test/default" failed: Operation not permitted (1)
./
.ebuild.x
1045133 100% 11.10MB/s 0:00:00 (xfer#1, to-check=160398/160400)
rsync: mkstemp "/test/..ebuild.x.fIoAHy" failed: Permission denied (13)
rsync: symlink "/test/distfiles" -> "/data/distfiles/" failed: Operation not permitted (1)
header.txt
121 100% 1.33kB/s 0:00:00 (xfer#2, to-check=160396/160400)
skel.ChangeLog
3666 100% 37.69kB/s 0:00:00 (xfer#3, to-check=160395/160400)
skel.ebuild
7176 100% 70.79kB/s 0:00:00 (xfer#4, to-check=160394/160400)
skel.metadata.xml
881 100% 8.69kB/s 0:00:00 (xfer#5, to-check=160393/160400)
.cache/
rsync: recv_generator: mkdir "/test/.cache" failed: Operation not permitted (1)
*** Skipping everything below this failed directory ***
app-accessibility/
rsync: recv_generator: mkdir "/test/app-accessibility" failed: Operation not permitted (1)
*** Skipping everything below this failed directory ***
app-admin/
rsync: recv_generator: mkdir "/test/app-admin" failed: Operation not permitted (1)
*** Skipping everything below this failed directory ***
|
| Quote: | | /dev/sdd6 on /test type btrfs (rw) |
using v0.4
thanks in advance
- this was just a small peak, I unforunately don't have the time to test it any deeper (but would like to, due to limited time)
keep on the good work 
this fs has potential
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004 |
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Tue Jun 26, 2007 8:12 am Post subject: |
|
|
| kernelOfTruth wrote: | is this fs actually writable ?
| Quote: | rsync -azurP --delete /usr/portage/ /test/
building file list ...
160400 files to consider
rsync: delete_file: rmdir "/test/default" failed: Operation not permitted (1)
./
.ebuild.x
1045133 100% 11.10MB/s 0:00:00 (xfer#1, to-check=160398/160400)
rsync: mkstemp "/test/..ebuild.x.fIoAHy" failed: Permission denied (13)
rsync: symlink "/test/distfiles" -> "/data/distfiles/" failed: Operation not permitted (1)
header.txt
121 100% 1.33kB/s 0:00:00 (xfer#2, to-check=160396/160400)
skel.ChangeLog
3666 100% 37.69kB/s 0:00:00 (xfer#3, to-check=160395/160400)
skel.ebuild
7176 100% 70.79kB/s 0:00:00 (xfer#4, to-check=160394/160400)
skel.metadata.xml
881 100% 8.69kB/s 0:00:00 (xfer#5, to-check=160393/160400)
.cache/
rsync: recv_generator: mkdir "/test/.cache" failed: Operation not permitted (1)
*** Skipping everything below this failed directory ***
app-accessibility/
rsync: recv_generator: mkdir "/test/app-accessibility" failed: Operation not permitted (1)
*** Skipping everything below this failed directory ***
app-admin/
rsync: recv_generator: mkdir "/test/app-admin" failed: Operation not permitted (1)
*** Skipping everything below this failed directory ***
|
| Quote: | | /dev/sdd6 on /test type btrfs (rw) |
using v0.4
thanks in advance
- this was just a small peak, I unforunately don't have the time to test it any deeper (but would like to, due to limited time)
keep on the good work
this fs has potential |
Direct in the root, you can create "sub file systems". By default there is only 1, named "default". Snapshots are also saved in this place. You should create a subfilesystem like this: btrfsctl -s portage /test. Then you can sync to /test/portage/
I don't know if the developer want's to keep it like this, I thought he was considering make a .snaps dir with the snapshots, and make the root normally writable, so you can use it as your / also.
Frank |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
| Posted: Tue Jun 26, 2007 8:32 am Post subject: |
|
|
Thanks, Frank,
now it finally worked
it seems to be pretty fast & efficient with space usage too:
| Quote: | /dev/sdd6 btrfs 4,7G 281M 4,4G 6% /test
/dev/sdc8 reiser4 152G 42G 111G 28% /data
/dev/sdc7 reiser4 4,5G 144M 4,3G 4% /usr/portage
|
that reiser4 partition on /usr/portage uses lzo1 compression, so the result should be just fine
this is the result with a normal formatted reiser4-partition:
| Quote: | | /dev/sdd6 reiser4 4,5G 215M 4,3G 5% /test |
ok, some other results:
reiserfs with -o noatime,nodiratime,data=writeback,commit=120
| Quote: | sent 83604570 bytes received 3137684 bytes 2040994.21 bytes/sec
total size is 173726829 speedup is 2.00
real 0m43.363s
user 0m21.172s
sys 0m23.407s
lexa-x86 bin # time sync
real 0m4.077s
user 0m0.001s
sys 0m0.356s |
reiser4 with -o noatime,nodiratime
| Quote: | sent 83604570 bytes received 3137684 bytes 2668992.43 bytes/sec
total size is 173726829 speedup is 2.00
real 0m32.423s
user 0m21.371s
sys 0m21.048s
lexa-x86 bin # time sync
real 0m5.703s
user 0m0.000s
sys 0m0.090s |
btrfs with -o noatime,nodiratime
| Quote: | 83604570 bytes received 3137684 bytes 2844008.33 bytes/sec
total size is 173726829 speedup is 2.00
real 0m30.625s
user 0m20.915s
sys 0m19.073s
lexa-x86 bin # time sync
real 0m1.883s
user 0m0.000s
sys 0m0.236s |
pretty impressive for it's state, I'm pretty sure it will get faster
- so it's already now faster than a default reiser4 partition (all data was in cache, so a pretty subjective test  )
given it's integrity checks & features it could develop into a strong competition of zfs ...
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004 |
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Tue Jun 26, 2007 8:36 am Post subject: |
|
|
And don't forget the snapshots! They work already, and it takes less than a second to create one
(Only problem there still is now, is that you can't remove subfilesystems and snapshots.... , you can, however delete everything from a snapshot or subfilesystem) |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
| Posted: Tue Jun 26, 2007 9:19 am Post subject: |
|
|
just noticed that data corruption somehow still exist:
| Quote: | [ 1385.605496] btrfs: sdd6 checksum verify failed on 4
[ 1385.605682] btrfs: sdd6 checksum verify failed on 12
[ 1385.605874] btrfs: sdd6 checksum verify failed on 11
[ 1395.229653] btrfs: sdd6 checksum verify failed on 10 |
one "wish":
it should be at least as efficient with space usage like jfs & reiserfs (space usage: jfs ~ reiserfsv3.6)
then this will be my filesystem of choice (since reiser4 unfortunately still has some little glitches, which should hopefully be fixed soon)
will test that out later ...
_________________
https://github.com/kernelOfTruth/ZFS-for-SystemRescueCD/tree/ZFS-for-SysRescCD-4.9.0
https://github.com/kernelOfTruth/pulseaudio-equalizer-ladspa
Hardcore Gentoo Linux user since 2004 |
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Tue Jun 26, 2007 9:24 am Post subject: |
|
|
| kernelOfTruth wrote: | just noticed that data corruption somehow still exist:
| Quote: | [ 1385.605496] btrfs: sdd6 checksum verify failed on 4
[ 1385.605682] btrfs: sdd6 checksum verify failed on 12
[ 1385.605874] btrfs: sdd6 checksum verify failed on 11
[ 1395.229653] btrfs: sdd6 checksum verify failed on 10 |
one "wish":
it should be at least as efficient with space usage like jfs & reiserfs (space usage: jfs ~ reiserfsv3.6)
then this will be my filesystem of choice (since reiser4 unfortunately still has some little glitches, which should hopefully be fixed soon)
will test that out later ... |
Those are checksums of some metadata (for the root), which aren't checksummed yet. Somebody created a patch for this, so that mkfs does this checksums. It will be in the next release I think. |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Fri Jun 29, 2007 8:55 am Post subject: |
|
|
| kernelOfTruth wrote: | is filesystem compression an option for this fs ?
(similar to reiser4) or will this be handled via kernel ? |
This isn't an option (yet?). What do you mean with "will this be handled via kernel?"? |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
|
| Back to top |
|
|
frenkel
Veteran
Joined: 13 May 2003
Posts: 1034
Location: .nl
|
| Posted: Fri Jun 29, 2007 10:05 am Post subject: |
|
|
| kernelOfTruth wrote: | | I refer to dm-crypt & cryptsetup-luks, device-mapper |
That's encryption, not compression... |
|
| Back to top |
|
|
kernelOfTruth
Watchman
Joined: 20 Dec 2005
Posts: 6111
Location: Vienna, Austria; Germany; hello world :)
|
|
| Back to top |
|
|
|
Gentoo Chat
