Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
New filesystem: Btrfs!
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2, 3, ... 24, 25, 26  Next  
This topic is locked: you cannot edit posts or make replies.    Gentoo Forums Forum Index Gentoo Chat
View previous topic :: View next topic  
Author Message
zxy
Veteran
Veteran


Joined: 06 Jan 2006
Posts: 1160
Location: in bed in front of the computer

PostPosted: Fri Jun 29, 2007 10:09 am    Post subject: Reply with quote

Though, the compression would be a cool feature. Is it planned/possible?
_________________
Nature does not hurry, yet everything is accomplished.
Lao Tzu
Back to top
View user's profile Send private message
frenkel
Veteran
Veteran


Joined: 13 May 2003
Posts: 1034
Location: .nl

PostPosted: Fri Jun 29, 2007 10:10 am    Post subject: Reply with quote

Yeah, I know ZFS has compression. I think it's not the main focus of the developers to be a ZFS competitior, it's more that they wanted a good COW (copy-on-write) filesystem for Linux, with the ability to create snapshots and checksumming of every block. Maybe in the future, when it has become more mature, they will implement compression.

I just wrote the btrfs-devel mailing list, lets see what the developer have to say...
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Fri Jun 29, 2007 10:45 am    Post subject: Reply with quote

just found out that it isn't as efficient as jfs & reiserfs

http://forums.gentoo.org/viewtopic-p-4118224.html#4118224

it uses 20-30 MBs more than reiserfs on the portage partition (only tested reiserfs, didn't want to wait on jfs, it takes generally some time longer to write & read),

do you think this can still be improved or is this part of development already finished ?
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
frenkel
Veteran
Veteran


Joined: 13 May 2003
Posts: 1034
Location: .nl

PostPosted: Fri Jun 29, 2007 10:49 am    Post subject: Reply with quote

kernelOfTruth wrote:
just found out that it isn't as efficient as jfs & reiserfs

http://forums.gentoo.org/viewtopic-p-4118224.html#4118224

it uses 20-30 MBs more than reiserfs on the portage partition (only tested reiserfs, didn't want to wait on jfs, it takes generally some time longer to write & read),

do you think this can still be improved or is this part of development already finished ?

I don't know, but I do know, that reiserfs doesn't have checksums and that it isn't COW, that stuff takes up space also. For example, the checksums take 32byte per block.
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Fri Jun 29, 2007 11:32 am    Post subject: Reply with quote

To get back on topic: are there some ebuilds available for btrfs and btrfs-progs?
Just moved my portage to btrfs to have some real world results. All I can say is *gasp*

Rei
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...


Last edited by ToeiRei on Fri Jun 29, 2007 11:50 am; edited 1 time in total
Back to top
View user's profile Send private message
frenkel
Veteran
Veteran


Joined: 13 May 2003
Posts: 1034
Location: .nl

PostPosted: Fri Jun 29, 2007 11:47 am    Post subject: Reply with quote

ToeiRei wrote:
To get back on topic: are there some ebuilds available for btrfs and btrfs-progs?

Rei

Not yet, I'll make some today.
Back to top
View user's profile Send private message
frenkel
Veteran
Veteran


Joined: 13 May 2003
Posts: 1034
Location: .nl

PostPosted: Fri Jun 29, 2007 12:26 pm    Post subject: Reply with quote

frenkel wrote:
ToeiRei wrote:
To get back on topic: are there some ebuilds available for btrfs and btrfs-progs?

Rei

Not yet, I'll make some today.

They are finished. You can get them from svn using this command:
svn co http://lassie.no-ip.org/btrfs/ <location of local portage overlay>
After that, just run emerge -a btrfs and it will install everything you need!

Btw, the developer showed interest in compression :) http://oss.oracle.com/pipermail/btrfs-devel/2007-June/000034.html

WARNING: Remember that this is still experimental and that the disk format may change during development!


Last edited by frenkel on Fri Jun 29, 2007 1:17 pm; edited 1 time in total
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Fri Jun 29, 2007 12:44 pm    Post subject: Reply with quote

great, frenkel - thanks!

Here are some timings of my system doing an emerge --sync from a local mirror (LAN, 100 MBit) to an empty partition

JFS:
Code:
real    5m14.770s
user    0m23.996s
sys     0m16.572s


BTRFS:
Code:
real    3m49.666s
user    0m21.163s
sys     0m20.111s

_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Wed Jul 04, 2007 2:42 pm    Post subject: Reply with quote

Update:

btrfs on top of LVM:
Quote:
real 4m27.315s
user 0m21.232s
sys 0m18.941s

_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
frenkel
Veteran
Veteran


Joined: 13 May 2003
Posts: 1034
Location: .nl

PostPosted: Wed Jul 04, 2007 2:50 pm    Post subject: Reply with quote

ToeiRei wrote:
Update:

btrfs on top of LVM:
Quote:
real 4m27.315s
user 0m21.232s
sys 0m18.941s


LVM slows your system down significantly if you resize and move your partitions a lot. You get fragmentation all over the place. On a desktop I don't find it useful. On a server I found it useful, to make snapshots for example, but if btrfs matures, I won't need it on servers either.
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Wed Jul 04, 2007 2:57 pm    Post subject: Reply with quote

I just moved my system for being able to resize partitions easily. So I just times btrfs for you to see how it plays with lvm...
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
zxy
Veteran
Veteran


Joined: 06 Jan 2006
Posts: 1160
Location: in bed in front of the computer

PostPosted: Wed Jul 04, 2007 8:48 pm    Post subject: Reply with quote

frenkel wrote:

Btw, the developer showed interest in compression :) http://oss.oracle.com/pipermail/btrfs-devel/2007-June/000034.html


I hope it will be done, as I really liked the reiser4's idea with plugins.

Reading the ^^^ link made me remember: Different people, different needs.

That's why i guess different plugins would be a cool feature. Maybe even various encription plugins and various compression plugins (like gzip, bzip2, lzo ...)
_________________
Nature does not hurry, yet everything is accomplished.
Lao Tzu
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Mon Jul 09, 2007 12:55 pm    Post subject: Reply with quote

Hello folks,

Could someone please confirm that the btrfs module does NOT load with the gentoo-sources 2.6.21-r4 and newest headers?
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Tue Jul 10, 2007 11:17 am    Post subject: Reply with quote

Upgraded to kernel 2.6.22 and rebuilt the module (still at the old kernel). No success on getting that bugger to work. After all I rebooted using the new kernel and emerged the btrfs module again. Found the hint there.
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Sat Jul 28, 2007 1:31 am    Post subject: Reply with quote

there's some coverage on this filesystem @osnews: :)

http://osnews.com/story.php/18347/Interview-Oracles-Chris-Mason-on-Btrfs/
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
aidanjt
Veteran
Veteran


Joined: 20 Feb 2005
Posts: 1096
Location: Rep. of Ireland

PostPosted: Sat Jul 28, 2007 1:40 am    Post subject: Reply with quote

Is it really a good idea to use an 'alpha' FS on your system?

That aside, what's with this 'everything but kitchen sink" file systems these days?.. we already have lvm and device mapper subsystems in the kernel that *are* stable.
_________________
drizek wrote:
Here in America, we are like a bunch of shit-slinging monkeys.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Sat Jul 28, 2007 2:19 am    Post subject: Reply with quote

Quote:
Though, the compression would be a cool feature. Is it planned/possible?


it is :D !

AidanJT wrote:
Is it really a good idea to use an 'alpha' FS on your system?

That aside, what's with this 'everything but kitchen sink" file systems these days?.. we already have lvm and device mapper subsystems in the kernel that *are* stable.


so what ? :wink:

does *stable* imply:
- they are fast
- they are efficient in terms of space usage
- they do checks on file (integrity)
- they offer compression
- they offer snaphosts
- the are zfs-like filesystems
? :roll:

don't forget: opensource / F/OSS, especially GNU/Gentoo is about choice
and each and every fs has it's right to exists since it serves a specific purpose
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
aidanjt
Veteran
Veteran


Joined: 20 Feb 2005
Posts: 1096
Location: Rep. of Ireland

PostPosted: Sat Jul 28, 2007 11:07 am    Post subject: Reply with quote

kernelOfTruth wrote:


AidanJT wrote:
Is it really a good idea to use an 'alpha' FS on your system?

That aside, what's with this 'everything but kitchen sink" file systems these days?.. we already have lvm and device mapper subsystems in the kernel that *are* stable.


does *stable* imply:
- they are fast
- they are efficient in terms of space usage
- they do checks on file (integrity)
- they offer compression
- they offer snaphosts
- the are zfs-like filesystems
? :roll:

don't forget: opensource / F/OSS, especially GNU/Gentoo is about choice
and each and every fs has it's right to exists since it serves a specific purpose


- yes
- depends on FS (where it should be)
- yes (also depends on FS)
- yes
- yes
- no, like I said, a FS isn't the place for volume management features

Well that's fair enough, developers can choose to design things whatever way they wish, but it flys in the face of decades of UNIX development, design something to do one job, and do it very well, we've all seen how designing one thing to do everything works in windows.
_________________
drizek wrote:
Here in America, we are like a bunch of shit-slinging monkeys.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Sat Jul 28, 2007 11:09 am    Post subject: Reply with quote

Quote:
design something to do one job,

in theory yes, but there will always be cases in which the filesystem can't cope with files as it should - for this there's a choice

Quote:
we've all seen how designing one thing to do everything works in windows.

yes, sort of, but if you can make it better, why not :wink:

ntfs' log replay also isn't that fast compared to ext3 or reiserfs as far as I know & it's space-usage also could be improved, if btrfs can manage to do these things all faster & better while maintaining even increased data integrity (see checksums) it surely would be used on lots of boxes

it probably could also replace the ext*-family as "default" recommended filesystem but that's still a long way ahead ....
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Tue Aug 07, 2007 12:42 pm    Post subject: Reply with quote

any news from the btrfs front?

Rei
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Wed Aug 08, 2007 10:22 am    Post subject: Reply with quote

There's a new version out - 0.6;
As far as I can see from the SVN Changelog it's mostly bugfixes and cleanups and API Changes.

Rei
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Wed Aug 08, 2007 11:55 am    Post subject: Reply with quote

WOW - it got an defrag functionality ? 8)
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Wed Aug 08, 2007 12:17 pm    Post subject: Reply with quote

It has never been said that there's no fragmentation problem on *nix FS...
even XFS got defrag stuff...

Got the new 0.6 version online here by bumping frenkels' ebuilds. Everything works file here - or at least pretends to do so.

Rei
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5345
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Wed Aug 08, 2007 2:01 pm    Post subject: Reply with quote

Quote:
It has never been said that there's no fragmentation problem on *nix FS...
even XFS got defrag stuff...


I didn't pretend the opposite :wink:

this filesystem really seems to become the next big thing :)
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1113
Location: Austria

PostPosted: Wed Aug 08, 2007 2:09 pm    Post subject: Reply with quote

Agreed. I am following the changes from svn as fs development is quite an interesting topic :)

Things I would love to see are the fs-is-full-event implementaion (still an open bug) and something like quotas on slices (or how you would call those directories to store files in on that system)
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
Display posts from previous:   
This topic is locked: you cannot edit posts or make replies.    Gentoo Forums Forum Index Gentoo Chat All times are GMT
Goto page Previous  1, 2, 3, ... 24, 25, 26  Next
Page 2 of 26

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum