Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
bcachefs
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
mkoniarz
n00b
n00b


Joined: 10 Nov 2008
Posts: 11
Location: Wrocław

PostPosted: Sat Jun 02, 2018 11:17 am    Post subject: bcachefs Reply with quote

I'm curious if anyone was testing

https://bcachefs.org/

??

Would anyone be nice enough to prepare ebuild ? (bcachefs-tools)
Or where to start. maybe I could done by myself and share here?
Back to top
View user's profile Send private message
Naib
Watchman
Watchman


Joined: 21 May 2004
Posts: 5354
Location: Removed by Neddy

PostPosted: Sat Jun 02, 2018 1:51 pm    Post subject: Reply with quote

I am looking forward to this.
zfs is out of kernel (been burnt too many times... if my system cannot boot with a stock kernel I am not interested). btrfs seems to have messed up and redhat have their userland ontop of xfs pipedream....

I have just created a 1st pass ebuild

Code:
# Copyright 1999-2015 Gentoo Foundation
# Distributed under the terms of the GNU General Public License v2

EAPI=5

EGIT_NONSHALLOW=true

inherit git-r3 toolchain-funcs udev

DESCRIPTION="Tools for bcachefs"
HOMEPAGE="http://bcachefs.evilpiepirate.org/"
SRC_URI=""
EGIT_REPO_URI="https://evilpiepirate.org/git/bcachefs-tools.git"

SLOT="0"
LICENSE="GPL-2"
KEYWORDS="~amd64"
IUSE=""

RDEPEND=""
DEPEND="${RDEPEND}
   sys-apps/attr
   sys-apps/util-linux
   app-crypt/libscrypt
   dev-libs/libsodium
   sys-apps/keyutils
   dev-libs/userspace-rcu
   dev-util/pkgconfig
   sys-libs/zlib
   app-arch/zstd
"


--edit--
bug submitted https://bugs.gentoo.org/657120
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
msst
Apprentice
Apprentice


Joined: 07 Jun 2011
Posts: 187

PostPosted: Sat Jun 02, 2018 9:37 pm    Post subject: Reply with quote

Quote:
btrfs seems to have messed up


Maybe you have other info than I do, but it works stable and without problems since quite a while now. It is also in the kernel and not going to vanish there. Some distrios have even made it their default filesystem. RedHat decided in the opposite direction, but that won't make it vanish.
Back to top
View user's profile Send private message
Naib
Watchman
Watchman


Joined: 21 May 2004
Posts: 5354
Location: Removed by Neddy

PostPosted: Sat Jun 02, 2018 9:57 pm    Post subject: Reply with quote

msst wrote:
Quote:
btrfs seems to have messed up


Maybe you have other info than I do, but it works stable and without problems since quite a while now. It is also in the kernel and not going to vanish there. Some distrios have even made it their default filesystem. RedHat decided in the opposite direction, but that won't make it vanish.


https://www.patreon.com/bcachefs

Quote:
btrfs, which was supposed to be Linux's next generation COW filesystem - Linux's answer to zfs. Unfortunately, too much code was written too quickly without focusing on getting the core design correct first, and now it has too many design mistakes baked into the on disk format and an enormous, messy codebase - bigger that xfs. It's taken far too long to stabilize as well - poisoning the well for future filesystems because too many people were burned on btrfs, repeatedly (e.g. Fedora's tried to switch to btrfs multiple times and had to switch at the last minute, and server vendors who years ago hoped to one day roll out btrfs are now quietly migrating to xfs instead).

sure this is the author of bcachefs so it probably has some bias, but outright slander wouldn't last long
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
bunder
Bodhisattva
Bodhisattva


Joined: 10 Apr 2004
Posts: 5619

PostPosted: Sun Jun 03, 2018 4:17 am    Post subject: Reply with quote

There was this: https://www.theregister.co.uk/2017/11/22/linux_4_14_bcache_bug_destroys_data/

Also, isn't stratis just lvm/dm+xfs?
_________________
overlay | patches
Neddyseagoon wrote:
The problem with leaving is that you can only do it once and it reduces your influence.
Back to top
View user's profile Send private message
Naib
Watchman
Watchman


Joined: 21 May 2004
Posts: 5354
Location: Removed by Neddy

PostPosted: Sun Jun 03, 2018 8:25 am    Post subject: Reply with quote

bunder wrote:
There was this: https://www.theregister.co.uk/2017/11/22/linux_4_14_bcache_bug_destroys_data/

Also, isn't stratis just lvm/dm+xfs?
that's bcache not bcache.
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
msst
Apprentice
Apprentice


Joined: 07 Jun 2011
Posts: 187

PostPosted: Sun Jun 03, 2018 9:04 am    Post subject: Reply with quote

Quote:
sure this is the author of bcachefs so it probably has some bias, but outright slander wouldn't last long


It is clearly an opinion, he seems to dislike btrfs coding design (cannot coment on this) and what is correct IMHO is that the early releases were quite alpha and produced problems.They were not tagged as stable, but people tried them and expected something else they got. And yes, development was slow as is true for many open source projects.

Since more than 3 years I am now using btrfs and it has not yet produced any problem including raid 0/10. Facebook seems to be using it in production as well. One can consider it stable with the exception of raid 5/6 (which may never get stable as these raid levels are becoming obsolete quickly).

Quote:
Also, isn't stratis just lvm/dm+xfs?


Red Hats decision seems somewhat political and I have no idea what stratis will be. If they make it just a repackaging of lvm+dm+xfs then it won't be able to compete. Who knows what the future will bring, but brtrfs will not go away from the kernel for many years, so that is no reason to avoid it.
And in the moment btrfs is much more established, adopted and tried than bcachefs. Kent will have to do some catch up work. Making new filesystems is certainly a daunting job.
Back to top
View user's profile Send private message
bunder
Bodhisattva
Bodhisattva


Joined: 10 Apr 2004
Posts: 5619

PostPosted: Sun Jun 03, 2018 9:25 am    Post subject: Reply with quote

msst wrote:
Who knows what the future will bring, but brtrfs will not go away from the kernel for many years, so that is no reason to avoid it.


I'm quite happy with openzfs and I don't care whether it hits mainline or not. I also don't care if Oracle eventually ports their v28-v43 closed source zfs to their "unbreakable" redhat clone.

Call me biased but I'm quite happy with my storage situation right now. :P

But good for them, there is always more room for competition.
_________________
overlay | patches
Neddyseagoon wrote:
The problem with leaving is that you can only do it once and it reduces your influence.
Back to top
View user's profile Send private message
Naib
Watchman
Watchman


Joined: 21 May 2004
Posts: 5354
Location: Removed by Neddy

PostPosted: Sun Jun 03, 2018 10:48 am    Post subject: Reply with quote

msst wrote:
Quote:
sure this is the author of bcachefs so it probably has some bias, but outright slander wouldn't last long


It is clearly an opinion, he seems to dislike btrfs coding design (cannot coment on this) and what is correct IMHO is that the early releases were quite alpha and produced problems.They were not tagged as stable, but people tried them and expected something else they got. And yes, development was slow as is true for many open source projects.

Since more than 3 years I am now using btrfs and it has not yet produced any problem including raid 0/10. Facebook seems to be using it in production as well. One can consider it stable with the exception of raid 5/6 (which may never get stable as these raid levels are becoming obsolete quickly).

I agree his statements are opinionated, especially as he has a "competitor" ... but this isn't the 1st time I have come across statement with respect to poor direction with btrfs. RH dropping it was more than likely politically driven BUT equally something had to aggravate them, ie BTRFS not producing what was needed...

Quote:

Quote:
Also, isn't stratis just lvm/dm+xfs?


Red Hats decision seems somewhat political and I have no idea what stratis will be. If they make it just a repackaging of lvm+dm+xfs then it won't be able to compete. Who knows what the future will bring, but brtrfs will not go away from the kernel for many years, so that is no reason to avoid it.
And in the moment btrfs is much more established, adopted and tried than bcachefs. Kent will have to do some catch up work. Making new filesystems is certainly a daunting job.
My concerns with Stratis is it will hook deeply into systemd as the aim appears to use a proven filesystem and bolt onto it "next gen" features in userland via daemons...

So essentially the next set of filesystems are...zfs,btrfs,stratis,bcachefs
ZFS would be the preferred option but the license issue stops it being mainlined (there is talks though...). For some this isn't an issue. HOWEVER I have been burnt in the past (ReiserFS on Mandrake, FakeRAID on Gentoo) and as such anything needed to boot my system must be in the vanilla source.
BTRFS looks like a possible alternative to ZFS but I keep coming across concerns ( straight from there wiki... WARNING: kernels 4.14.25 - 4.14.27 and 4.15.8 - 4.15.9 on big endian machines will damage a filesystem after first umount. https://btrfs.wiki.kernel.org/index.php/Main_Page) Its thinks like that that concerns me "don't use those kernels" ... and when the next issue comes along?

ZFS and BTRFS being developed by Oracle is also oO seems a waste of resource (I know btrfs was started by oracle and they then acquired zfs via sun but still...)

STRATIS... political and I have fears of hooks into systemd. Whether it is an open threat to get BTRFS or ZFS-GPL who knows...

BCACHEFS its intriguing I do like how they have targeted stability and core FS before jumping onto shinies. That was always my concern with BTRFS... they kept pushing the latest buzword stuff but then breaking diskformat or breaking the format :wink:
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
bunder
Bodhisattva
Bodhisattva


Joined: 10 Apr 2004
Posts: 5619

PostPosted: Sun Jun 03, 2018 11:47 am    Post subject: Reply with quote

Not to derail the thread, but openzfs is actually maintained quite well in gentoo. I talk to several gentoo developers (+ foundation members) and users on a daily basis through freenode #zfsonlinux.

Also, openzfs hasn't been maintained by Sun/Oracle since they closed their source in 2005, it's maintained by former Sun employees, illumos (formerly known as OpenSolaris) developers, freebsd developers, linux developers, mac developers, and most importantly, the US Government. (Not to mention countless randoms with no programming experience.)

(I guess technically speaking, Oracle never maintained it, one of the first things they did was to close it, so we shouldn't even be using the O word. :lol: )

That said, if you ever do play around with it and have questions, you know where to find me. :wink:
_________________
overlay | patches
Neddyseagoon wrote:
The problem with leaving is that you can only do it once and it reduces your influence.
Back to top
View user's profile Send private message
happosai
n00b
n00b


Joined: 17 Aug 2005
Posts: 33

PostPosted: Mon Jun 11, 2018 8:54 pm    Post subject: Reply with quote

msst wrote:

Since more than 3 years I am now using btrfs and it has not yet produced any problem including raid 0/10. Facebook seems to be using it in production as well. One can consider it stable with the exception of raid 5/6 (which may never get stable as these raid levels are becoming obsolete quickly).

Quote:
Also, isn't stratis just lvm/dm+xfs?


Red Hats decision seems somewhat political and I have no idea what stratis will be. If they make it just a repackaging of lvm+dm+xfs then it won't be able to compete. Who knows what the future will bring, but brtrfs will not go away from the kernel for many years, so that is no reason to avoid it.
And in the moment btrfs is much more established, adopted and tried than bcachefs. Kent will have to do some catch up work. Making new filesystems is certainly a daunting job.


Btrfs has been in development for over ten years now, and while the basic stuff is being considered stable, many of the more advanced features are in development, not really finalized yet and some are even unstable - check this out: https://btrfs.wiki.kernel.org/index.php/Status. If you want an even more sceptic analysis of its status, look here: https://github.com/mosteo/btrfs-status

The show stopper for enterprise use is in many cases that Btrfs doesn't support triple parity, while ZFS has been offering this feature since ages. Another show stopper for using btrfs is that it just plainly sucks with VM images and databases, in fact the official recommendation for both is to switch COW off then, because otherwise your file might fragment in literelly ten thousand of pieces or more. But what's the point in using VM images/database storage on a COW file system, when you cannot use the COW features then? For both usage types you are way better of with XFS, or ext4 - in that order.

Also another problem with the still unstable state of btrfs is that putting it on a server means that you should be able to roll out the latest and greatest kernel version every release cycle, because it may contain important bug fixes and performance optimizations. The thing is if your preferred Linux distribution doesn't do backports, than choosing Btrfs might not be such an exactly brillant idea, because when you are running into issues the developers will tell you to switch to the latest and greatest kernel.

Facebook by the way has been testing it in production, but mostly for the deployment and management of system partitions, and not much more. Btrfs on Red Hat has never been a first class citizen, but yes, they lost faith in it completely.

If you want to get real insights what using btrfs in production use meaned, just look at CoreOS. They rolled it out as their default file system in 2014, and the complaints and problems about it skyrocketed to such a boiling point, that they ditched it entirely back then and switched to ext4 + overlayfs early in 2015. The most typical complaints were out of disk space errors, metadata rebalancing problems, and generally slow performance compared to other file systems (https://lwn.net/Articles/627232/). Rebalanciing problems are even an issue in 2018: https://www.spinics.net/lists/linux-btrfs/msg74892.html

Russel Coker from Australia is writing in his personal blog about his experience with Btrfs on his own machines, which he started bloggin about in 2012 and you might also want to check here: https://etbe.coker.com.au/ In the first few years he had a major hiccup almost every six months or so, were he had to ask the mailing list for help, but then it became more reliable and it slowed down.

I also used it several times on my own, and it always ran okay for some weeks then, when problems started to occur and the fun stuff happened. And RAID1 is now nothing fancy in particular. I always had a backup of my data, just in case, and I always needed it.

Having said that, Btrfs is fine to play around with in my opinion if you are using it with throwaway data only, or you get a regular backup of your data. I would never, ever use it on a production level system.

Synology though does use it since over two years as standard file systems, and they seem do be quite happy with it.

To make it short: if you really need a COW file system on Linux, then take ZFS. If you have issues with it on a Linux machine due to CCDL vs GPL, then switch over to FreeBSD. Btrfs has been a nice idea, but is still to much construction area, and a convoluted mess in reality which I would not trust my data with. And BcacheFS might be what could become the new king, but give it at least two or three years, because they are still lacking some basic features like scrubbing. The thing though is that many people, just like myself, have lost their faith in Btreefs completely, so time is not such a pressing issue for BcacheFS at the moment as some might think.

And by the way Oracle recently in February this year completely unexpected relicensed another cron jewel from Sun, dtrace, under the GPL. Maybe ZFS might follow, who knows?
Back to top
View user's profile Send private message
steveL
Watchman
Watchman


Joined: 13 Sep 2006
Posts: 5080
Location: The Peanut Gallery

PostPosted: Tue Jun 12, 2018 12:41 pm    Post subject: Reply with quote

I like the sound of it; I've always wondered why people don't talk about the bcache more, since it underpins everything, and has been around since the beginning of UNIX. (cf: Lions, Bach.)

It's the original "page cache", afaic (and I don't think you really need another one in-kernel; just memory areas or "extents".)
Back to top
View user's profile Send private message
Ant P.
Watchman
Watchman


Joined: 18 Apr 2009
Posts: 5074

PostPosted: Tue Jun 12, 2018 6:32 pm    Post subject: Reply with quote

Bah. Still waiting for Tux3.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum