Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
New filesystem: Btrfs! (cont.)
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2, 3 ... 9, 10, 11  
Reply to topic    Gentoo Forums Forum Index Gentoo Chat
View previous topic :: View next topic  
Author Message
renkinjutsu
n00b
n00b


Joined: 28 Jul 2010
Posts: 28

PostPosted: Fri Jan 27, 2012 10:51 pm    Post subject: Reply with quote

upengan78 wrote:
darklegion wrote:
Small_Penguin wrote:
I wanted to try btrfs with lzo compression for /usr/portage, hoping for the compression to speed things up.
Its partition size is only 512MiB. Unfortunately, the data does not even fit with btrfs. What a showstopper!

However, using ext4 with 1024 block size: /dev/sdb5 519412 376850 142562 73% /usr/portage

It's a pity ext4 can't do compression. However, both its stability and configurability are great and I had no problems so far.


You need to enable the "-M" option when creating a small partition with btrfs. Otherwise it will use a lot of space for metadata. Regarding compressing /usr/portage you should probably use something like squashfs.


mkbtrfs
Code:
usage: mkfs.btrfs [options] dev [ dev ... ]
options:
    -A --alloc-start the offset to start the FS
    -b --byte-count total number of bytes in the FS
    -d --data data profile, raid0, raid1, raid10 or single
    -l --leafsize size of btree leaves
    -L --label set a label
    -m --metadata metadata profile, values like data profile
    -n --nodesize size of btree nodes
    -s --sectorsize min block allocation
Btrfs Btrfs v0.19


Don't see -M here. Can you tell me where one needs to enable -M option ? Thanks.


The -M option is available if you install btrfs-progs-9999.
What it does is store the metadata WITH the data to be more space efficient.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Fri Jan 27, 2012 11:18 pm    Post subject: Reply with quote

renkinjutsu wrote:

The -M option is available if you install btrfs-progs-9999.
What it does is store the metadata WITH the data to be more space efficient.


happy days !

once more formatting the partitions :roll:


didn't know the progs had to be that recent

thx !
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
renkinjutsu
n00b
n00b


Joined: 28 Jul 2010
Posts: 28

PostPosted: Fri Jan 27, 2012 11:24 pm    Post subject: Reply with quote

kernelOfTruth wrote:
renkinjutsu wrote:

The -M option is available if you install btrfs-progs-9999.
What it does is store the metadata WITH the data to be more space efficient.


happy days !

once more formatting the partitions :roll:


didn't know the progs had to be that recent

thx !


IIRC the patches are fairly old. I think Josef Bacik sent the patches in to make BtrFS usable on small devices. This was because people from moblin/meego wanted to use BtRFS on their mobile devices (so yeah.. pretty old).. But then again, btrfs-progs doesn't get updated very often. It's been 0.19 for ages!
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Fri Jan 27, 2012 11:36 pm    Post subject: Reply with quote

renkinjutsu wrote:
kernelOfTruth wrote:
renkinjutsu wrote:

The -M option is available if you install btrfs-progs-9999.
What it does is store the metadata WITH the data to be more space efficient.


happy days !

once more formatting the partitions :roll:


didn't know the progs had to be that recent

thx !


IIRC the patches are fairly old. I think Josef Bacik sent the patches in to make BtrFS usable on small devices. This was because people from moblin/meego wanted to use BtRFS on their mobile devices (so yeah.. pretty old).. But then again, btrfs-progs doesn't get updated very often. It's been 0.19 for ages!


well, in that case I must have overlooked it somehow :lol:

-M --mixed mix metadata and data together

is there for me (emerged on January 6th this year)


who of you is using that switch ?

any issues with data integrity or data loss so far ?
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
Dont Panic
Guru
Guru


Joined: 20 Jun 2007
Posts: 320
Location: SouthEast U.S.A.

PostPosted: Sun Jan 29, 2012 4:43 pm    Post subject: Reply with quote

kernelOfTruth wrote:
who of you is using that switch ?

any issues with data integrity or data loss so far ?

I tested the Mixed Data/Metadata mode when it first came out.

It did result in a slowdown of about 10-15%. I can't precisely recall the metric I used to come to that conclusion, but the developer thought that was about what would be expected.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Tue May 08, 2012 8:20 pm    Post subject: Reply with quote

Dont Panic wrote:
kernelOfTruth wrote:
who of you is using that switch ?

any issues with data integrity or data loss so far ?

I tested the Mixed Data/Metadata mode when it first came out.

It did result in a slowdown of about 10-15%. I can't precisely recall the metric I used to come to that conclusion, but the developer thought that was about what would be expected.


ok, I stopped using that since it didn't really get that much



seems like btrfs still isn't so stable and ready for prime-time

using 3.4 kernel's btrfs + 3.3.2


just wanted to rsync the portage-tree and got the following:

Quote:
[ 6709.344432] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6709.344436] rsync D ffff88023fcd1000 0 11893 11891 0x00000004
[ 6709.344443] ffff88019f329a40 0000000000000082 ffff88018b1dbe68 ffff88023698b480
[ 6709.344450] ffff88018b1dbfd8 ffff88018b1dbfd8 ffff88018b1dbfd8 ffff88019f329a40
[ 6709.344456] 0000000000000246 ffff8802147d4400 ffff8802147d4620 ffff88018b1dbed8
[ 6709.344462] Call Trace:
[ 6709.344473] [<ffffffff812dd443>] ? btrfs_find_free_ino+0xb3/0x140
[ 6709.344480] [<ffffffff81063450>] ? finish_wait+0x90/0x90
[ 6709.344486] [<ffffffff812f267d>] ? btrfs_mkdir+0x6d/0x1f0
[ 6709.344493] [<ffffffff811141d7>] ? vfs_mkdir+0x67/0xf0
[ 6709.344498] [<ffffffff811181fe>] ? sys_mkdirat+0xbe/0xd0
[ 6709.344504] [<ffffffff816da5a2>] ? system_call_fastpath+0x16/0x1b
[ 6829.137933] INFO: task btrfs-transacti:10710 blocked for more than 120 seconds.
[ 6829.137937] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6829.137941] btrfs-transacti D ffff88023fc51000 0 10710 2 0x00000000
[ 6829.137948] ffff880236228690 0000000000000046 0000000000000001 ffff8802368b6270
[ 6829.137955] ffff88019f9ebfd8 ffff88019f9ebfd8 ffff88019f9ebfd8 ffff880236228690
[ 6829.137961] ffff88014deea7e0 ffff88014b464050 ffff8802352de400 0000000000000000
[ 6829.137967] Call Trace:
[ 6829.137977] [<ffffffff816d72ea>] ? schedule_timeout+0x1ca/0x250
[ 6829.137986] [<ffffffff81330d16>] ? __btrfs_release_delayed_node+0x66/0x1c0
[ 6829.137992] [<ffffffff811000e4>] ? kmem_cache_free+0x14/0x90
[ 6829.137997] [<ffffffff81304a02>] ? btrfs_run_ordered_operations+0x1d2/0x1f0
[ 6829.138005] [<ffffffff812e5942>] ? btrfs_commit_transaction+0x362/0x9e0
[ 6829.138012] [<ffffffff81063450>] ? finish_wait+0x90/0x90
[ 6829.138017] [<ffffffff812e6415>] ? start_transaction+0x95/0x2c0
[ 6829.138023] [<ffffffff812de715>] ? transaction_kthread+0x245/0x2c0
[ 6829.138028] [<ffffffff812de4d0>] ? check_leaf.isra.108+0x300/0x300
[ 6829.138033] [<ffffffff81063155>] ? kthread+0x85/0x90
[ 6829.138039] [<ffffffff816db754>] ? kernel_thread_helper+0x4/0x10
[ 6829.138045] [<ffffffff810630d0>] ? flush_kthread_worker+0x80/0x80
[ 6829.138050] [<ffffffff816db750>] ? gs_change+0xb/0xb
[ 6829.138066] INFO: task rsync:11893 blocked for more than 120 seconds.
[ 6829.138068] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6829.138071] rsync D ffff88023fcd1000 0 11893 11891 0x00000004
[ 6829.138077] ffff88019f329a40 0000000000000082 ffff88018b1dbe68 ffff88023698b480
[ 6829.138083] ffff88018b1dbfd8 ffff88018b1dbfd8 ffff88018b1dbfd8 ffff88019f329a40
[ 6829.138089] 0000000000000246 ffff8802147d4400 ffff8802147d4620 ffff88018b1dbed8
[ 6829.138095] Call Trace:
[ 6829.138100] [<ffffffff812dd443>] ? btrfs_find_free_ino+0xb3/0x140
[ 6829.138106] [<ffffffff81063450>] ? finish_wait+0x90/0x90
[ 6829.138111] [<ffffffff812f267d>] ? btrfs_mkdir+0x6d/0x1f0
[ 6829.138117] [<ffffffff811141d7>] ? vfs_mkdir+0x67/0xf0
[ 6829.138123] [<ffffffff811181fe>] ? sys_mkdirat+0xbe/0xd0
[ 6829.138127] [<ffffffff816da5a2>] ? system_call_fastpath+0x16/0x1b
[ 6829.138133] INFO: task rsync:12029 blocked for more than 120 seconds.
[ 6829.138135] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6829.138138] rsync D ffff88023fc91000 0 12029 12027 0x00000004
[ 6829.138143] ffff88016126c830 0000000000000086 ffff880147c52fd0 ffff880236988d20
[ 6829.138149] ffff88019fa4bfd8 ffff88019fa4bfd8 ffff88019fa4bfd8 ffff88016126c830
[ 6829.138155] ffff88019fa4be38 ffff880147c53068 ffff880147c5306c ffff88016126c830
[ 6829.138161] Call Trace:
[ 6829.138166] [<ffffffff816d7cb1>] ? __mutex_lock_slowpath+0x101/0x1a0
[ 6829.138172] [<ffffffff811130da>] ? getname_flags+0xda/0x250
[ 6829.138176] [<ffffffff811000e4>] ? kmem_cache_free+0x14/0x90
[ 6829.138181] [<ffffffff81117d37>] ? user_path_at_empty+0x67/0xb0
[ 6829.138186] [<ffffffff816d765a>] ? mutex_lock+0x1a/0x40
[ 6829.138193] [<ffffffff8113137f>] ? utimes_common+0xaf/0x150
[ 6829.138199] [<ffffffff811314f7>] ? do_utimes+0xd7/0xf0
[ 6829.138204] [<ffffffff811315c9>] ? sys_utimensat+0x49/0x80
[ 6829.138208] [<ffffffff816da5a2>] ? system_call_fastpath+0x16/0x1b
[ 6948.931401] INFO: task btrfs-transacti:10710 blocked for more than 120 seconds.
[ 6948.931405] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6948.931409] btrfs-transacti D ffff88023fc51000 0 10710 2 0x00000000
[ 6948.931416] ffff880236228690 0000000000000046 0000000000000001 ffff8802368b6270
[ 6948.931423] ffff88019f9ebfd8 ffff88019f9ebfd8 ffff88019f9ebfd8 ffff880236228690
[ 6948.931429] ffff88014deea7e0 ffff88014b464050 ffff8802352de400 0000000000000000
[ 6948.931435] Call Trace:
[ 6948.931445] [<ffffffff816d72ea>] ? schedule_timeout+0x1ca/0x250
[ 6948.931453] [<ffffffff81330d16>] ? __btrfs_release_delayed_node+0x66/0x1c0
[ 6948.931459] [<ffffffff811000e4>] ? kmem_cache_free+0x14/0x90
[ 6948.931465] [<ffffffff81304a02>] ? btrfs_run_ordered_operations+0x1d2/0x1f0
[ 6948.931473] [<ffffffff812e5942>] ? btrfs_commit_transaction+0x362/0x9e0
[ 6948.931480] [<ffffffff81063450>] ? finish_wait+0x90/0x90
[ 6948.931486] [<ffffffff812e6415>] ? start_transaction+0x95/0x2c0
[ 6948.931491] [<ffffffff812de715>] ? transaction_kthread+0x245/0x2c0
[ 6948.931496] [<ffffffff812de4d0>] ? check_leaf.isra.108+0x300/0x300
[ 6948.931501] [<ffffffff81063155>] ? kthread+0x85/0x90
[ 6948.931508] [<ffffffff816db754>] ? kernel_thread_helper+0x4/0x10
[ 6948.931513] [<ffffffff810630d0>] ? flush_kthread_worker+0x80/0x80
[ 6948.931518] [<ffffffff816db750>] ? gs_change+0xb/0xb
[ 6948.931524] INFO: task rsync:11893 blocked for more than 120 seconds.
[ 6948.931527] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6948.931529] rsync D ffff88023fcd1000 0 11893 11891 0x00000004
[ 6948.931535] ffff88019f329a40 0000000000000082 ffff88018b1dbe68 ffff88023698b480
[ 6948.931541] ffff88018b1dbfd8 ffff88018b1dbfd8 ffff88018b1dbfd8 ffff88019f329a40
[ 6948.931547] 0000000000000246 ffff8802147d4400 ffff8802147d4620 ffff88018b1dbed8
[ 6948.931553] Call Trace:
[ 6948.931559] [<ffffffff812dd443>] ? btrfs_find_free_ino+0xb3/0x140
[ 6948.931564] [<ffffffff81063450>] ? finish_wait+0x90/0x90
[ 6948.931569] [<ffffffff812f267d>] ? btrfs_mkdir+0x6d/0x1f0
[ 6948.931575] [<ffffffff811141d7>] ? vfs_mkdir+0x67/0xf0
[ 6948.931581] [<ffffffff811181fe>] ? sys_mkdirat+0xbe/0xd0
[ 6948.931585] [<ffffffff816da5a2>] ? system_call_fastpath+0x16/0x1b
[ 6948.931591] INFO: task rsync:12029 blocked for more than 120 seconds.
[ 6948.931593] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6948.931596] rsync D ffff88023fc91000 0 12029 12027 0x00000004
[ 6948.931601] ffff88016126c830 0000000000000086 ffff880147c52fd0 ffff880236988d20
[ 6948.931607] ffff88019fa4bfd8 ffff88019fa4bfd8 ffff88019fa4bfd8 ffff88016126c830
[ 6948.931613] ffff88019fa4be38 ffff880147c53068 ffff880147c5306c ffff88016126c830
[ 6948.931619] Call Trace:
[ 6948.931624] [<ffffffff816d7cb1>] ? __mutex_lock_slowpath+0x101/0x1a0
[ 6948.931630] [<ffffffff811130da>] ? getname_flags+0xda/0x250
[ 6948.931634] [<ffffffff811000e4>] ? kmem_cache_free+0x14/0x90
[ 6948.931639] [<ffffffff81117d37>] ? user_path_at_empty+0x67/0xb0
[ 6948.931644] [<ffffffff816d765a>] ? mutex_lock+0x1a/0x40
[ 6948.931651] [<ffffffff8113137f>] ? utimes_common+0xaf/0x150
[ 6948.931657] [<ffffffff811314f7>] ? do_utimes+0xd7/0xf0
[ 6948.931662] [<ffffffff811315c9>] ? sys_utimensat+0x49/0x80
[ 6948.931666] [<ffffffff816da5a2>] ? system_call_fastpath+0x16/0x1b
[ 6948.931670] INFO: task emerge:12034 blocked for more than 120 seconds.
[ 6948.931673] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 6948.931675] emerge D ffff88023fd91000 0 12034 7850 0x00000004
[ 6948.931681] ffff88023365cec0 0000000000000082 ffff88023fd970a0 ffff8802369e2df0
[ 6948.931687] ffff8801e7c3ffd8 ffff8801e7c3ffd8 ffff8801e7c3ffd8 ffff88023365cec0
[ 6948.931693] 0000000000000246 ffff880155921e10 ffff8802147d4520 ffff88015ca80180
[ 6948.931699] Call Trace:
[ 6948.931704] [<ffffffff812e4fa5>] ? wait_current_trans.isra.30+0xa5/0xf0
[ 6948.931710] [<ffffffff81063450>] ? finish_wait+0x90/0x90
[ 6948.931715] [<ffffffff812e64c5>] ? start_transaction+0x145/0x2c0
[ 6948.931720] [<ffffffff812f29f9>] ? btrfs_create+0x49/0x210
[ 6948.931725] [<ffffffff811142d4>] ? vfs_create+0x74/0xf0
[ 6948.931730] [<ffffffff8111761e>] ? do_last+0x5ee/0x890
[ 6948.931735] [<ffffffff811179d9>] ? path_openat+0xd9/0x3b0
[ 6948.931741] [<ffffffff81117dd4>] ? do_filp_open+0x44/0xb0
[ 6948.931746] [<ffffffff81123e6a>] ? alloc_fd+0xda/0x130
[ 6948.931752] [<ffffffff811080fd>] ? do_sys_open+0xed/0x1c0
[ 6948.931757] [<ffffffff816da5a2>] ? system_call_fastpath+0x16/0x1b


seems like the partition is screwed - will run a scrub after next reboot when the partition is still accessible ...

edit:

scrub runs through suspiciously fast and returns no errors

data still seems accessible though (didn't test much more than a ls -l /usr/gentoo - where the partition is at)

but trying another rsync also leads to filesystems hang

so reformatting


the reason for this could be that I did half or close to a dozen times of suspend and resume

which in the past killed the filesystem after one or two passes

now it's much more resilient but still way too fragile for my taste
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
Dont Panic
Guru
Guru


Joined: 20 Jun 2007
Posts: 320
Location: SouthEast U.S.A.

PostPosted: Tue May 08, 2012 9:02 pm    Post subject: Reply with quote

I had to go back and check.

I made my first post to this thread about 3 1/2 years ago on Thu Oct 30, 2008.

If I had to guess, I'd say we're still at least 2 years away from being stable. But I think I had the same timeline in 2008. :D

Oh well, maybe my children will have a stable Btrfs.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Fri Jun 01, 2012 10:19 am    Post subject: Reply with quote

Dont Panic wrote:
I had to go back and check.

I made my first post to this thread about 3 1/2 years ago on Thu Oct 30, 2008.

If I had to guess, I'd say we're still at least 2 years away from being stable. But I think I had the same timeline in 2008. :D

Oh well, maybe my children will have a stable Btrfs.


yeah, probably :lol:


I wonder how Edward, Hans and all the others managed to get reiserfs & reiser4 that stable 8O


seems like btrfs has similar issues like reiser4 (probably using similar principles and functionality):

Quote:
Jun 1 09:36:44 lupus kernel: [ 375.080179] btrfs: use zlib compression
Jun 1 09:36:44 lupus kernel: [ 375.080187] btrfs: enabling inode map caching
Jun 1 09:36:44 lupus kernel: [ 375.080190] btrfs: not using ssd allocation scheme
Jun 1 09:36:44 lupus kernel: [ 375.080192] btrfs: disk space caching is enabled
Jun 1 09:40:29 lupus kernel: [ 599.817793] INFO: task rsync:7314 blocked for more than 120 seconds.
Jun 1 09:40:29 lupus kernel: [ 599.817798] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:40:29 lupus kernel: [ 599.817802] rsync D ffff88023fc91000 0 7314 7313 0x00000000
Jun 1 09:40:29 lupus kernel: [ 599.817808] ffff8802369a85f0 0000000000000082 ffff8801a1be9e68 ffff8801ff18eae0
Jun 1 09:40:29 lupus kernel: [ 599.817815] ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801ff18eae0
Jun 1 09:40:29 lupus kernel: [ 599.817821] 0000000000000246 ffff8802357d2400 ffff8802357d2620 ffff8801a1be9ed8
Jun 1 09:40:29 lupus kernel: [ 599.817828] Call Trace:
Jun 1 09:40:29 lupus kernel: [ 599.817838] [<ffffffff812d2573>] ? btrfs_find_free_ino+0xb3/0x140
Jun 1 09:40:29 lupus kernel: [ 599.817844] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:40:29 lupus kernel: [ 599.817850] [<ffffffff812e7a2d>] ? btrfs_mkdir+0x6d/0x1f0
Jun 1 09:40:29 lupus kernel: [ 599.817856] [<ffffffff8105a848>] ? ns_capable+0x28/0x50
Jun 1 09:40:29 lupus kernel: [ 599.817862] [<ffffffff8110eb57>] ? vfs_mkdir+0x67/0xf0
Jun 1 09:40:29 lupus kernel: [ 599.817867] [<ffffffff81112924>] ? sys_mkdirat+0x4/0xd0
Jun 1 09:40:29 lupus kernel: [ 599.817871] [<ffffffff811129dd>] ? sys_mkdirat+0xbd/0xd0
Jun 1 09:40:29 lupus kernel: [ 599.817877] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 09:42:29 lupus kernel: [ 719.611235] INFO: task btrfs-transacti:7069 blocked for more than 120 seconds.
Jun 1 09:42:29 lupus kernel: [ 719.611239] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:42:29 lupus kernel: [ 719.611243] btrfs-transacti D ffff88023fd91000 0 7069 2 0x00000000
Jun 1 09:42:29 lupus kernel: [ 719.611249] ffff88020f6bb570 0000000000000046 ffff88017b313000 ffff88020d070000
Jun 1 09:42:29 lupus kernel: [ 719.611256] ffff8802009d7fd8 ffff8802009d7fd8 ffff8802009d7fd8 ffff88020d070000
Jun 1 09:42:29 lupus kernel: [ 719.611262] ffff8802332d7360 ffff8802294bd370 7fffffffffffffff 0000000000000000
Jun 1 09:42:29 lupus kernel: [ 719.611268] Call Trace:
Jun 1 09:42:29 lupus kernel: [ 719.611278] [<ffffffff816d9ecd>] ? schedule_timeout+0x1fd/0x280
Jun 1 09:42:29 lupus kernel: [ 719.611286] [<ffffffff813254ee>] ? __btrfs_release_delayed_node+0x5e/0x190
Jun 1 09:42:29 lupus kernel: [ 719.611293] [<ffffffff810fa8e4>] ? kmem_cache_free+0x14/0x90
Jun 1 09:42:29 lupus kernel: [ 719.611299] [<ffffffff812f947d>] ? btrfs_run_ordered_operations+0x1ad/0x1c0
Jun 1 09:42:29 lupus kernel: [ 719.611305] [<ffffffff812da7d8>] ? btrfs_commit_transaction+0x318/0x960
Jun 1 09:42:29 lupus kernel: [ 719.611310] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:42:29 lupus kernel: [ 719.611315] [<ffffffff812db269>] ? start_transaction+0x89/0x2a0
Jun 1 09:42:29 lupus kernel: [ 719.611322] [<ffffffff812d4c6d>] ? transaction_kthread+0x22d/0x2a0
Jun 1 09:42:29 lupus kernel: [ 719.611328] [<ffffffff812d4a40>] ? btrfs_destroy_delayed_refs.isra.101+0x1d0/0x1d0
Jun 1 09:42:29 lupus kernel: [ 719.611335] [<ffffffff8106c435>] ? kthread+0x85/0x90
Jun 1 09:42:29 lupus kernel: [ 719.611341] [<ffffffff816ddfd4>] ? kernel_thread_helper+0x4/0x10
Jun 1 09:42:29 lupus kernel: [ 719.611347] [<ffffffff8106c3b0>] ? kthread_freezable_should_stop+0x60/0x60
Jun 1 09:42:29 lupus kernel: [ 719.611352] [<ffffffff816ddfd0>] ? gs_change+0xb/0xb
Jun 1 09:42:29 lupus kernel: [ 719.611366] INFO: task rsync:7314 blocked for more than 120 seconds.
Jun 1 09:42:29 lupus kernel: [ 719.611368] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:42:29 lupus kernel: [ 719.611371] rsync D ffff88023fc91000 0 7314 7313 0x00000000
Jun 1 09:42:29 lupus kernel: [ 719.611376] ffff8802369a85f0 0000000000000082 ffff8801a1be9e68 ffff8801ff18eae0
Jun 1 09:42:29 lupus kernel: [ 719.611383] ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801ff18eae0
Jun 1 09:42:29 lupus kernel: [ 719.611389] 0000000000000246 ffff8802357d2400 ffff8802357d2620 ffff8801a1be9ed8
Jun 1 09:42:29 lupus kernel: [ 719.611394] Call Trace:
Jun 1 09:42:29 lupus kernel: [ 719.611400] [<ffffffff812d2573>] ? btrfs_find_free_ino+0xb3/0x140
Jun 1 09:42:29 lupus kernel: [ 719.611404] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:42:29 lupus kernel: [ 719.611410] [<ffffffff812e7a2d>] ? btrfs_mkdir+0x6d/0x1f0
Jun 1 09:42:29 lupus kernel: [ 719.611416] [<ffffffff8105a848>] ? ns_capable+0x28/0x50
Jun 1 09:42:29 lupus kernel: [ 719.611422] [<ffffffff8110eb57>] ? vfs_mkdir+0x67/0xf0
Jun 1 09:42:29 lupus kernel: [ 719.611426] [<ffffffff81112924>] ? sys_mkdirat+0x4/0xd0
Jun 1 09:42:29 lupus kernel: [ 719.611430] [<ffffffff811129dd>] ? sys_mkdirat+0xbd/0xd0
Jun 1 09:42:29 lupus kernel: [ 719.611435] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 09:42:29 lupus kernel: [ 719.611439] INFO: task rsync:7315 blocked for more than 120 seconds.
Jun 1 09:42:29 lupus kernel: [ 719.611442] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:42:29 lupus kernel: [ 719.611445] rsync D ffff88023fc91000 0 7315 7314 0x00000000
Jun 1 09:42:29 lupus kernel: [ 719.611450] ffff8802369a85f0 0000000000000082 00000000001e0000 ffff8802362af6c0
Jun 1 09:42:29 lupus kernel: [ 719.611456] ffff88019e2bbfd8 ffff88019e2bbfd8 ffff88019e2bbfd8 ffff8802362af6c0
Jun 1 09:42:29 lupus kernel: [ 719.611462] 0000000000000246 ffff880194222000 ffff8802357d2520 00000000001e0000
Jun 1 09:42:29 lupus kernel: [ 719.611468] Call Trace:
Jun 1 09:42:29 lupus kernel: [ 719.611472] [<ffffffff812d9edd>] ? wait_current_trans.isra.31+0x8d/0xf0
Jun 1 09:42:29 lupus kernel: [ 719.611477] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:42:29 lupus kernel: [ 719.611481] [<ffffffff812db303>] ? start_transaction+0x123/0x2a0
Jun 1 09:42:29 lupus kernel: [ 719.611486] [<ffffffff8110f47e>] ? path_init+0x17e/0x3c0
Jun 1 09:42:29 lupus kernel: [ 719.611491] [<ffffffff812e6a06>] ? btrfs_rename+0x166/0x6c0
Jun 1 09:42:29 lupus kernel: [ 719.611497] [<ffffffff81111395>] ? path_lookupat+0x65/0x6f0
Jun 1 09:42:29 lupus kernel: [ 719.611502] [<ffffffff8110f8dc>] ? vfs_rename+0x11c/0x460
Jun 1 09:42:29 lupus kernel: [ 719.611507] [<ffffffff81119e7e>] ? d_lookup+0x2e/0x60
Jun 1 09:42:29 lupus kernel: [ 719.611513] [<ffffffff8110e5bc>] ? __lookup_hash.part.36+0x2c/0xf0
Jun 1 09:42:29 lupus kernel: [ 719.611517] [<ffffffff81112ee2>] ? sys_renameat+0x222/0x240
Jun 1 09:42:29 lupus kernel: [ 719.611523] [<ffffffff8111cd56>] ? notify_change+0x1e6/0x350
Jun 1 09:42:29 lupus kernel: [ 719.611529] [<ffffffff8110197a>] ? chmod_common+0x8a/0xb0
Jun 1 09:42:29 lupus kernel: [ 719.611533] [<ffffffff81118e0a>] ? dput+0xba/0x240
Jun 1 09:42:29 lupus kernel: [ 719.611538] [<ffffffff8111f4f5>] ? mntput_no_expire+0x25/0x160
Jun 1 09:42:29 lupus kernel: [ 719.611543] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 09:44:29 lupus kernel: [ 839.404654] INFO: task btrfs-transacti:7069 blocked for more than 120 seconds.
Jun 1 09:44:29 lupus kernel: [ 839.404659] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:44:29 lupus kernel: [ 839.404663] btrfs-transacti D ffff88023fd91000 0 7069 2 0x00000000
Jun 1 09:44:29 lupus kernel: [ 839.404669] ffff88020f6bb570 0000000000000046 ffff88017b313000 ffff88020d070000
Jun 1 09:44:29 lupus kernel: [ 839.404676] ffff8802009d7fd8 ffff8802009d7fd8 ffff8802009d7fd8 ffff88020d070000
Jun 1 09:44:29 lupus kernel: [ 839.404682] ffff8802332d7360 ffff8802294bd370 7fffffffffffffff 0000000000000000
Jun 1 09:44:29 lupus kernel: [ 839.404688] Call Trace:
Jun 1 09:44:29 lupus kernel: [ 839.404698] [<ffffffff816d9ecd>] ? schedule_timeout+0x1fd/0x280
Jun 1 09:44:29 lupus kernel: [ 839.404706] [<ffffffff813254ee>] ? __btrfs_release_delayed_node+0x5e/0x190
Jun 1 09:44:29 lupus kernel: [ 839.404713] [<ffffffff810fa8e4>] ? kmem_cache_free+0x14/0x90
Jun 1 09:44:29 lupus kernel: [ 839.404719] [<ffffffff812f947d>] ? btrfs_run_ordered_operations+0x1ad/0x1c0
Jun 1 09:44:29 lupus kernel: [ 839.404725] [<ffffffff812da7d8>] ? btrfs_commit_transaction+0x318/0x960
Jun 1 09:44:29 lupus kernel: [ 839.404730] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:44:29 lupus kernel: [ 839.404734] [<ffffffff812db269>] ? start_transaction+0x89/0x2a0
Jun 1 09:44:29 lupus kernel: [ 839.404741] [<ffffffff812d4c6d>] ? transaction_kthread+0x22d/0x2a0
Jun 1 09:44:29 lupus kernel: [ 839.404747] [<ffffffff812d4a40>] ? btrfs_destroy_delayed_refs.isra.101+0x1d0/0x1d0
Jun 1 09:44:29 lupus kernel: [ 839.404754] [<ffffffff8106c435>] ? kthread+0x85/0x90
Jun 1 09:44:29 lupus kernel: [ 839.404760] [<ffffffff816ddfd4>] ? kernel_thread_helper+0x4/0x10
Jun 1 09:44:29 lupus kernel: [ 839.404766] [<ffffffff8106c3b0>] ? kthread_freezable_should_stop+0x60/0x60
Jun 1 09:44:29 lupus kernel: [ 839.404771] [<ffffffff816ddfd0>] ? gs_change+0xb/0xb
Jun 1 09:44:29 lupus kernel: [ 839.404783] INFO: task rsync:7314 blocked for more than 120 seconds.
Jun 1 09:44:29 lupus kernel: [ 839.404786] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:44:29 lupus kernel: [ 839.404789] rsync D ffff88023fc91000 0 7314 7313 0x00000000
Jun 1 09:44:29 lupus kernel: [ 839.404794] ffff8802369a85f0 0000000000000082 ffff8801a1be9e68 ffff8801ff18eae0
Jun 1 09:44:29 lupus kernel: [ 839.404801] ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801ff18eae0
Jun 1 09:44:29 lupus kernel: [ 839.404807] 0000000000000246 ffff8802357d2400 ffff8802357d2620 ffff8801a1be9ed8
Jun 1 09:44:29 lupus kernel: [ 839.404812] Call Trace:
Jun 1 09:44:29 lupus kernel: [ 839.404818] [<ffffffff812d2573>] ? btrfs_find_free_ino+0xb3/0x140
Jun 1 09:44:29 lupus kernel: [ 839.404822] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:44:29 lupus kernel: [ 839.404828] [<ffffffff812e7a2d>] ? btrfs_mkdir+0x6d/0x1f0
Jun 1 09:44:29 lupus kernel: [ 839.404834] [<ffffffff8105a848>] ? ns_capable+0x28/0x50
Jun 1 09:44:29 lupus kernel: [ 839.404840] [<ffffffff8110eb57>] ? vfs_mkdir+0x67/0xf0
Jun 1 09:44:29 lupus kernel: [ 839.404845] [<ffffffff81112924>] ? sys_mkdirat+0x4/0xd0
Jun 1 09:44:29 lupus kernel: [ 839.404849] [<ffffffff811129dd>] ? sys_mkdirat+0xbd/0xd0
Jun 1 09:44:29 lupus kernel: [ 839.404854] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 09:44:29 lupus kernel: [ 839.404858] INFO: task rsync:7315 blocked for more than 120 seconds.
Jun 1 09:44:29 lupus kernel: [ 839.404860] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:44:29 lupus kernel: [ 839.404863] rsync D ffff88023fc91000 0 7315 7314 0x00000000
Jun 1 09:44:29 lupus kernel: [ 839.404868] ffff8802369a85f0 0000000000000082 00000000001e0000 ffff8802362af6c0
Jun 1 09:44:29 lupus kernel: [ 839.404874] ffff88019e2bbfd8 ffff88019e2bbfd8 ffff88019e2bbfd8 ffff8802362af6c0
Jun 1 09:44:29 lupus kernel: [ 839.404880] 0000000000000246 ffff880194222000 ffff8802357d2520 00000000001e0000
Jun 1 09:44:29 lupus kernel: [ 839.404886] Call Trace:
Jun 1 09:44:29 lupus kernel: [ 839.404891] [<ffffffff812d9edd>] ? wait_current_trans.isra.31+0x8d/0xf0
Jun 1 09:44:29 lupus kernel: [ 839.404895] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:44:29 lupus kernel: [ 839.404900] [<ffffffff812db303>] ? start_transaction+0x123/0x2a0
Jun 1 09:44:29 lupus kernel: [ 839.404905] [<ffffffff8110f47e>] ? path_init+0x17e/0x3c0
Jun 1 09:44:29 lupus kernel: [ 839.404910] [<ffffffff812e6a06>] ? btrfs_rename+0x166/0x6c0
Jun 1 09:44:29 lupus kernel: [ 839.404915] [<ffffffff81111395>] ? path_lookupat+0x65/0x6f0
Jun 1 09:44:29 lupus kernel: [ 839.404920] [<ffffffff8110f8dc>] ? vfs_rename+0x11c/0x460
Jun 1 09:44:29 lupus kernel: [ 839.404926] [<ffffffff81119e7e>] ? d_lookup+0x2e/0x60
Jun 1 09:44:29 lupus kernel: [ 839.404931] [<ffffffff8110e5bc>] ? __lookup_hash.part.36+0x2c/0xf0
Jun 1 09:44:29 lupus kernel: [ 839.404936] [<ffffffff81112ee2>] ? sys_renameat+0x222/0x240
Jun 1 09:44:29 lupus kernel: [ 839.404941] [<ffffffff8111cd56>] ? notify_change+0x1e6/0x350
Jun 1 09:44:29 lupus kernel: [ 839.404947] [<ffffffff8110197a>] ? chmod_common+0x8a/0xb0
Jun 1 09:44:29 lupus kernel: [ 839.404952] [<ffffffff81118e0a>] ? dput+0xba/0x240
Jun 1 09:44:29 lupus kernel: [ 839.404956] [<ffffffff8111f4f5>] ? mntput_no_expire+0x25/0x160
Jun 1 09:44:29 lupus kernel: [ 839.404961] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 09:46:29 lupus kernel: [ 959.198028] INFO: task btrfs-transacti:7069 blocked for more than 120 seconds.
Jun 1 09:46:29 lupus kernel: [ 959.198032] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:46:29 lupus kernel: [ 959.198036] btrfs-transacti D ffff88023fd91000 0 7069 2 0x00000000
Jun 1 09:46:29 lupus kernel: [ 959.198043] ffff88020f6bb570 0000000000000046 ffff88017b313000 ffff88020d070000
Jun 1 09:46:29 lupus kernel: [ 959.198050] ffff8802009d7fd8 ffff8802009d7fd8 ffff8802009d7fd8 ffff88020d070000
Jun 1 09:46:29 lupus kernel: [ 959.198056] ffff8802332d7360 ffff8802294bd370 7fffffffffffffff 0000000000000000
Jun 1 09:46:29 lupus kernel: [ 959.198062] Call Trace:
Jun 1 09:46:29 lupus kernel: [ 959.198072] [<ffffffff816d9ecd>] ? schedule_timeout+0x1fd/0x280
Jun 1 09:46:29 lupus kernel: [ 959.198080] [<ffffffff813254ee>] ? __btrfs_release_delayed_node+0x5e/0x190
Jun 1 09:46:29 lupus kernel: [ 959.198087] [<ffffffff810fa8e4>] ? kmem_cache_free+0x14/0x90
Jun 1 09:46:29 lupus kernel: [ 959.198093] [<ffffffff812f947d>] ? btrfs_run_ordered_operations+0x1ad/0x1c0
Jun 1 09:46:29 lupus kernel: [ 959.198099] [<ffffffff812da7d8>] ? btrfs_commit_transaction+0x318/0x960
Jun 1 09:46:29 lupus kernel: [ 959.198104] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:46:29 lupus kernel: [ 959.198109] [<ffffffff812db269>] ? start_transaction+0x89/0x2a0
Jun 1 09:46:29 lupus kernel: [ 959.198115] [<ffffffff812d4c6d>] ? transaction_kthread+0x22d/0x2a0
Jun 1 09:46:29 lupus kernel: [ 959.198121] [<ffffffff812d4a40>] ? btrfs_destroy_delayed_refs.isra.101+0x1d0/0x1d0
Jun 1 09:46:29 lupus kernel: [ 959.198128] [<ffffffff8106c435>] ? kthread+0x85/0x90
Jun 1 09:46:29 lupus kernel: [ 959.198134] [<ffffffff816ddfd4>] ? kernel_thread_helper+0x4/0x10
Jun 1 09:46:29 lupus kernel: [ 959.198140] [<ffffffff8106c3b0>] ? kthread_freezable_should_stop+0x60/0x60
Jun 1 09:46:29 lupus kernel: [ 959.198145] [<ffffffff816ddfd0>] ? gs_change+0xb/0xb
Jun 1 09:46:29 lupus kernel: [ 959.198158] INFO: task rsync:7314 blocked for more than 120 seconds.
Jun 1 09:46:29 lupus kernel: [ 959.198161] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:46:29 lupus kernel: [ 959.198164] rsync D ffff88023fc91000 0 7314 7313 0x00000000
Jun 1 09:46:29 lupus kernel: [ 959.198169] ffff8802369a85f0 0000000000000082 ffff8801a1be9e68 ffff8801ff18eae0
Jun 1 09:46:29 lupus kernel: [ 959.198175] ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801a1be9fd8 ffff8801ff18eae0
Jun 1 09:46:29 lupus kernel: [ 959.198181] 0000000000000246 ffff8802357d2400 ffff8802357d2620 ffff8801a1be9ed8
Jun 1 09:46:29 lupus kernel: [ 959.198187] Call Trace:
Jun 1 09:46:29 lupus kernel: [ 959.198193] [<ffffffff812d2573>] ? btrfs_find_free_ino+0xb3/0x140
Jun 1 09:46:29 lupus kernel: [ 959.198197] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:46:29 lupus kernel: [ 959.198203] [<ffffffff812e7a2d>] ? btrfs_mkdir+0x6d/0x1f0
Jun 1 09:46:29 lupus kernel: [ 959.198209] [<ffffffff8105a848>] ? ns_capable+0x28/0x50
Jun 1 09:46:29 lupus kernel: [ 959.198215] [<ffffffff8110eb57>] ? vfs_mkdir+0x67/0xf0
Jun 1 09:46:29 lupus kernel: [ 959.198219] [<ffffffff81112924>] ? sys_mkdirat+0x4/0xd0
Jun 1 09:46:29 lupus kernel: [ 959.198223] [<ffffffff811129dd>] ? sys_mkdirat+0xbd/0xd0
Jun 1 09:46:29 lupus kernel: [ 959.198228] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 09:46:29 lupus kernel: [ 959.198232] INFO: task rsync:7315 blocked for more than 120 seconds.
Jun 1 09:46:29 lupus kernel: [ 959.198235] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun 1 09:46:29 lupus kernel: [ 959.198238] rsync D ffff88023fc91000 0 7315 7314 0x00000000
Jun 1 09:46:29 lupus kernel: [ 959.198243] ffff8802369a85f0 0000000000000082 00000000001e0000 ffff8802362af6c0
Jun 1 09:46:29 lupus kernel: [ 959.198249] ffff88019e2bbfd8 ffff88019e2bbfd8 ffff88019e2bbfd8 ffff8802362af6c0
Jun 1 09:46:29 lupus kernel: [ 959.198255] 0000000000000246 ffff880194222000 ffff8802357d2520 00000000001e0000
Jun 1 09:46:29 lupus kernel: [ 959.198261] Call Trace:
Jun 1 09:46:29 lupus kernel: [ 959.198265] [<ffffffff812d9edd>] ? wait_current_trans.isra.31+0x8d/0xf0
Jun 1 09:46:29 lupus kernel: [ 959.198270] [<ffffffff8106cd00>] ? add_wait_queue+0x60/0x60
Jun 1 09:46:29 lupus kernel: [ 959.198274] [<ffffffff812db303>] ? start_transaction+0x123/0x2a0
Jun 1 09:46:29 lupus kernel: [ 959.198279] [<ffffffff8110f47e>] ? path_init+0x17e/0x3c0
Jun 1 09:46:29 lupus kernel: [ 959.198284] [<ffffffff812e6a06>] ? btrfs_rename+0x166/0x6c0
Jun 1 09:46:29 lupus kernel: [ 959.198289] [<ffffffff81111395>] ? path_lookupat+0x65/0x6f0
Jun 1 09:46:29 lupus kernel: [ 959.198295] [<ffffffff8110f8dc>] ? vfs_rename+0x11c/0x460
Jun 1 09:46:29 lupus kernel: [ 959.198300] [<ffffffff81119e7e>] ? d_lookup+0x2e/0x60
Jun 1 09:46:29 lupus kernel: [ 959.198306] [<ffffffff8110e5bc>] ? __lookup_hash.part.36+0x2c/0xf0
Jun 1 09:46:29 lupus kernel: [ 959.198310] [<ffffffff81112ee2>] ? sys_renameat+0x222/0x240
Jun 1 09:46:29 lupus kernel: [ 959.198316] [<ffffffff8111cd56>] ? notify_change+0x1e6/0x350
Jun 1 09:46:29 lupus kernel: [ 959.198322] [<ffffffff8110197a>] ? chmod_common+0x8a/0xb0
Jun 1 09:46:29 lupus kernel: [ 959.198327] [<ffffffff81118e0a>] ? dput+0xba/0x240
Jun 1 09:46:29 lupus kernel: [ 959.198331] [<ffffffff8111f4f5>] ? mntput_no_expire+0x25/0x160
Jun 1 09:46:29 lupus kernel: [ 959.198336] [<ffffffff816dce22>] ? system_call_fastpath+0x16/0x1b
Jun 1 10:28:42 lupus kernel: [ 3488.338959] SysRq : Keyboard mode set to system default
Jun 1 10:28:43 lupus kernel: [ 3488.634449] SysRq : Keyboard mode set to system default
Jun 1 10:28:43 lupus kernel: [ 3488.897995] SysRq : Terminate All Tasks


when rsyncing large amounts of data and having large values in

/proc/sys/vm/dirty_background_ratio
/proc/sys/vm/dirty_ratio


the filesystem seems to take too long to react to input from the kernel/system/user/etc. when adding manual sync command (perhaps also an automatic sync),

from time to time I tend to sync manually (+ sdparm -C sync) to make sure that large amounts of data really got to the platters


so a "workaround" to circumvent running into that issue is to lower (haven't run into that issue with low values yet)

/proc/sys/vm/dirty_background_ratio
/proc/sys/vm/dirty_ratio

3 and 5


that running sync command can't be killed and strangely the filesystem doesn't sync (whereas reiser4 e.g. would continually keep the drive busy without syncing afaik)

so the only option is to restart via magic sysrq key + reisub
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
Dont Panic
Guru
Guru


Joined: 20 Jun 2007
Posts: 320
Location: SouthEast U.S.A.

PostPosted: Fri Jun 01, 2012 6:47 pm    Post subject: Reply with quote

I notice several transaction related functions in the callback.

Josef Bacik just put out a set of "Transaction abort fixes" patches.

http://comments.gmane.org/gmane.comp.file-systems.btrfs/17670

I don't know if they'll make it into 3.5 or not.

Let people review those patches for a couple of days, and if Josef still has them in his 'btrfs-next' git repo on kernel.org. Then you may want to give them a try.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Sat Jun 02, 2012 12:21 am    Post subject: Reply with quote

Dont Panic wrote:
I notice several transaction related functions in the callback.

Josef Bacik just put out a set of "Transaction abort fixes" patches.

http://comments.gmane.org/gmane.comp.file-systems.btrfs/17670

I don't know if they'll make it into 3.5 or not.

Let people review those patches for a couple of days, and if Josef still has them in his 'btrfs-next' git repo on kernel.org. Then you may want to give them a try.


awesome, thanks !

especially the last patch seems to be related to the issue I was seeing


*fingers crossed* that there are no issues


meanwhile I prepared the diff:

btrfs-3.5.x-transaction_abort_fixes.patch wrote:
diff -Nrupad linux-3.4_btrfs+_libata/fs/btrfs/disk-io.c linux-3.4_btrfs+_libata_bak/fs/btrfs/disk-io.c
--- linux-3.4_btrfs+_libata/fs/btrfs/disk-io.c 2012-06-02 02:05:34.872589285 +0200
+++ linux-3.4_btrfs+_libata_bak/fs/btrfs/disk-io.c 2012-06-02 01:56:47.901620753 +0200
@@ -3400,6 +3400,7 @@ int btrfs_destroy_delayed_refs(struct bt

delayed_refs = &trans->delayed_refs;

+again:
spin_lock(&delayed_refs->lock);
if (delayed_refs->num_entries == 0) {
spin_unlock(&delayed_refs->lock);
@@ -3407,36 +3408,31 @@ int btrfs_destroy_delayed_refs(struct bt
return ret;
}

- while ((node = rb_first(&delayed_refs->root)) != NULL) {
+ node = rb_first(&delayed_refs->root);
+ while (node) {
ref = rb_entry(node, struct btrfs_delayed_ref_node, rb_node);
+ node = rb_next(node);
+
+ ref->in_tree = 0;
+ rb_erase(&ref->rb_node, &delayed_refs->root);
+ delayed_refs->num_entries--;

atomic_set(&ref->refs, 1);
if (btrfs_delayed_ref_is_head(ref)) {
struct btrfs_delayed_ref_head *head;

head = btrfs_delayed_node_to_head(ref);
- if (!mutex_trylock(&head->mutex)) {
- atomic_inc(&ref->refs);
- spin_unlock(&delayed_refs->lock);
-
- /* Need to wait for the delayed ref to run */
- mutex_lock(&head->mutex);
- mutex_unlock(&head->mutex);
- btrfs_put_delayed_ref(ref);
-
- continue;
- }
-
+ spin_unlock(&delayed_refs->lock);
+ mutex_lock(&head->mutex);
kfree(head->extent_op);
delayed_refs->num_heads--;
if (list_empty(&head->cluster))
delayed_refs->num_heads_ready--;
list_del_init(&head->cluster);
+ mutex_unlock(&head->mutex);
+ btrfs_put_delayed_ref(ref);
+ goto again;
}
- ref->in_tree = 0;
- rb_erase(&ref->rb_node, &delayed_refs->root);
- delayed_refs->num_entries--;
-
spin_unlock(&delayed_refs->lock);
btrfs_put_delayed_ref(ref);

@@ -3524,9 +3520,11 @@ static int btrfs_destroy_marked_extents(
&(&BTRFS_I(page->mapping->host)->io_tree)->buffer,
offset >> PAGE_CACHE_SHIFT);
spin_unlock(&dirty_pages->buffer_lock);
- if (eb)
+ if (eb) {
ret = test_and_clear_bit(EXTENT_BUFFER_DIRTY,
&eb->bflags);
+ atomic_set(&eb->refs, 1);
+ }
if (PageWriteback(page))
end_page_writeback(page);

@@ -3540,8 +3538,8 @@ static int btrfs_destroy_marked_extents(
spin_unlock_irq(&page->mapping->tree_lock);
}

+ page->mapping->a_ops->invalidatepage(page, 0);
unlock_page(page);
- page_cache_release(page);
}
}

@@ -3587,13 +3585,16 @@ void btrfs_cleanup_one_transaction(struc
/* FIXME: cleanup wait for commit */
cur_trans->in_commit = 1;
cur_trans->blocked = 1;
- wake_up(&root->fs_info->transaction_blocked_wait);
+ if (waitqueue_active(&root->fs_info->transaction_blocked_wait))
+ wake_up(&root->fs_info->transaction_blocked_wait);

cur_trans->blocked = 0;
- wake_up(&root->fs_info->transaction_wait);
+ if (waitqueue_active(&root->fs_info->transaction_wait))
+ wake_up(&root->fs_info->transaction_wait);

cur_trans->commit_done = 1;
- wake_up(&cur_trans->commit_wait);
+ if (waitqueue_active(&cur_trans->commit_wait))
+ wake_up(&cur_trans->commit_wait);

btrfs_destroy_pending_snapshots(cur_trans);

diff -Nrupad linux-3.4_btrfs+_libata/fs/btrfs/inode.c linux-3.4_btrfs+_libata_bak/fs/btrfs/inode.c
--- linux-3.4_btrfs+_libata/fs/btrfs/inode.c 2012-06-02 02:05:40.921588944 +0200
+++ linux-3.4_btrfs+_libata_bak/fs/btrfs/inode.c 2012-06-02 01:56:47.920620752 +0200
@@ -830,7 +830,7 @@ static noinline int cow_file_range(struc
if (IS_ERR(trans)) {
extent_clear_unlock_delalloc(inode,
&BTRFS_I(inode)->io_tree,
- start, end, locked_page,
+ start, end, NULL,
EXTENT_CLEAR_UNLOCK_PAGE |
EXTENT_CLEAR_UNLOCK |
EXTENT_CLEAR_DELALLOC |
@@ -963,7 +963,7 @@ out:
out_unlock:
extent_clear_unlock_delalloc(inode,
&BTRFS_I(inode)->io_tree,
- start, end, locked_page,
+ start, end, NULL,
EXTENT_CLEAR_UNLOCK_PAGE |
EXTENT_CLEAR_UNLOCK |
EXTENT_CLEAR_DELALLOC |
@@ -1136,18 +1136,8 @@ static noinline int run_delalloc_nocow(s
u64 ino = btrfs_ino(inode);

path = btrfs_alloc_path();
- if (!path) {
- extent_clear_unlock_delalloc(inode,
- &BTRFS_I(inode)->io_tree,
- start, end, locked_page,
- EXTENT_CLEAR_UNLOCK_PAGE |
- EXTENT_CLEAR_UNLOCK |
- EXTENT_CLEAR_DELALLOC |
- EXTENT_CLEAR_DIRTY |
- EXTENT_SET_WRITEBACK |
- EXTENT_END_WRITEBACK);
+ if (!path)
return -ENOMEM;
- }

nolock = btrfs_is_free_space_inode(root, inode);

@@ -1157,15 +1147,6 @@ static noinline int run_delalloc_nocow(s
trans = btrfs_join_transaction(root);

if (IS_ERR(trans)) {
- extent_clear_unlock_delalloc(inode,
- &BTRFS_I(inode)->io_tree,
- start, end, locked_page,
- EXTENT_CLEAR_UNLOCK_PAGE |
- EXTENT_CLEAR_UNLOCK |
- EXTENT_CLEAR_DELALLOC |
- EXTENT_CLEAR_DIRTY |
- EXTENT_SET_WRITEBACK |
- EXTENT_END_WRITEBACK);
btrfs_free_path(path);
return PTR_ERR(trans);
}
@@ -1346,11 +1327,8 @@ out_check:
}
btrfs_release_path(path);

- if (cur_offset <= end && cow_start == (u64)-1) {
+ if (cur_offset <= end && cow_start == (u64)-1)
cow_start = cur_offset;
- cur_offset = end;
- }
-
if (cow_start != (u64)-1) {
ret = cow_file_range(inode, locked_page, cow_start, end,
page_started, nr_written, 1);
@@ -1369,17 +1347,6 @@ error:
if (!ret)
ret = err;

- if (ret && cur_offset < end)
- extent_clear_unlock_delalloc(inode,
- &BTRFS_I(inode)->io_tree,
- cur_offset, end, locked_page,
- EXTENT_CLEAR_UNLOCK_PAGE |
- EXTENT_CLEAR_UNLOCK |
- EXTENT_CLEAR_DELALLOC |
- EXTENT_CLEAR_DIRTY |
- EXTENT_SET_WRITEBACK |
- EXTENT_END_WRITEBACK);
-
btrfs_free_path(path);
return ret;
}
diff -Nrupad linux-3.4_btrfs+_libata/fs/btrfs/transaction.c linux-3.4_btrfs+_libata_bak/fs/btrfs/transaction.c
--- linux-3.4_btrfs+_libata/fs/btrfs/transaction.c 2012-06-02 02:05:28.272589683 +0200
+++ linux-3.4_btrfs+_libata_bak/fs/btrfs/transaction.c 2012-06-02 01:56:47.933620751 +0200
@@ -100,10 +100,6 @@ loop:
kmem_cache_free(btrfs_transaction_cachep, cur_trans);
cur_trans = fs_info->running_transaction;
goto loop;
- } else if (root->fs_info->fs_state & BTRFS_SUPER_FLAG_ERROR) {
- spin_unlock(&root->fs_info->trans_lock);
- kmem_cache_free(btrfs_transaction_cachep, cur_trans);
- return -EROFS;
}

atomic_set(&cur_trans->num_writers, 1);
@@ -846,9 +842,7 @@ static noinline int commit_fs_roots(stru
btrfs_update_reloc_root(trans, root);
btrfs_orphan_commit_root(trans, root);

- err = btrfs_save_ino_cache(root, trans);
- if (err)
- goto out;
+ btrfs_save_ino_cache(root, trans);

/* see comments in should_cow_block() */
root->force_cow = 0;
@@ -873,7 +867,6 @@ static noinline int commit_fs_roots(stru
}
}
spin_unlock(&fs_info->fs_roots_radix_lock);
-out:
return err;
}

@@ -1220,20 +1213,14 @@ int btrfs_commit_transaction_async(struc


static void cleanup_transaction(struct btrfs_trans_handle *trans,
- struct btrfs_root *root, int err)
+ struct btrfs_root *root)
{
struct btrfs_transaction *cur_trans = trans->transaction;

WARN_ON(trans->use_count > 1);

- btrfs_abort_transaction(trans, root, err);
-
spin_lock(&root->fs_info->trans_lock);
list_del_init(&cur_trans->list);
- if (cur_trans == root->fs_info->running_transaction) {
- root->fs_info->running_transaction = NULL;
- root->fs_info->trans_no_join = 0;
- }
spin_unlock(&root->fs_info->trans_lock);

btrfs_cleanup_one_transaction(trans->transaction, root);
@@ -1539,7 +1526,7 @@ cleanup_transaction:
// WARN_ON(1);
if (current->journal_info == trans)
current->journal_info = NULL;
- cleanup_transaction(trans, root, ret);
+ cleanup_transaction(trans, root);

return ret;
}

_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
ToeiRei
Veteran
Veteran


Joined: 03 Jan 2005
Posts: 1156
Location: Austria

PostPosted: Sat Jun 02, 2012 10:11 am    Post subject: Reply with quote

It's not a big problem to patch the kernel sources. You can also add chris mason's stuff and replace things on your local kernel as there aren't too many deps outside of btrfs...
_________________
Blog | btrfs | Please stand by - The mailer daemon is busy burning your messages in hell...
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Sat Jun 02, 2012 4:18 pm    Post subject: Reply with quote

ToeiRei wrote:
It's not a big problem to patch the kernel sources. You can also add chris mason's stuff and replace things on your local kernel as there aren't too many deps outside of btrfs...


yeah it's pretty straightforward :)



anyone got the following errors already btw ?

it shows an error for an transaction and then remounts the filesystem read-only (that's more like it ! reiser4 also did the same to ensure that safety, integrity & consistency on the disk)


currently running a scrub to see whether it find anything

strangely another harddrive with similar/same content revealed no errors during rsync




I'm currently trying latest 3.5.x + transaction abort fixes patchset:

Quote:
[17608.336357] WARNING: at fs/btrfs/extent-tree.c:124 btrfs_put_block_group+0x5e/0x60()
[17608.336363] Hardware name: ipower G3710
[17608.336366] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.336432] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.336439] Call Trace:
[17608.336446] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.336459] [<ffffffff812e54ce>] ? btrfs_put_block_group+0x5e/0x60
[17608.336469] [<ffffffff812ed428>] ? btrfs_free_block_groups+0x98/0x340
[17608.336482] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.336489] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.336498] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.336511] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.336520] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.336532] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.336541] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.336552] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.336560] ---[ end trace 44212655964fc1c6 ]---
[17608.336599] ------------[ cut here ]------------
[17608.336605] WARNING: at fs/btrfs/extent-tree.c:124 btrfs_put_block_group+0x5e/0x60()
[17608.336611] Hardware name: ipower G3710
[17608.336614] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.336680] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.336687] Call Trace:
[17608.336694] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.336708] [<ffffffff812e54ce>] ? btrfs_put_block_group+0x5e/0x60
[17608.336717] [<ffffffff812ed428>] ? btrfs_free_block_groups+0x98/0x340
[17608.336730] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.336737] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.336746] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.336759] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.336767] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.336779] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.336789] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.336799] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.336806] ---[ end trace 44212655964fc1c7 ]---
[17608.336810] ------------[ cut here ]------------
[17608.336816] WARNING: at fs/btrfs/extent-tree.c:125 btrfs_put_block_group+0x4b/0x60()
[17608.336824] Hardware name: ipower G3710
[17608.336828] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.336910] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.336918] Call Trace:
[17608.336925] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.336939] [<ffffffff812e54bb>] ? btrfs_put_block_group+0x4b/0x60
[17608.336949] [<ffffffff812ed428>] ? btrfs_free_block_groups+0x98/0x340
[17608.336962] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.336970] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.336979] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.336991] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.336999] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.337011] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.337020] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.337030] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.337036] ---[ end trace 44212655964fc1c8 ]---
[17608.337042] ------------[ cut here ]------------
[17608.337049] WARNING: at fs/btrfs/extent-tree.c:124 btrfs_put_block_group+0x5e/0x60()
[17608.337057] Hardware name: ipower G3710
[17608.337061] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.337149] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.337156] Call Trace:
[17608.337164] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.337180] [<ffffffff812e54ce>] ? btrfs_put_block_group+0x5e/0x60
[17608.337188] [<ffffffff812ed428>] ? btrfs_free_block_groups+0x98/0x340
[17608.337198] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.337208] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.337218] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.337224] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.337230] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.337237] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.337246] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.337257] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.337263] ---[ end trace 44212655964fc1c9 ]---
[17608.337277] ------------[ cut here ]------------
[17608.337282] WARNING: at fs/btrfs/extent-tree.c:124 btrfs_put_block_group+0x5e/0x60()
[17608.337289] Hardware name: ipower G3710
[17608.337293] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.337368] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.337374] Call Trace:
[17608.337381] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.337393] [<ffffffff812e54ce>] ? btrfs_put_block_group+0x5e/0x60
[17608.337401] [<ffffffff812ed428>] ? btrfs_free_block_groups+0x98/0x340
[17608.337412] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.337420] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.337430] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.337436] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.337442] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.337449] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.337457] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.337468] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.337474] ---[ end trace 44212655964fc1ca ]---
[17608.337482] ------------[ cut here ]------------
[17608.337488] WARNING: at fs/btrfs/extent-tree.c:124 btrfs_put_block_group+0x5e/0x60()
[17608.337495] Hardware name: ipower G3710
[17608.337499] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.337574] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.337580] Call Trace:
[17608.337587] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.337599] [<ffffffff812e54ce>] ? btrfs_put_block_group+0x5e/0x60
[17608.337608] [<ffffffff812ed428>] ? btrfs_free_block_groups+0x98/0x340
[17608.337620] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.337628] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.337637] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.337644] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.337650] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.337657] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.337669] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.337677] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.337683] ---[ end trace 44212655964fc1cb ]---
[17608.341159] ------------[ cut here ]------------
[17608.341171] WARNING: at fs/btrfs/extent-tree.c:4277 btrfs_free_block_groups+0x31d/0x340()
[17608.341179] Hardware name: ipower G3710
[17608.341184] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.341266] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.341280] Call Trace:
[17608.341288] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.341298] [<ffffffff812ed6ad>] ? btrfs_free_block_groups+0x31d/0x340
[17608.341312] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.341320] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.341329] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.341342] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.341350] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.341362] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.341371] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.341383] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.341389] ---[ end trace 44212655964fc1cc ]---
[17608.341393] ------------[ cut here ]------------
[17608.341401] WARNING: at fs/btrfs/extent-tree.c:7537 btrfs_free_block_groups+0x232/0x340()
[17608.341409] Hardware name: ipower G3710
[17608.341414] Modules linked in: radeon drm_kms_helper ttm drm cfbfillrect cfbimgblt cfbcopyarea i2c_algo_bit it87 hwmon_vid nf_conntrack_ftp nf_conntrack_irc ipt_REJECT xt_state xt_LOG xt_limit iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek i2c_i801 i7core_edac coretemp snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc wmi e1000e snd_timer snd soundcore e1000 lockd auth_rpcgss sunrpc scsi_wait_scan sl811_hcd ohci_hcd ssb usb_storage ehci_hcd [last unloaded: firewire_core]
[17608.341497] Pid: 19350, comm: umount Tainted: G W 3.4.0_btrfs+_libata #1
[17608.341509] Call Trace:
[17608.341516] [<ffffffff810577bb>] ? warn_slowpath_common+0x7b/0xc0
[17608.341526] [<ffffffff812ed5c2>] ? btrfs_free_block_groups+0x232/0x340
[17608.341540] [<ffffffff812f84ce>] ? close_ctree+0x19e/0x310
[17608.341547] [<ffffffff8113486c>] ? evict_inodes+0xfc/0x110
[17608.341555] [<ffffffff8111cb6a>] ? generic_shutdown_super+0x5a/0xf0
[17608.341569] [<ffffffff8111cc89>] ? kill_anon_super+0x9/0x20
[17608.341576] [<ffffffff812d5a8d>] ? btrfs_kill_super+0xd/0x80
[17608.341588] [<ffffffff8111ce83>] ? deactivate_locked_super+0x43/0x80
[17608.341596] [<ffffffff811387ab>] ? sys_umount+0x7b/0x390
[17608.341608] [<ffffffff81707d66>] ? system_call_fastpath+0x1a/0x1f
[17608.341614] ---[ end trace 44212655964fc1cd ]---
[17608.341619] space_info 5 has 85275021312 free, is full
[17608.341625] space_info total=1000198569984, used=914912882688, pinned=10522624, reserved=12288, may_use=0, readonly=131072



edit:


ok, seems some stuff had to be updated

obviously scrub did the job :)


Quote:
[33672.499425] btrfs: force zlib compression
[33672.499435] btrfs: enabling inode map caching
[33672.499441] btrfs: not using ssd allocation scheme
[33672.499444] btrfs: disk space caching is enabled
[33672.574004] btrfs: bdev /dev/mapper/btrfs_bak01 errs: wr 0, rd 0, flush 0, corrupt 0, gen 0

_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
Dont Panic
Guru
Guru


Joined: 20 Jun 2007
Posts: 320
Location: SouthEast U.S.A.

PostPosted: Mon Jun 04, 2012 5:24 pm    Post subject: Reply with quote

kernelOfTruth wrote:

obviously scrub did the job :)


Quote:
[33672.499425] btrfs: force zlib compression
[33672.499435] btrfs: enabling inode map caching
[33672.499441] btrfs: not using ssd allocation scheme
[33672.499444] btrfs: disk space caching is enabled
[33672.574004] btrfs: bdev /dev/mapper/btrfs_bak01 errs: wr 0, rd 0, flush 0, corrupt 0, gen 0

I see "errs: wr 0, rd 0, flush 0, corrupt 0, gen 0" is highlighted.

This kernel message is just a summary of accumulated I/O errors, primarily intended for detecting when a disk in a RAID array is starting to go bad.

I can see how this message might imply some kind of integrity check was performed. But, currently, the only user-land integrity check that I know of is btrfsck.

There are actually some patches in the kernel to allow for a quick mount-time integrity check. But, I don't believe those patches are actually implemented in any fashion.
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Thu Jun 21, 2012 7:48 pm    Post subject: Reply with quote

Dont Panic wrote:
kernelOfTruth wrote:

obviously scrub did the job :)


Quote:
[33672.499425] btrfs: force zlib compression
[33672.499435] btrfs: enabling inode map caching
[33672.499441] btrfs: not using ssd allocation scheme
[33672.499444] btrfs: disk space caching is enabled
[33672.574004] btrfs: bdev /dev/mapper/btrfs_bak01 errs: wr 0, rd 0, flush 0, corrupt 0, gen 0

I see "errs: wr 0, rd 0, flush 0, corrupt 0, gen 0" is highlighted.

This kernel message is just a summary of accumulated I/O errors, primarily intended for detecting when a disk in a RAID array is starting to go bad.

I can see how this message might imply some kind of integrity check was performed. But, currently, the only user-land integrity check that I know of is btrfsck.

There are actually some patches in the kernel to allow for a quick mount-time integrity check. But, I don't believe those patches are actually implemented in any fashion.


yeah it seems to be some kind of new feature showing the current state which is pretty neat if you ask me :)


I didn't had any issues so far



oh - some of you might like the following patch :wink: (won't have time to test soon but hopefully this will fix some issues for you - afaik I haven't seen ENOSPC errors for a long time)

http://marc.info/?l=linux-btrfs&m=134030482216452&w=2




the below one might speed up things significantly:

http://marc.info/?l=linux-btrfs&m=134027062402446&w=2
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
petrjanda
Veteran
Veteran


Joined: 05 Sep 2003
Posts: 1557
Location: Brno, Czech Republic

PostPosted: Sun Jun 24, 2012 2:18 am    Post subject: Reply with quote

Last time I posted in this thread 16 months ago. Is btrfs still a fail?
_________________
There is, a not-born, a not-become, a not-made, a not-compounded. If that unborn, not-become, not-made, not-compounded were not, there would be no escape from this here that is born, become, made and compounded. - Gautama Siddharta
Back to top
View user's profile Send private message
kernelOfTruth
Watchman
Watchman


Joined: 20 Dec 2005
Posts: 5679
Location: Vienna, Austria; Germany; hello world :)

PostPosted: Sun Jun 24, 2012 9:18 am    Post subject: Reply with quote

petrjanda wrote:
Last time I posted in this thread 16 months ago. Is btrfs still a fail?


seems so - at least according to some messages in the mailing list

but from my experience it's quickly getting better

so it'll soon-ish be in a good & usable state

even btrfsck already has some fixing functionality ;)
_________________
Unofficial minimal livecd x86/amd64 w/reiser4+truecrypt (by Neo2)
2.6.37.2_plus_v1: BFS, CFS,THP,compaction, zcache or TOI
Hardcore Linux user since 2004 :D
Back to top
View user's profile Send private message
d2_racing
Moderator
Moderator


Joined: 25 Apr 2005
Posts: 13046
Location: Ste-Foy,Canada

PostPosted: Fri Jul 27, 2012 12:01 am    Post subject: Reply with quote

So if I want to test Btrfs, I should try this :

1. Use the latest git-sources
2. Use the latest btrfs-progs, not the 9999 version I guess

Am I on the right track ?

Finally, I should install my Gentoo box inside a subvolume I guess too.
_________________
Sysadmin of GentooQuébec.org
Wiki
Signature
IRC on Freenode : #gentoo-quebec
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Gentoo Chat All times are GMT
Goto page Previous  1, 2, 3 ... 9, 10, 11
Page 11 of 11

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum