Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
HELP! My /home partition keeps filling up.
View unanswered posts
View posts from last 24 hours

Goto page Previous  1, 2  
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo
View previous topic :: View next topic  
Author Message
salfter
n00b
n00b


Joined: 02 Jan 2003
Posts: 64

PostPosted: Wed Jul 10, 2019 5:12 pm    Post subject: Reply with quote

In my case, I logged into my home desktop this morning to find / was full. I eventually tracked it down to ~/.local/share/sddm/xorg-session.log, which had grown to 90 GB. I truncated it with echo -n...it freed up lots of space on disk, but the indicated length was still a long way from zero. I found that it was getting spammed with these two messages repeatedly:

Code:
org.kde.baloo.engine: PostingDB::put MDB_BAD_TXN: Transaction must abort, has a child, or is invalid
org.kde.baloo.engine: PositionDB::put MDB_BAD_TXN: Transaction must abort, has a child, or is invalid


pkill baloo put an end to that nonsense.
Back to top
View user's profile Send private message
Fitzcarraldo
Veteran
Veteran


Joined: 30 Aug 2008
Posts: 1787
Location: United Kingdom

PostPosted: Mon Aug 19, 2019 2:56 pm    Post subject: Reply with quote

salfter wrote:
In my case, I logged into my home desktop this morning to find / was full. I eventually tracked it down to ~/.local/share/sddm/xorg-session.log, which had grown to 90 GB. I truncated it with echo -n...it freed up lots of space on disk, but the indicated length was still a long way from zero. I found that it was getting spammed with these two messages repeatedly:

Code:
org.kde.baloo.engine: PostingDB::put MDB_BAD_TXN: Transaction must abort, has a child, or is invalid
org.kde.baloo.engine: PositionDB::put MDB_BAD_TXN: Transaction must abort, has a child, or is invalid


pkill baloo put an end to that nonsense.

I discovered today that ~/.xsession-errors was full of these two error messages and growing continually. Baloo seems to be a perennial source of trouble. The best thing is simply to disable it:
Code:
$ balooctl disable
$ >~/.xsession-errors

_________________
Clevo W230SS: amd64 nvidia-drivers & xf86-video-intel.
Compal NBLB2: ~amd64 xf86-video-ati. Dual boot Win 7 Pro 64-bit.
OpenRC eudev elogind & KDE on both.

Fitzcarraldo's blog
Back to top
View user's profile Send private message
Naib
Watchman
Watchman


Joined: 21 May 2004
Posts: 5785
Location: Removed by Neddy

PostPosted: Mon Aug 19, 2019 3:51 pm    Post subject: Reply with quote

Honestly this is one major oversight here... There should be some warning to the user if this logfile grows above a certain size as most of the time it isn't checked.

I might add a simple zenity check at login ( if > ... Then...)
_________________
The best argument against democracy is a five-minute conversation with the average voter
Great Britain is a republic, with a hereditary president, while the United States is a monarchy with an elective king
Back to top
View user's profile Send private message
salfter
n00b
n00b


Joined: 02 Jan 2003
Posts: 64

PostPosted: Mon Aug 19, 2019 7:07 pm    Post subject: Reply with quote

Fitzcarraldo wrote:
salfter wrote:
In my case, I logged into my home desktop this morning to find / was full. I eventually tracked it down to ~/.local/share/sddm/xorg-session.log, which had grown to 90 GB. I truncated it with echo -n...it freed up lots of space on disk, but the indicated length was still a long way from zero. I found that it was getting spammed with these two messages repeatedly:

Code:
org.kde.baloo.engine: PostingDB::put MDB_BAD_TXN: Transaction must abort, has a child, or is invalid
org.kde.baloo.engine: PositionDB::put MDB_BAD_TXN: Transaction must abort, has a child, or is invalid


pkill baloo put an end to that nonsense.

I discovered today that ~/.xsession-errors was full of these two error messages and growing continually. Baloo seems to be a perennial source of trouble. The best thing is simply to disable it:
Code:
$ balooctl disable
$ >~/.xsession-errors


I've since gone a step further, as baloo was causing other issues:

Code:
$ sudo euse -D semantic-desktop && sudo emerge -uNDv @world && sudo emerge --depclean && sudo eclean-dist --deep


It's now gone completely. Its absence hasn't affected functionality in any way that I can detect.
Back to top
View user's profile Send private message
don quixada
l33t
l33t


Joined: 15 May 2003
Posts: 738

PostPosted: Tue Sep 03, 2019 3:06 pm    Post subject: Reply with quote

I just started having these issues and after only one day I had a 262Gig .~/.local/share/sddm/xorg-session.log file.

'balooctl disable' fixed it but is this a bug that should be reported?

dq


Last edited by don quixada on Wed Oct 02, 2019 12:16 am; edited 1 time in total
Back to top
View user's profile Send private message
Anon-E-moose
Advocate
Advocate


Joined: 23 May 2008
Posts: 4398
Location: Dallas area

PostPosted: Tue Sep 03, 2019 3:11 pm    Post subject: Reply with quote

what does man say about balooctl and logging, lots of times there's a quiet option? (I don't run kde so have no answer)

You don't need baloo, it just keeps metadata about files on the system, similar to windows file indexing. Can speed things up (especially on slow hdd, less useful for ssd, IMO)
_________________
Asus m5a99fx, FX 8320 - nouveau, oss4, rx550 for qemu passthrough
Acer laptop E5-575, i3-7100u - i965, alsa
---both---
5.0.13 zen kernel, profile 17.1 (no-pie & modified) amd64-no-multilib
gcc 8.2.0, eudev, openrc, openbox, palemoon
Back to top
View user's profile Send private message
Hu
Moderator
Moderator


Joined: 06 Mar 2007
Posts: 14945

PostPosted: Wed Sep 04, 2019 1:27 am    Post subject: Reply with quote

In my opinion, it is absolutely a bug that a program would go writing gigabytes of error logs without explicit instruction from the user.
Back to top
View user's profile Send private message
don quixada
l33t
l33t


Joined: 15 May 2003
Posts: 738

PostPosted: Wed Sep 04, 2019 2:32 am    Post subject: Reply with quote

Anon-E-moose wrote:
what does man say about balooctl and logging, lots of times there's a quiet option? (I don't run kde so have no answer)

You don't need baloo, it just keeps metadata about files on the system, similar to windows file indexing. Can speed things up (especially on slow hdd, less useful for ssd, IMO)


Code:
# man balooctl
No manual entry for balooctl
# man baloo
No manual entry for baloo


Hey BTW, I've been messing with my RAID partitions (reference here). Do you think this is why baloo went wonky? I've never had this happen before to baloo.

dq
Back to top
View user's profile Send private message
don quixada
l33t
l33t


Joined: 15 May 2003
Posts: 738

PostPosted: Wed Oct 02, 2019 12:19 am    Post subject: Reply with quote

Is there a way to permanently remove/disable balooctl? I rebooted and it quickly filled up my partition again...
Back to top
View user's profile Send private message
ct85711
Veteran
Veteran


Joined: 27 Sep 2005
Posts: 1741

PostPosted: Wed Oct 02, 2019 6:55 pm    Post subject: Reply with quote

Doing a quick search, this may have some useful information:

https://forums.opensuse.org/showthread.php/534745-KDE-and-Baloo-File-Indexing
Back to top
View user's profile Send private message
don quixada
l33t
l33t


Joined: 15 May 2003
Posts: 738

PostPosted: Thu Oct 03, 2019 1:07 am    Post subject: Reply with quote

Thanks, I see that script. The funny thing is that if I use that script as-is it will check every 2 days but I can guarantee my 1TB (mostly empty) partition will fill up before then!

(obviously I will change the interval in the script...) Thanks again!

dq
Back to top
View user's profile Send private message
mrbassie
Guru
Guru


Joined: 31 May 2013
Posts: 579

PostPosted: Thu Oct 03, 2019 3:01 pm    Post subject: Reply with quote

don quixada wrote:
Is there a way to permanently remove/disable balooctl? I rebooted and it quickly filled up my partition again...


If you want to remove baloo altogether:

Code:
kde-plasma/plasma-desktop -semantic-desktop


in package.use.
Back to top
View user's profile Send private message
ct85711
Veteran
Veteran


Joined: 27 Sep 2005
Posts: 1741

PostPosted: Thu Oct 03, 2019 4:05 pm    Post subject: Reply with quote

The link I posted also told you which config file to change (and what part), to disable the file-indexing that baloo does. Once that is disabled, baloo shouldn't be filling up your hard drive.
Back to top
View user's profile Send private message
Fitzcarraldo
Veteran
Veteran


Joined: 30 Aug 2008
Posts: 1787
Location: United Kingdom

PostPosted: Fri Oct 11, 2019 6:35 pm    Post subject: Reply with quote

Naib wrote:
Honestly this is one major oversight here... There should be some warning to the user if this logfile grows above a certain size as most of the time it isn't checked.

I might add a simple zenity check at login ( if > ... Then...)

In the end I used crontab Example #2 from Daniel López Azaña's 2017 blog post How to prevent the .xsession-errors file from growing to a huge size to check every 15 minutes if the file size is greater than 5 GB and if so truncates it to the last 10,000 lines:

Code:
*/15      *     *       *       *       [ $(du -k .xsession-errors | awk '{ print $1 }') -gt 5000000 ] && tail -10000 /home/$(whoami)/.xsession-errors > /home/$(whoami)/.xsession-errors

_________________
Clevo W230SS: amd64 nvidia-drivers & xf86-video-intel.
Compal NBLB2: ~amd64 xf86-video-ati. Dual boot Win 7 Pro 64-bit.
OpenRC eudev elogind & KDE on both.

Fitzcarraldo's blog
Back to top
View user's profile Send private message
Hu
Moderator
Moderator


Joined: 06 Mar 2007
Posts: 14945

PostPosted: Sat Oct 12, 2019 12:17 am    Post subject: Reply with quote

It looks like your solution may be a bit more effective than you intended. As I read that command, your shell will truncate the output file to be empty, then you will copy the last 10000 lines of the now empty file into the file. This leaves you with a zero line file, until the runaway logger starts adding to it again.
Back to top
View user's profile Send private message
Anon-E-moose
Advocate
Advocate


Joined: 23 May 2008
Posts: 4398
Location: Dallas area

PostPosted: Sat Oct 12, 2019 12:48 am    Post subject: Reply with quote

I would do it this way

tail -10000 /home/$(whoami)/.xsession-errors > /tmp/tmpname && mv /tmp/tmpname /home/$(whoami)/.xsession-errors

With the realization, that I might lose a message or two in the process.

Or if you really don't care about the errors (which most of the time you won't) then a simple >~/.xsession-errors will suffice.
_________________
Asus m5a99fx, FX 8320 - nouveau, oss4, rx550 for qemu passthrough
Acer laptop E5-575, i3-7100u - i965, alsa
---both---
5.0.13 zen kernel, profile 17.1 (no-pie & modified) amd64-no-multilib
gcc 8.2.0, eudev, openrc, openbox, palemoon
Back to top
View user's profile Send private message
Fitzcarraldo
Veteran
Veteran


Joined: 30 Aug 2008
Posts: 1787
Location: United Kingdom

PostPosted: Sat Oct 12, 2019 1:32 am    Post subject: Reply with quote

Hu wrote:
It looks like your solution may be a bit more effective than you intended. As I read that command, your shell will truncate the output file to be empty, then you will copy the last 10000 lines of the now empty file into the file. This leaves you with a zero line file, until the runaway logger starts adding to it again.

Doh. Well spotted! Thanks. I should have actually tested it. I have changed it to use sponge (from sys-apps/moreutils) rather than specify a temporary file:

Code:
*/15      *     *       *       *       [ $(du -k /home/$(whoami)/.xsession-errors | awk '{ print $1 }') -gt 5000000 ] && tail -n 10000 /home/$(whoami)/.xsession-errors | sponge /home/$(whoami)/.xsession-errors


A quick test shows sponge does the job:
Code:
$ du -k .xsession-errors | awk '{ print $1 }'
72
$ wc -l ~/.xsession-errors
779 /home/fitzcarraldo/.xsession-errors
$ [ $(du -k /home/$(whoami)/.xsession-errors | awk '{ print $1 }') -gt 70 ] && tail -n 100 /home/$(whoami)/.xsession-errors | sponge /home/$(whoami)/.xsession-errors
$ wc -l ~/.xsession-errors
100 /home/fitzcarraldo/.xsession-errors

_________________
Clevo W230SS: amd64 nvidia-drivers & xf86-video-intel.
Compal NBLB2: ~amd64 xf86-video-ati. Dual boot Win 7 Pro 64-bit.
OpenRC eudev elogind & KDE on both.

Fitzcarraldo's blog
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo All times are GMT
Goto page Previous  1, 2
Page 2 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum