| View previous topic :: View next topic |
| Author |
Message |
paziu
n00b
Joined: 24 Nov 2006
Posts: 62
Location: N.Carolina
|
 Posted: Wed Feb 29, 2012 1:46 pm Post subject: out of memory killer again.... |
 |
|
hello,
I have been running 2.6.39-r3 for near 1 year now, 24 / 7, bfs, preemption disabled - doing often time and cpu heavy things like video encoding etc...
I wrote a couple of scripts recently that parse some ascii / html data,
suddenly after executing the cat / sort / sed piped commands the system goes nutz, most daemons are getting killed, X dies.... I am still able to access the console
the funny thing is, that it only dies when using tools from the coreutilst (8.12) against ascii data, it never "chokes" when running multithreaded processes of any other kind ( compressing / encoding / you name it )
the workstation has 12GB ram and a i5 650 dual core with h/t.
I got a part of dmesg output here, this repeats for most daemons / processes running on the system - just pasted one instance. /var/messages got nothing interesting
http://pastebin.com/Z7kQfhWB
kernel config:
http://pastebin.com/UiXmf1hL
this is the line that the system oops'ed on me quite a few times, especially it the input data ($FNAME_TMP) is around 50MB - 500k lines of html :
| Code: | | sort -f $FNAME_TMP | sed 's/<\/div>/<\/div><\/i><hr>/g' | sed 's/<A HREF/<A H_REF/g' > $FNAME |
I am quite sure it is not a hardware problem, I let the system "exercise" quite often...
Thank you for any suggestions,
Mike
[edit]
it looks like "out of mem", but I do not see that 12GB is consumed while running sort/sed against 50MB of ascii - even if that's the case - I do not understand that running such processes can cause oom-killer to wipe out several daemons / processes on a system? I would expect it on a windoz 98 box but not on a 2.6.39 gentoo
Last edited by paziu on Wed Apr 25, 2012 4:45 pm; edited 3 times in total |
|
| Back to top |
|
 |
paziu
n00b
Joined: 24 Nov 2006
Posts: 62
Location: N.Carolina
|
| Posted: Wed Apr 25, 2012 4:44 pm Post subject: |
|
|
Ciao!
It is possible and I probably should change the way I am expressing myself here, on the Gentoo forum.
In the meantime I, changed ( optimized ) the parsing of the HTML ( a few day home_use project - local dictionary/encyclopedia lookup and crossword puzzle "semi-solver" )
Since than I never got the OOM_KILLA again.
Last week I got a small present for myself, dual quad 54xx xeon system - for now just 8GB RAM.
I was in the middle of compiling "openbricks" ( during stripping one of the micro ftpd's ) when I lost connectivity via openvpn, so I used a secondary "door" to see what's up ( not much ).
The system had about 10% of the original processes / services running, including sshd ( how nice ).
it again OOM-ed for a mysterious reason, I was able to get dmesg before restarting:
http://sebsauvage.net/paste/?33160522fd19f6be#jBK0JDWhxR+KNqCoapYlRDgrI7U5cKDNngrFhPFsOvo=
I would greatly appreciate all your suggestions,
Mike |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Kernel & Hardware
