| View previous topic :: View next topic |
| Author |
Message |
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
 Posted: Sun Jul 25, 2021 9:13 am Post subject: Possible QtWebEngine memory leak (was: Konqueror issues) |
 |
|
Hello Gentoo users!
And hello Konqueror users!
I am browsing most of my computer and Linux related sites in Konqueror. I have to confess that over the years the state of Konqueror as a reliable browser declined gradually. There are some functions that just don't work anymore for quite some time on my system, and I know others have the same issue. To name just a few:
- Spell checking is not working in Konqueror (e.g. Spell checking in Konqueror from 2015), but works e.g. with Kate.
- Adblocker and automatic lists don't work (e.g. Adblock doesn't works from 2013), but used to work in the (long gone) past.
- Switching the user agent doesn't work anymore (in the Tools menu).
- Konqueror crashes way more often than any other browser I use, but not so often that it would make me stop using it. (A couple of times a week maybe.)
In general Konqueror was a long time on the edge due to users being unsatisfied with it (e.g. Konqueror should be replaced by a better web browser from 2009). [And I'm not getting into the replacement of Konqueror as a file browser; I think Dolphin does a great job as a file browser; e.g. KDE is great ... and sucks.]
I still prefer Konqueror over any other browser on my Linux system as it is something that is unique to Linux and KDE (Plasma). Firefox, Chromium and Opera can be run on any operating system but Konqueror has a special place in my heard since I started using KDE almost 20 years ago, and I'm almost proud (as a spectator, as a user I didn't help in any way) that KHTML (Konqueror) is the father of WebKit (Safari) and Blink (Chrome). Since those are the only two remaining rendering engines and every browser uses either of them, Konqueror now runs on Qt WebEngine as well (WebKit ported to Qt), but the unique KDE specific UI of the browser remains. I'm used to Web Shortcuts, which is probably the biggest issue I have with Firefox (which I am also using regularly).
Since the last update of dev-qt/qtwebengine from 5.15.2_p20210421 to 5.15.2_p20210625 I have a new issue. I would be greatful if someone could confirm this:
Please open https://www.heise.de/newsticker/ (it's in german) in a new tab. Leave it open and do something else (on the computer or away from the computer). If you return to the tab after a couple of hours, the tab is stalled and doesn't react to scolling and clicks.
Additionally, open one of the linked news articles in another tab. You'd see the same stalling after some hours.
This is a new issue introduced with the qtwebengine update. I cannot report this though because I don't see any other indication, like an error message or a useful log output.
So I'm curious, if you are a KDE (Plasma) user, what browser are you running?
What do you think of Konqueror?
If you use Konqueror, what are your issues with it?
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire
Last edited by Atha on Mon Jul 26, 2021 12:05 pm; edited 1 time in total |
|
| Back to top |
|
 |
pietinger
Moderator
Joined: 17 Oct 2006
Posts: 4130
Location: Bavaria
|
| Posted: Sun Jul 25, 2021 9:25 am Post subject: Re: Konqueror issues |
|
|
| Atha wrote: | | What do you think of Konqueror? |
It was my first browser with gentoo-kde ... and my only ... still having it ... and USING it ... because I am using two browsers in my kde ->
| Atha wrote: | | So I'm curious, if you are a KDE (Plasma) user, what browser are you running? |
falkon ! I can only recommend it ... all what konqueror cant do, is managed by it ... all what falkon cant do ...  |
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Sun Jul 25, 2021 10:28 am Post subject: Re: Konqueror issues |
|
|
| pietinger wrote: | | falkon ! I can only recommend it ... all what konqueror cant do, is managed by it ... all what falkon cant do ... |
Thanks, I already had Falkon installed on my system. How do web shortcuts work? The defaults are e.g. "d" for duckduckgo and "g" for google, but entering "g:string" searches for "g:string" from the default search engine (duckduckgo) – including the "g:"!! – but not from google.
Also, in the Falkon settings I see that spell checking won't work, it says that there are no languages installed in either /usr/bin/qtwebengine_dictionaries or /usr/share/qt5/qtwebengine_dictionaries. My system doesn't have either path. I do have hunspell installed, and aspell-foo and myspell-foo, so the dictionary files are on the system.
I found this: https://archlinux.org/todo/packaging-qtwebengine-dictionaries/ According to it, qwebengine_convert_dict foo.dic foo.bdic could do such a convertion, but I also couldn't find this on my system.
Falkon is nice, but very different to Konqueror...
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Sun Jul 25, 2021 11:53 am Post subject: |
|
|
I converted all installed dictionaries like this:
| Code: | | mkdir -p /usr/share/qt5/qtwebengine_dictionaries ; cd /usr/share/myspell ; for f in *.dic ; do /usr/lib64/qt5/bin/qwebengine_convert_dict "./$f" "/usr/share/qt5/qtwebengine_dictionaries/${f%.dic}.bdic" ; done |
Spell check works now in Falkon, but still not in Konqueror...
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
pietinger
Moderator
Joined: 17 Oct 2006
Posts: 4130
Location: Bavaria
|
| Posted: Sun Jul 25, 2021 4:44 pm Post subject: Re: Konqueror issues |
|
|
| Atha wrote: | | The defaults are e.g. "d" for duckduckgo and "g" for google, but entering "g:string" searches for "g:string" from the default search engine (duckduckgo) – including the "g:"!! – but not from google. |
I dont know how to use this in falkon. I do googling (and all which isnt important) with konqueror ... deleting all the cookies and stuff at the end of the day ... 
| Atha wrote: | | Falkon is nice, but very different to Konqueror... |
Yes ... but I think it is more stable AND have less problems with some "special" websites (like chess24.com ...  ) |
|
| Back to top |
|
|
pietinger
Moderator
Joined: 17 Oct 2006
Posts: 4130
Location: Bavaria
|
| Posted: Sun Jul 25, 2021 4:46 pm Post subject: |
|
|
| Atha wrote: | I converted all installed dictionaries like this:
| Code: | | mkdir -p /usr/share/qt5/qtwebengine_dictionaries ; cd /usr/share/myspell ; for f in *.dic ; do /usr/lib64/qt5/bin/qwebengine_convert_dict "./$f" "/usr/share/qt5/qtwebengine_dictionaries/${f%.dic}.bdic" ; done |
|
Thanks a lot !
Many greetings,
Peter |
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Mon Jul 26, 2021 12:03 pm Post subject: |
|
|
So, after > 6 hours [edit: likely > 8 or 10 hours] of having Konqueror running and the Heise Newsticker page open, I can see a QtWebEngine process that is using up 6 GB (and still rising), between 30 and 40 % of CPU (which the fans clearly indicate), while the page is doing nothing, and when I go to the tab, I cannot scroll up or down or click anything. I now just closed the tab, I am writing this posting while still in the same Konqueror session (I didn't close Konqueror). It must be some content on www.heise.de/newsticker that is triggering a memory leak?!?
I would be grateful if someone could confirm this.
So please reproduce:
1. Start Konqueror.
2. Open https://www.heise.de/newsticker in one tab. I had Wikipedia open in another, but this may not be relevant.
3. Leave your system running until you see a QtWebEngine process eating your memory (and a little bit of CPU).
Thanks.
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
pietinger
Moderator
Joined: 17 Oct 2006
Posts: 4130
Location: Bavaria
|
| Posted: Mon Jul 26, 2021 12:49 pm Post subject: |
|
|
| Atha wrote: | | So please reproduce: |
I will try it ... but ... I am using a proxy (privoxy), so maybe it doesnt work at my side.
Second: In konqueror you have three buttons at the top: "reload", "stop" and "home". When I browse to "www.heise.de" I see the stop-button in RED, meaning there is something going on. Usually I stop such websites immediately. For testing I dont do it now (and watching system monitor from kde is running (as always)). |
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Mon Jul 26, 2021 1:45 pm Post subject: |
|
|
| pietinger wrote: | | In konqueror you have three buttons at the top: "reload", "stop" and "home". When I browse to "www.heise.de" I see the stop-button in RED, meaning there is something going on. |
Yes, I have this sometimes too. When I browse to "heise.de/newsticker" now (specifically, not only "heise.de"), the red button turns gray, indication that it has finished loading.
And thanks for trying to reproduce it. Danke.
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
ulenrich
Veteran
Joined: 10 Oct 2010
Posts: 1480
|
| Posted: Mon Jul 26, 2021 2:26 pm Post subject: |
|
|
I consider the qtwebengine a dirtbag. I monitor maximal disk usage while compiling:
| Code: | 3812532 kb dev-qt/qtwebengine
567308 kb dev-qt/qtwebkit
929308 kb net-libs/webkit-gtk
|
Isn't there anywhere an extension for firefox that could provide to you what you miss from Konqueror? |
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Mon Jul 26, 2021 3:00 pm Post subject: |
|
|
| ulenrich wrote: | | Isn't there anywhere an extension for firefox that could provide to you what you miss from Konqueror? |
I do use Firefox too. What I miss most is the Web Shortcuts and the tight KDE integration. Konqueror uses a classic GUI window, menu on top and all. Firefox is more modern, which I don't really need.
I do miss the various extensions/addons for Firefox in Konqueror though...
In addition to this I like diversity and variety. I like to challenge websites to also work with Konqueror – if they don't, I just don't use them. It's more of a statement really.
I would have to export all my bookmarks and import them in Firefox, and find an extension that provides Web Shortcuts, then I guess it doesn't really make a difference anymore... Even though it won't be the same.
If it were still available, I would prefer a simpler rendering engine, something like KHMTL. But this, along with Webkit (qtwebkit), has been removed a couple of years ago. Only qtwebengine remained...
BTW, Chromium compiles for two days or more on this old notebook, firefox and qtwebengine only one night. So I prefer the later two... But, my guess is that Chromium (including its rendering engine Blink) will also take up a lot of diskspace when compiling.
Additionally, Konqueror should be kept for the reason of being the native KDE browser. It's just that it should be finally fixed. But who would do it, if everyone is recommending Firefox or other browsers? I know that it would require a lot of work: the mentioned issues and maybe enhancements, such as support for Mozilla compatible webextensions, would be great!
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
pietinger
Moderator
Joined: 17 Oct 2006
Posts: 4130
Location: Bavaria
|
| Posted: Mon Jul 26, 2021 4:18 pm Post subject: |
|
|
| Atha wrote: | | And thanks for trying to reproduce it. Danke. |
Sorry, after three hours nothing happened. Maybe you are interested what privoxy did:
| Code: | 2021-07-26 18:15:10.124 7f2d6135f640 Request: www.heise.de:443/
2021-07-26 18:15:10.328 7f2d60b2c640 Request: script.ioam.de:443/
2021-07-26 18:15:10.328 7f2d60b2c640 Crunch: Blocked: script.ioam.de:443
2021-07-26 18:15:10.340 7f2d60b2c640 Request: securepubads.g.doubleclick.net:443/
2021-07-26 18:15:10.340 7f2d60b2c640 Crunch: Blocked: securepubads.g.doubleclick.net:443
2021-07-26 18:15:10.342 7f2d60b2c640 Request: yxsu5ufd2m.kameleoon.eu:443/
2021-07-26 18:15:10.342 7f2d5bfff640 Request: cmp.heise.de:443/
2021-07-26 18:15:10.343 7f2d5b7fe640 Request: hl.upscore.com:443/
2021-07-26 18:15:11.428 7f2d5affd640 Request: 1.f.ix.de:443/
2021-07-26 18:15:11.430 7f2d5a7fc640 Request: heise.cloudimg.io:443/
2021-07-26 18:15:12.737 7f2d59ffb640 Request: eu-tlp03.kameleoon.eu:443/
2021-07-26 18:15:12.796 7f2d597fa640 Request: eu-tlp04.kameleoon.eu:443/
2021-07-26 18:15:12.910 7f2d58ff9640 Request: cmp.heise.de:443/
2021-07-26 18:15:12.912 7f2d37fff640 Request: rtc.dymatrix.cloud:443/
2021-07-26 18:15:12.913 7f2d377fe640 Request: responder.wt.heise.de:443/
2021-07-26 18:15:13.283 7f2d36ffd640 Request: am.heise.de:443/
2021-07-26 18:15:13.291 7f2d367fc640 Request: cdn.thenewsbox.net:443/
2021-07-26 18:15:13.342 7f2d35ffb640 Request: eu-tlp01.kameleoon.eu:443/
2021-07-26 18:15:13.343 7f2d357fa640 Request: eu-tlp01.kameleoon.eu:443/
2021-07-26 18:15:13.343 7f2d34ff9640 Request: eu-tlp01.kameleoon.eu:443/
2021-07-26 18:15:13.344 7f2d17fff640 Request: eu-tlp01.kameleoon.eu:443/
2021-07-26 18:15:13.344 7f2d177fe640 Request: eu-tlp01.kameleoon.eu:443/
2021-07-26 18:15:13.439 7f2d16ffd640 Request: cdnapisec.kaltura.com:443/
2021-07-26 18:15:13.580 7f2d167fc640 Request: cdn.mateti.net:443/
2021-07-26 18:15:13.716 7f2d15ffb640 Request: content.upscore.com:443/
2021-07-26 18:15:13.718 7f2d157fa640 Request: files.upscore.com:443/
2021-07-26 18:15:14.038 7f2d14ff9640 Request: rpe.dymatrix.cloud:443/
2021-07-26 18:15:14.039 7f2cf7fff640 Request: prophet.heise.de:443/
2021-07-26 18:15:14.089 7f2cf77fe640 Request: api-eu.cleverpush.com:443/
2021-07-26 18:15:14.192 7f2cf6ffd640 Request: r.mateti.net:443/
2021-07-26 18:15:14.203 7f2cf67fc640 Request: r.mateti.net:443/
2021-07-26 18:15:14.287 7f2cf5ffb640 Request: r.mateti.net:443/
2021-07-26 18:15:14.288 7f2cf57fa640 Request: r.mateti.net:443/
2021-07-26 18:15:14.464 7f2cf4ff9640 Request: 688012155290337.mateti.net:443/
2021-07-26 18:15:14.554 7f2cd7fff640 Request: hit-pool.upscore.com:443/
2021-07-26 18:15:14.560 7f2cd77fe640 Request: heise.cleverpush.com:443/
2021-07-26 18:15:24.549 7f2d17fff640 Request: positions.upscore.com:443/ |
|
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Mon Jul 26, 2021 6:04 pm Post subject: |
|
|
Thanks for trying. I think you'd have to wait longer...
I'll be busy the next days anyhow, so... I'll have to look into it later. In the meantime I'd be grateful if – anyone – could give it a try also, and try > 8 hrs. 12 hrs maybe, or even 24 hrs. Thanks.
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
Fitzcarraldo
Advocate
Joined: 30 Aug 2008
Posts: 2034
Location: United Kingdom
|
| Posted: Sun Aug 01, 2021 9:35 am Post subject: |
|
|
| Atha wrote: | | Additionally, Konqueror should be kept for the reason of being the native KDE browser. |
Isn't Falkon now the 'native' KDE browser?
_________________
Clevo W230SS: amd64, VIDEO_CARDS="intel modesetting nvidia".
Compal NBLB2: ~amd64, xf86-video-ati. Dual boot Win 7 Pro 64-bit.
OpenRC udev elogind & KDE on both.
Fitzcarraldo's blog |
|
| Back to top |
|
|
Atha
Apprentice
Joined: 22 Sep 2004
Posts: 229
|
| Posted: Sun Aug 01, 2021 1:27 pm Post subject: |
|
|
| Fitzcarraldo wrote: | | Isn't Falkon now the 'native' KDE browser? |
I cannot find how Falkon is KDE native in any way, it is a Qt Browser. Since KDE is Qt based, there is a connection, but not full integration. Maybe it's planned, or even started, but Konqueror is defenitely more KDE native than Falkon.
_________________
Think for yourself and let others enjoy the privilege of doing so too. – Voltaire |
|
| Back to top |
|
|
|
Desktop Environments
