Slow searches after migration (unanswered, user posts, etc.)

Message

poly_poly-man · Post by **poly_poly-man** » Tue Aug 04, 2009 3:14 am

two links I pulled off of here:
http://forums.gentoo.org/search.php?sea ... =desultory : works with a count of 4049 (less than his real post count, interestingly enough - deleted posts? nvm that tho)

http://forums.gentoo.org/search.php?sea ... hor=bunder : for examply. Neddy, me, others are all like this. I suspect it has to do with the over-6666-ness of the real posts (including otw)...

please fix?

Mod edit: Changed topic title to indicate that several kinds of searches are affected.
--timeBandit

yabbadabbadont · Post by **yabbadabbadont** » Tue Aug 04, 2009 3:29 am

After I saw this, I ran the query for all posts for my user and got the '6666' results (fine, what I expected) and 257 pages of results. When I tried to jump to page 257 to see the oldest results, I got the following error message:

http://omploader.org/vMjNjMg

I used a screenshot so that you could see the URL as well as the message and where it was displayed.

poly_poly-man · Post by **poly_poly-man** » Tue Aug 04, 2009 3:38 am

yabbadabbadont wrote:After I saw this, I ran the query for all posts for my user and got the '6666' results (fine, what I expected) and 257 pages of results. When I tried to jump to page 257 to see the oldest results, I got the following error message:

http://omploader.org/vMjNjMg

I used a screenshot so that you could see the URL as well as the message and where it was displayed.

can you see bunder's?

yabbadabbadont · Post by **yabbadabbadont** » Tue Aug 04, 2009 3:39 am

poly_poly-man wrote:can you see bunder's?

I'm letting it run now. Mine took a few minutes to return...

Edit: I mean I got up and refilled my beverage, nuked a couple of frozen burritos, and made a pitstop in the restroom before the query completed...

Edit2: It just returned fine. Took it a little over two minutes to finish.

poly_poly-man · Post by **poly_poly-man** » Tue Aug 04, 2009 3:44 am

yabbadabbadont wrote:
poly_poly-man wrote:can you see bunder's?
I'm letting it run now. Mine took a few minutes to return...

Edit: I mean I got up and refilled my beverage, nuked a couple of frozen burritos, and made a pitstop in the restroom before the query completed...

Edit2: It just returned fine. Took it a little over two minutes to finish.

more patience than I have... wonder why it's limited to certain users. Fixing title.

poly_poly-man · Post by **poly_poly-man** » Tue Aug 04, 2009 3:46 am

nope.. you were just searching differently than I was... http://forums.gentoo.org/search.php?sea ... adabbadont

I go to your profile then click search posts by.

yabbadabbadont · Post by **yabbadabbadont** » Tue Aug 04, 2009 3:48 am

I clicked the link you provided in your first post for bunder....

poly_poly-man · Post by **poly_poly-man** » Tue Aug 04, 2009 3:50 am

yabbadabbadont wrote:I clicked the link you provided in your first post for bunder....

and that took a few minutes.

EDIT: I get it... it turns into a search id when you go to a page.. nvm...

btw, desultory's last page is "no posts match"... EDIT... or was the first time..

what did you guys do to searching? I didn't know it was possible for it to get *worse*

yabbadabbadont · Post by **yabbadabbadont** » Tue Aug 04, 2009 3:51 am

poly_poly-man wrote:
yabbadabbadont wrote:I clicked the link you provided in your first post for bunder....
and that took a few minutes.

EDIT: I get it... it turns into a search id when you go to a page.. nvm...

btw, desultory's last page is "no posts match"...

A little over two, yes.

Post by **bunder** » Tue Aug 04, 2009 3:42 pm

this also affects "view unanswered posts", it has something to do with the hardware upgrade, but from what i understand they're looking into it.

poly_poly-man · Post by **poly_poly-man** » Tue Aug 04, 2009 3:59 pm

bunder wrote:this also affects "view unanswered posts", it has something to do with the hardware upgrade, but from what i understand they're looking into it.

unanswered has only ever hung for a small number of seconds for me...

yabbadabbadont · Post by **yabbadabbadont** » Tue Aug 04, 2009 7:40 pm

poly_poly-man wrote:
bunder wrote:this also affects "view unanswered posts", it has something to do with the hardware upgrade, but from what i understand they're looking into it.
unanswered has only ever hung for a small number of seconds for me...

It just took 166 seconds for me...

Post by **think4urs11** » Tue Aug 04, 2009 8:27 pm

poly_poly-man wrote:two links I pulled off of here:
http://forums.gentoo.org/search.php?sea ... =desultory : works with a count of 4049 (less than his real post count, interestingly enough - deleted posts? nvm that tho)

http://forums.gentoo.org/search.php?sea ... hor=bunder : for examply. Neddy, me, others are all like this. I suspect it has to do with the over-6666-ness of the real posts (including otw)...

please fix?

The first one should be ok, as long as you don't find an account where viewprofile>search_author # of posts.
The second one sees strange; contrary to the old setup i see now (but only for my own account) a search_author value of >6666, for e.g. Neddy though it shows 6666...
unanswered-search is known to be slow in the new setup, see viewtopic-t-785980.html

Post by **timeBandit** » Tue Aug 04, 2009 10:04 pm

bunder wrote:... from what i understand they're looking into it.

Correct, if by "looking into it" you mean "someone ensured infra and desultory are aware of the problem and this thread" and if "someone" is me.

VinzC · Post by **VinzC** » Wed Aug 05, 2009 10:55 am

Hi admins.

For two days I've been trying to get the list of unanswered posts and it takes a very, very long time -- too long to me and I'd rather stop the request instead. So the list of unanswered posts doesn't appear and it's been more or less two days it is so. Has anybody reported a problem around that?

Thanks.

simon_irl · Post by **simon_irl** » Wed Aug 05, 2009 11:24 am

i'm having this problem too: i logged in to look through the unanswered questions, but gave up waiting for the screen to load.

Post by **bunder** » Wed Aug 05, 2009 12:04 pm

viewtopic-t-785980.html

VinzC · Post by **VinzC** » Wed Aug 05, 2009 12:24 pm

Okay, thanks... Sorry I didn't [bother] see the announcement

...

Take it as a suggestion: in some forum software is a place to provide a note or link on top of each browsed page. That note/link appears until it's acknowledged by the [subscribed] visitor. That's how I knew TombRaider forums there was a soundtrack community pack, IIRC.

Post by **timeBandit** » Wed Aug 05, 2009 3:08 pm

VinzC wrote:Okay, thanks... Sorry I didn't [bother] see the announcement ...

Thank you for at least being honest.

Take it as a suggestion: in some forum software is a place to provide a note or link on top of each browsed page. That note/link appears until it's acknowledged by the [subscribed] visitor. That's how I knew TombRaider forums there was a soundtrack community pack, IIRC.

If it's provided by phpBB v3, it might appear here after the upgrade (officially, Real Soon Now, edging closer by the day). Sounds more annoying than useful though.

The Latest Site News section at the top of the forums main index serves the purpose nicely. Items are marked new until you read them. As of this writing all three announcements pertain to the migration. Honestly, there's only so much we can do short of reaching through the monitor, knocking you gently on the head, saying "Hey! Read this!" and pointing to the news item.

Post by **timeBandit** » Wed Aug 05, 2009 3:22 pm

Merged above five posts here and changed the original topic title to reflect the more general nature of the problem.

VinzC · Post by **VinzC** » Wed Aug 05, 2009 3:45 pm

Take it as a suggestion: in some forum software is a place to provide a note or link on top of each browsed page. That note/link appears until it's acknowledged by the [subscribed] visitor. That's how I knew TombRaider forums there was a soundtrack community pack, IIRC.

timeBandit wrote:If it's provided by phpBB v3, it might appear here after the upgrade (officially, Real Soon Now, edging closer by the day). Sounds more annoying than useful though.

The Latest Site News section at the top of the forums main index serves the purpose nicely. Items are marked new until you read them. As of this writing all three announcements pertain to the migration. Honestly, there's only so much we can do short of reaching through the monitor, knocking you gently on the head, saying "Hey! Read this!" and pointing to the news item.

I'm not sure I understood but the trick is to gently avoid to have to read forum announcements everyday, knowing such a thing [as this one move] happens very, very, very rarely -- in the spirit «notifications are better than polling».

poly_poly-man · Post by **poly_poly-man** » Wed Aug 05, 2009 4:03 pm

VinzC wrote:
Take it as a suggestion: in some forum software is a place to provide a note or link on top of each browsed page. That note/link appears until it's acknowledged by the [subscribed] visitor. That's how I knew TombRaider forums there was a soundtrack community pack, IIRC.

timeBandit wrote:If it's provided by phpBB v3, it might appear here after the upgrade (officially, Real Soon Now, edging closer by the day). Sounds more annoying than useful though.

The Latest Site News section at the top of the forums main index serves the purpose nicely. Items are marked new until you read them. As of this writing all three announcements pertain to the migration. Honestly, there's only so much we can do short of reaching through the monitor, knocking you gently on the head, saying "Hey! Read this!" and pointing to the news item.
I'm not sure I understood but the trick is to gently avoid to have to read forum announcements everyday, knowing such a thing [as this one move] happens very, very, very rarely -- in the spirit «notifications are better than polling».

++ - most of us do not actually hit forums.gentoo.org/ on any more than about a monthly basis...and even then it's not to look at that, it's to quick hit egosearch or another forum (like goaa, which hardly ever shows up in 24 hours)

Post by **desultory** » Tue Aug 18, 2009 5:46 am

poly_poly-man wrote:http://forums.gentoo.org/search.php?sea ... =desultory : works with a count of 4049 (less than his real post count, interestingly enough - deleted posts? nvm that tho)

Those posts exist, they just happen to be hidden.

poly_poly-man wrote:http://forums.gentoo.org/search.php?sea ... hor=bunder : for examply. Neddy, me, others are all like this. I suspect it has to do with the over-6666-ness of the real posts (including otw)...

please fix?

Done, robbat2 managed to generally locate, and correct, some interesting behavior on the part of the intermediate database interface which manifested under exactly the conditions you described. It should work in a more timely manner now.

poly_poly-man · Post by **poly_poly-man** » Tue Aug 18, 2009 5:56 am

desultory wrote:
poly_poly-man wrote:http://forums.gentoo.org/search.php?sea ... =desultory : works with a count of 4049 (less than his real post count, interestingly enough - deleted posts? nvm that tho)
Those posts exist, they just happen to be hidden.
poly_poly-man wrote:http://forums.gentoo.org/search.php?sea ... hor=bunder : for examply. Neddy, me, others are all like this. I suspect it has to do with the over-6666-ness of the real posts (including otw)...

please fix?
Done, robbat2 managed to generally locate, and correct, some interesting behavior on the part of the intermediate database interface which manifested under exactly the conditions you described. It should work in a more timely manner now.

that explains the short database outage as well? cool, thanks.

Post by **desultory** » Tue Aug 18, 2009 6:18 am

That it does, there was a glitch in switching over which got fixed by the next automated pass.

Slow searches after migration (unanswered, user posts, etc.)

Slow searches after migration (unanswered, user posts, etc.)

Re: >6666 realpost count users - search takes 2+min

Is there a problem with unanswered posts?