View previous topic :: View next topic |
Author |
Message |
danomac l33t
Joined: 06 Nov 2004 Posts: 881 Location: Vancouver, BC
|
Posted: Sun Sep 30, 2012 3:12 pm Post subject: |
|
|
roravun wrote: | I am experiencing issues too.
But it is mostly unaccessible http. I can always 'ping' forums.gentoo.org, but http connections get reset/timed out. |
Yep, same here.
I tried for almost 45 minutes yesterday to post something in this thread, but had to give up. Nine times out of ten I can't connect now.
I was actually surprised the site loaded this morning. That's not a good sign when you start thinking like that. |
|
Back to top |
|
|
dE_logics Advocate
Joined: 02 Jan 2009 Posts: 2253 Location: $TERM
|
Posted: Sun Sep 30, 2012 3:43 pm Post subject: |
|
|
Yes, the forums sometimes doesn't load. _________________ My blog |
|
Back to top |
|
|
schorsch_76 Guru
Joined: 19 Jun 2012 Posts: 450
|
Posted: Sun Sep 30, 2012 3:48 pm Post subject: |
|
|
Friday and Yesterday i had massiv issues using the forums. I had luck loading the main page but nothing else could i open. Ping was ok, but http timed out.
Its really important for us as users of gentoo that this forum is reachable for us!
Today morning it did load really nice and was accessible.
Bye
schorsch |
|
Back to top |
|
|
danomac l33t
Joined: 06 Nov 2004 Posts: 881 Location: Vancouver, BC
|
Posted: Sun Sep 30, 2012 4:56 pm Post subject: |
|
|
Right after I posted the last post the forums went AWOL again. It seems to be OK now again. |
|
Back to top |
|
|
Simba7 l33t
Joined: 22 Jan 2007 Posts: 706 Location: Billings, MT, USA
|
Posted: Sun Sep 30, 2012 5:04 pm Post subject: |
|
|
wswartzendruber wrote: | Timing out or refusing connections? |
Timing out. It seems to be working alright at the moment. |
|
Back to top |
|
|
desultory Bodhisattva
Joined: 04 Nov 2005 Posts: 9410
|
Posted: Mon Oct 01, 2012 5:33 am Post subject: |
|
|
wswartzendruber wrote: | How's your cooling? | As I understand it the cooling and other general accommodations are all fairly normal datacenter fare, which should be rather more than adequate for the loads put on the servers.
wswartzendruber wrote: | Are these Intel or AMD boxes? | AMD.
wswartzendruber wrote: | What kind of EMF is in the area? Any powerful RF transmitters? | So far as I am aware there is nothing of note of either sort in close proximity to the datacenter where the servers are located.
avx wrote: | Meh, still going on. Just been down again for a few minutes.
Anything we can do to help? | Alas not, though the offer is much appreciated.
avx wrote: | Note downtimes or something like that? | One of the few benefits of this latest batch of problems was getting some of our log handling and notification tools back in order, so we can find downtime with less manual searching; though a gentle prod in #gentoo-forums or post here would not be unwelcome.
schorsch_76 wrote: | Friday and Yesterday i had massiv issues using the forums. I had luck loading the main page but nothing else could i open. Ping was ok, but http timed out. | The web services on the servers are apparently the only things affected by the problem, whatever it actually is.
schorsch_76 wrote: | Its really important for us as users of gentoo that this forum is reachable for us! | Agreed, fully. There is simply no excuse for letting software failures disrupt the site so thoroughly for so long.
schorsch_76 wrote: | Today morning it did load really nice and was accessible. | The infrastructure team tried an alternative configuration on one of the web servers, which at least so far appears to not suffer from the same problems as the prior configuration.
danomac wrote: | Right after I posted the last post the forums went AWOL again. It seems to be OK now again. | That is probably due to how things are set up at the moment, one of the front ends is deliberately left with the configuration that has been problematic lately so that we might be able to find out why it has been so problematic, so there will likely be brief periods when traffic is still directed at an effectively down server, they should not last long as the load balancer has been failing over properly lately. |
|
Back to top |
|
|
wswartzendruber Veteran
Joined: 23 Mar 2004 Posts: 1261 Location: Idaho, USA
|
Posted: Mon Oct 01, 2012 5:36 am Post subject: |
|
|
Are you guys running Hardened? There's been some funk going on with that for me. _________________ Git has obsoleted SVN.
10mm Auto has obsoleted 45 ACP. |
|
Back to top |
|
|
desultory Bodhisattva
Joined: 04 Nov 2005 Posts: 9410
|
Posted: Mon Oct 01, 2012 5:59 am Post subject: |
|
|
wswartzendruber wrote: | Are you guys running Hardened? There's been some funk going on with that for me. | Yes, though so far that does not appear to be part of the problem. |
|
Back to top |
|
|
schorsch_76 Guru
Joined: 19 Jun 2012 Posts: 450
|
Posted: Mon Oct 01, 2012 6:23 am Post subject: |
|
|
wswartzendruber wrote: | Are you guys running Hardened? There's been some funk going on with that for me. |
No, i run desktop profile. The problem did even appear on my win7 on bare metal box. |
|
Back to top |
|
|
danomac l33t
Joined: 06 Nov 2004 Posts: 881 Location: Vancouver, BC
|
Posted: Tue Oct 02, 2012 12:13 am Post subject: |
|
|
schorsch_76 wrote: | wswartzendruber wrote: | Are you guys running Hardened? There's been some funk going on with that for me. |
No, i run desktop profile. The problem did even appear on my win7 on bare metal box. |
I'm pretty sure he's talking about the web servers, not the clients. |
|
Back to top |
|
|
turtles Veteran
Joined: 31 Dec 2004 Posts: 1659
|
Posted: Tue Oct 02, 2012 4:53 am Post subject: |
|
|
Seems like it is fixed now.
Thanks guys.
Just curious what was it? _________________ Donate to Gentoo |
|
Back to top |
|
|
GFCCAE6xF Apprentice
Joined: 06 Aug 2012 Posts: 295
|
Posted: Tue Oct 02, 2012 7:27 am Post subject: |
|
|
^^ I hope!
Last night was the first evening/night where I had no trouble getting on here at all. |
|
Back to top |
|
|
schorsch_76 Guru
Joined: 19 Jun 2012 Posts: 450
|
Posted: Tue Oct 02, 2012 8:08 am Post subject: |
|
|
Since yesterday i had no issues connecting to the forums. Good work guys |
|
Back to top |
|
|
krinn Watchman
Joined: 02 May 2003 Posts: 7470
|
Posted: Tue Oct 02, 2012 10:33 am Post subject: |
|
|
Looking good for me too guys, good work |
|
Back to top |
|
|
avx Advocate
Joined: 21 Jun 2004 Posts: 2152
|
Posted: Tue Oct 02, 2012 11:29 am Post subject: |
|
|
Working here, too, so far, but it's sometimes still awfully slow(took >1min to load this reply form). _________________ ++++++++++[>+++++++>++++++++++>+++>+<<<<-]>++.>+.+++++++..+++.>++.<<+++++++++++++++.>.+++.------.--------.>+.>. |
|
Back to top |
|
|
desultory Bodhisattva
Joined: 04 Nov 2005 Posts: 9410
|
Posted: Wed Oct 03, 2012 4:13 am Post subject: |
|
|
turtles wrote: | Just curious what was it? | For some as yet undetermined reason, the server processes stopped handing off requests to the handlers, then, apparently, crashed when the queue overran. This seems especially strange to me given that none of the underlying hardware or software was indicated to have changed as this went from an occasional glitch to a serious problem on through it effectively disabling the site.
avx wrote: | Working here, too, so far, but it's sometimes still awfully slow(took >1min to load this reply form). | You might still be hitting the one configured as both had been, or the still occasionally problematic (Gentoo specific) piwik server, or something else entirely, in short I do not know why but will try to find out and, if possible, correct it. |
|
Back to top |
|
|
avx Advocate
Joined: 21 Jun 2004 Posts: 2152
|
Posted: Thu Oct 04, 2012 10:07 am Post subject: |
|
|
Boy that's annoying. While it runs pretty smoothly (again) 3/4 of the time, I seem to attract pretty bad luck whenever I'm trying to post something or even login, so I've got to make sure to c&p my reply before trying to send it.
Edit, maybe on a related note, are some mirrors having problems? Answered a few posts today already, where the mirrors don't respond/give 404:
https://forums.gentoo.org/viewtopic-t-938536-highlight-.html
https://forums.gentoo.org/viewtopic-p-7154716.html _________________ ++++++++++[>+++++++>++++++++++>+++>+<<<<-]>++.>+.+++++++..+++.>++.<<+++++++++++++++.>.+++.------.--------.>+.>. |
|
Back to top |
|
|
turtles Veteran
Joined: 31 Dec 2004 Posts: 1659
|
Posted: Thu Oct 04, 2012 6:54 pm Post subject: |
|
|
desultory wrote: | turtles wrote: | Just curious what was it? | For some as yet undetermined reason, the server processes stopped handing off requests to the handlers, then, apparently, crashed when the queue overran. This seems especially strange to me given that none of the underlying hardware or software was indicated to have changed as this went from an occasional glitch to a serious problem on through it effectively disabling the site.
|
That sounds like a nightmare to track down. Thanks for doing it. _________________ Donate to Gentoo |
|
Back to top |
|
|
avx Advocate
Joined: 21 Jun 2004 Posts: 2152
|
Posted: Mon Oct 22, 2012 10:38 pm Post subject: |
|
|
Problems again? Had 'critical db'-error and 503s for the last ~1 hour. Additionally, planet and packages are down for ages now(unreachable for at least 3 days)
Edit, got this too right now: "Could not obtain topic watch information" _________________ ++++++++++[>+++++++>++++++++++>+++>+<<<<-]>++.>+.+++++++..+++.>++.<<+++++++++++++++.>.+++.------.--------.>+.>. |
|
Back to top |
|
|
ichbinsisyphos Guru
Joined: 08 Dec 2006 Posts: 547
|
Posted: Mon Oct 22, 2012 10:45 pm Post subject: |
|
|
I think they used to have some syncing issues between different servers? An hour, or maybe half an hour, ago I got a version of this forums that was more than 12 hours old. Immediately afterwards it was totally unreachable until just now. |
|
Back to top |
|
|
avx Advocate
Joined: 21 Jun 2004 Posts: 2152
|
Posted: Tue Oct 23, 2012 4:39 pm Post subject: |
|
|
Still slow as molasses, wiki unreachable, could have at least some status info on the main page. _________________ ++++++++++[>+++++++>++++++++++>+++>+<<<<-]>++.>+.+++++++..+++.>++.<<+++++++++++++++.>.+++.------.--------.>+.>. |
|
Back to top |
|
|
Bones McCracker Veteran
Joined: 14 Mar 2006 Posts: 1611 Location: U.S.A.
|
Posted: Tue Oct 23, 2012 5:49 pm Post subject: |
|
|
My intuition says it's the database, with things backing up from there. _________________
patrix_neo wrote: | The human thought: I cannot win.
The ratbrain in me : I can only go forward and that's it. |
Last edited by Bones McCracker on Thu Oct 25, 2012 12:54 pm; edited 2 times in total |
|
Back to top |
|
|
Bones McCracker Veteran
Joined: 14 Mar 2006 Posts: 1611 Location: U.S.A.
|
Posted: Wed Oct 24, 2012 12:16 pm Post subject: |
|
|
Intermittent problems again today. _________________
patrix_neo wrote: | The human thought: I cannot win.
The ratbrain in me : I can only go forward and that's it. |
|
|
Back to top |
|
|
dasPaul Apprentice
Joined: 14 Feb 2012 Posts: 243 Location: Dresden
|
Posted: Wed Oct 24, 2012 1:14 pm Post subject: |
|
|
heavy "Unable to connect" ... |
|
Back to top |
|
|
danomac l33t
Joined: 06 Nov 2004 Posts: 881 Location: Vancouver, BC
|
Posted: Wed Oct 24, 2012 4:32 pm Post subject: |
|
|
Last night I was having issues. Seems to be OK now.
Last night I kept getting "Could not obtain topic watch information". |
|
Back to top |
|
|
|