Forum outage 8/12/17

Forum News, Announcements and any issues you're having with the forum
User avatar
xantia_v6
Forum Admin Team
Posts: 9520
Joined: 09 Nov 2005, 22:03
x 926

Forum outage 8/12/17

Unread post by xantia_v6 »

We apologise for the unscheduled downtime.

The issue was (from our perspective) caused by a lock-up in the hypervisor system which manages this server. This piece of software is run by the hosting company and is outside of our control.

Unfortunately the lock-up occurred while a database write operation was being processed on our server and after the system was rebooted by the hosting company our site did not start because it detected a database corruption. I have now manually restarted our database, and it appears to be working correctly.

If you notice any odd behaviour on the site, or anything that looks like data corruption, please report it.

Note that this hypervisor has been causing us intermittent speed problems for a few weeks now, and we were already planning to migrate to a different type of server node before the end of the year.
Hell Razor5543
Donor 2023
Posts: 13889
Joined: 01 Apr 2012, 09:47
x 3076

Re: Forum outage 8/12/17

Unread post by Hell Razor5543 »

Yay! I was suffering from withdrawal symptoms. Now I feel better.
James
ex BX 1.9
ex Xantia 2.0HDi SX
ex Xantia 2.0HDi LX
ex C5 2.0HDi VTR
ex C5 2.0HDi VTR
ex C5 2.2HDi VTX+

Yes, I am paranoid, but am I paranoid ENOUGH?
Out amongst the stars, looking for a world of my own!
User avatar
Paul-R
Donor 2023
Posts: 7259
Joined: 07 May 2009, 16:24
x 1439

Re: Forum outage 8/12/17

Unread post by Paul-R »

Welcome back. A page starting

General Error
SQL ERROR [ mysqli ]
Connection refused [2002]
BACKTRACE

was not a suitable substitute!
As I get older I think a lot about the hereafter - I go into a room and then wonder what I'm here after.

Inside every old person is a young person wondering what the hell happened.

"Trying is the first step towards failure" ~ Homer J Simpson​
User avatar
white exec
Posts: 7445
Joined: 21 Dec 2015, 12:46
x 1754

Re: Forum outage 8/12/17

Unread post by white exec »

Thanks, Mike, for keeping on top of this. That was quite some outage.
Chris
User avatar
xantia_v6
Forum Admin Team
Posts: 9520
Joined: 09 Nov 2005, 22:03
x 926

Re: Forum outage 8/12/17

Unread post by xantia_v6 »

The timing was unfortunate, as it coincided with my bed-time.

In this case it would probably not have helped to have someone else with server access, as the procedure for correcting a corrupt database journal is a bit technical, and I only knew how to do it because the same thing happened earlier in the year.

LS say that the new KVM hardware should be tested and ready at the beginning of 2018.