Cl2-CP stopped responding

abhishek · February 23, 2016, 1:32am

We are checking it and will post an update soon.

Stephen · February 23, 2016, 1:40am

We are rebooting this node, which will impact the CL1-CP as well.

Stephen · February 23, 2016, 1:44am

The servers are down now, and there will almost certainly be a file check as it has been a while since the last one. (over a year)

Stephen · February 23, 2016, 2:25am

Both CPs currently down, I am here on site and we are having to do some fsck (linux file checks) from the console level offline.

Stephen · February 23, 2016, 2:33am

CL1CP is live, still working on the CL2 CP now.

Stephen · February 23, 2016, 3:38am

We are going to take the entire node down again, and swap out an entire array of storage, then bring it back up. The CL1CP will be down for about 20 minutes in this process, the CL2CP will remain down after that as we work to bring it back up.

Stephen · February 23, 2016, 4:08am

Well that did not go well, there seems to be more at play here, and I am going to make a new topic as both control panels are down.

abhishek · February 23, 2016, 6:07pm

Both Control panels are up now.