Web14 not responding over network, we are checking the same
Re: Web14 not responding over network Web15 slow
Web15 is being slow as well, so checking both
Re: Web14 not responding over network Web15 slow
ok…it was hanging on reboot we had to reboot it now says 181 days up and must check filesystem, so that is going now.
52% done.
Re: Web14 not responding over network Web15 slow
We have them both up, but web14 is being slammed with a huge amount of requests (which is what started the matter in first place)
Re: Web14 not responding over network Web15 slow
Both servers are UP as updated already and all services are responding fine now on both of them.
However, we are closely monitoring the servers.
Re: Web14 not responding over network Web15 slow
Looks to be getting hammered again, we are checking
Re: Web14 not responding over network Web15 slow
Should be up much more quickly this time, in just a minute or two.
Re: Web14 not responding over network Web15 slow
All are up, again watching close
Re: Web14 not responding over network Web15 slow
Now the node had a kernel panic, I am suspecting something has gone wrong hardware wise. I am proceeding in that route now.
Re: Web14 not responding over network Web15 slow
Still working on this, run into some hiccups.
Re: Web14 not responding over network Web15 slow
the issue actually seems to be an electrical fault in one of the RAID cards on the storage array. We are checking now, as when that connects, it makes everything go haywire.
We have a replacement here, but it needs some firmware updates before being used.
Re: Web14 not responding over network Web15 slow
I have all hardware in cooperation now, after a flash upgrade of the motherboard now, and FSCK is going on the workbench.
Re: Web14/Web15 not responding over network - working to resolve
Servers are up , but network being configured now.
All services will up soon.
Re: Web14/Web15 not responding over network - working to resolve
New network cards being quite stubborn, Tanmaya and I in on KVM working on it now.
Re: Web14/Web15 not responding over network - working to resolve
We got all up for 7 pings, before it all went down again on new hardware.
I am trying to keep you all up to date here, as it is quite complex dealing with the hardware and the updates in a timely manner as well.
Re: Web14/Web15 not responding over network - working to resolve
We have tried all we can for now, and are having to resort to provisioning of a new node. After this, we will proceed for recovery. This will take a few hours at the least. We apologize for the continued inconvenience.
Re: Web14/Web15 not responding over network - working to resolve
Long time since updates I know, but we have very good progress, updates forthcoming.
Re: Web14/Web15 not responding over network - working to resolve
Web14 is up for the last 10 minutes or so, we are testing it out so far and working well
edit: Just as I say that, we issued a reboot on web14, but this time it was us.
Re: Web14/Web15 not responding over network - working to resolve
Web15 will be up in next 1 minute, but we will reboot it in 10-15 minutes for a quick update and then it will return.
Re: Web14/Web15 not responding over network - working to resolve
Oh how I am glad to see this:
Web15-PHP is RUNNING (Got page and content is OK)