Win13 - Emergency Migration/Recovery - completed

Stephen

Stephen

US Operations
Staff member
Win13 is in a virtually unusable state now, it will not work fast enough with network access to do anything at all, even without network it was hitting slowness at times, with no IO activity or applications running.

RAID shows optimal in all places, and there are no alerts or temperature warnings, the case is quite mysterious, but the fact remains it is not fast enough to be useful at this time.

We are working now to move backups to the new datacenter and proceed with this as an emergency restore and migration.

I am going to be honest and upfront here, it is going to take a while, as the backups are large and we already have them transferring, but it is going to take some time to restore. The restores will be to 2 days ago, as the last two nights have been problems when stats start to run. We will overnight the hard drives from Miami to the new Texas datacenter, and work on rectifying any file differences from the native hard drives.

We were planning to start sync on this server this evening, even before any problems happened for a weekend migration, but those plans have been shot for this matter, and we are proceeding with it on an urgent basis.
 
Re: Win13 - Emergency Migration/Recovery

We are not giving up to attempt getting current win13 up at the same time, that would be the most desirable situation, but right now backups are moving across.
 
Re: Win13 - Emergency Migration/Recovery

We have rebooted the current node a couple times, it sometimes is a little usable for 3-8 min, then bad, and sometimes not usable at all, we are really now to a point of wasting time, and also putting HD at risk for continued reboots, which we don't want to have an issue there right now.
 
Re: Win13 - Emergency Migration/Recovery

Mostly a bump here, we are working on the new hardware/software setup here in the new datacenter for this server.
 
Re: Win13 - Emergency Migration/Recovery

I hit some frustration in getting things setup, but we are making progress on the software side now after changing CD-ROMs, one was bad and copying invalid data.
 
Re: Win13 - Emergency Migration/Recovery

We are working fully now on software configuration in prep for data restore
 
Re: Win13 - Emergency Migration/Recovery

We are still looking at 6-8 hours here, sadly.

We have the files transferred for a bit, but working now to restore them, and have a working server. Being that we moved across to new datacenter here, it took a bit longer, but had little choice in the end but to do this.
 
Re: Win13 - Emergency Migration/Recovery

The fastest and cleanest way of restore using the automated program, just failed.

We have ways to do this, but working on it now to do so. It didn't like the change in the amount of sectors on the new hardware.
 
Re: Win13 - Emergency Migration/Recovery

We are recreating users/iis domains and settings now.
 
Re: Win13 - Emergency Migration/Recovery

The creation process is nearing an end, the recovery process still has a bit to go about 20GB more data to be restored, since the automated and faster process failed we are having to do a file by file level copy (in bulk)

I hope to start processing the ip migration portion in the coming 1.5-2 hours and sites will start to come online at that time.

The win13 original drives are already shipped out via overnight service and will have hands on in the morning.
 
Re: Win13 - Emergency Migration/Recovery

Sites are coming live, if you aren't seeing all your content via FTP etc, do not yet upload new, we are still in process of restoring content and permissions, some may be there but not visible due to permissions, which are being set now. NOT ALL content is yet restored, but over 80% of it is done now.
 
Re: Win13 - Emergency Migration/Recovery

All content is restored now except SSL certificates.

We are working to get the SSL certificates off the old server hard drives now.
 
You must log in or register to reply here.
Back
Top