mail3 drive problem - restored to new sever

Lukesh

Perch
Server has lots of IMAP Connection those overloading server . We have stopped service for a while. We will keep you updated further.
 
Re: Mail3 - mail3.g********.com IMAP Service

We have started IMAP service again and monitoring server further.
 
Re: Mail3 - mail3.g********.com IMAP Service

IMAP service creating too much load on server. We have stopped it again and it might take a bit time to resolve the root cause of this.
 
Hardware maintenance at 10 PM EST.

The server has a drive failure, so the RAID is running in degraded state. We are replacing the faulty drive in server at 10 PM EST. As soon as the RAID array is in sync, IMAP service will be made available. Please note this maintenance will need a reboot.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

Maintenance will start shortly.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

Server has been shutdown for maintenance.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

This is taking longer than expected, and the bad news is that the RAID controller now shows 3 drives of 4 in this RAID 10 array as failed. We are still working on it.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

2 drive that were working this morning (of the 4 drive RAID10) now show 'drive error' on bootup, these were not even reporting any issue before.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

Despite of our best efforts, and multiple attempts to bring the server online, it just couldn't happen. We are now working on making a new server asap.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

Since the two drive were on the same mirror, this is a big issue, I have swapped out the power supply in hopes it was some freak power issue, but it did not good at all.

These two drives that failed were in nearby serial numbers, seems a batch problem possibly, but they have run well for a long while.

p0 DEVICE-ERROR u0 298.09 GB 625142448 WD-WCARW4195860
p1 OK u0 298.09 GB 625142448 WD-WCARW4198743
p2 OK u0 298.09 GB 625142448 WD-WCARW4255737
p3 OK u0 298.09 GB 625142448 WD-WCARW4255790


This was this morning, we swapped the bad drive and rebooted, and on that there were some errors, and then ports p2/p3 now show 'drive error' with no further info.

We have backups and are working to build up a new server for it as well now, to restore backups.
This is bad news, and not what we needed in the midst of the server moves that have really picked up pace and moving well now.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

As per the speed of data transfer at the moment, this process will probably take 7 hours to complete. What slows down the process is the fact that we are talking about more than 120gig of data comprising of many millions of smalls files.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

We are looking at another 5 hours from here.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

This is still not done, and the data transfer rate is not being up to the mark. We apologize for the extended downtime, and would like to assure we are trying everything to bring it back in service at the earliest possible.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

I should have mentioned before. Any email being sent to your/your client's mailbox hosted on mail3 shouldn't be lost. It will only be queued on sender mail server and retried at a later time.
 
Re: mail3 drive problem - H/w maintenance at 10PM EST

Mail3 is up now, pop-ssl and imap-ssl are not working right now.
 
Back
Top