ALL SERVERS Maintenance Window until Jan 21st, potential reboots and downtime

Stephen

US Operations
Staff member
Maintenance Windows Time: Now until the end of Jan 21st (and may be extended if needed)
Target time of Reboots maintenance: All day on Weekends or 9pm Central-5am Central (UTC-5) on weekdays
Potential impact: Normal to extended reboot, 5-45 minutes each reboot and 2-4 reboots required.

As you may be aware from the news, there are a number of recently discovered bugs virtually every CPU sold in the last 20 years.
We are rebooting all servers to perform emergency software mitigation of these matters, and since the situation is fluid and still developing with some patches still flowing down from multiple channels, will require multiple reboots and updates to patch. Some updates have resulted in slowdowns of processing of PHP pages(on Windows servers specifically) in our experience, and we will strive to make this as low impact as possible but do want to acknowledge that it could hit some areas more than others. Safety is of the highest importance here.

The currently available patches have been tested outside our production systems and we know to take up to 45 minutes to complete processing when done on a host node level for the cloud servers. Some patches will be much faster done with a simple reboot, and others will need the extended time as the patches configure and update taking a more extended time.

Thank you for your patience and understanding as we address this unprecedented matter and have a large window posted to be sure we get all patches completed as quickly as possible when released.
 
Not all work was completed in the timeframe because of some adverse side effects of some patching(random reboots, very extreme cpu usage, and some cases apps just closing out and crashing). We don't have a timeframe for the next window yet but will update when further major reboot times are required.
 
Back
Top