Kudos to Jodohost for supreme efforts dealing with the situation today. Sometimes shit happens… and sometimes you have to depend on other people to do their job right. Thankfully we do not have many grave situations like this but it’s obvious that the staff there are willing to work around the clock to solve them when they do happen. Most of all, I’m thankful we were kept up to date with progress and JH was open about the situation, and that makes things easier to deal with when my clients were calling me up to ask what the f*** was going on (like I could do something about it, but at least I could tell them exactly what was happening and wasn’t completely in the dark.)
Hope you get good sleep tonight.
Not sleeping yet, tied up a few loose ends and looks like I may be able to now.
Things happen sometimes we don’t understand.
I planned to be out of town this weekend, but stupid major road construction here ruined my car alignment, and my tires were being eaten to shreds. (see my rant in chat).
This made me need to schedule appointment to have repaired, I was planning to be gone already. And had it happened only 10 min later, my car would have been on a lift being checked and I’d have been unable to come here for an extended time.
I was driving into shop as Ved called me said network issue, DOS or something a lot is down.
NEVER did I expect what happened/had happened.
If my car had not broken, I’d have been over 2.5 hours away at least, and left to my other staff that being I’d never experienced this once before to have happen in some manner TWICE in one day, just astounding. It all makes sense now why the 2nd time happened (more details in one place will be posted later today)
I really don’t know what we’d have done to have had this with me so far away, and the stability and calmness I provided, even though I didn’t feel it always internally and the 20 min waiting for electrician to get here was like walking through fire.
I’ve been here going on 10 years now(9 completed years as Dec 2012), and I’ve moved servers a couple times, I’ve worked in a lot of facilities and never had this happen to us directly, but have seen similar cases. I just never expected such to happen to us as we use all metered power equipment so we never make accidental over amp etc
This week had already been tough in ways not seen to the client, we’ve got a load of new nodes coming in/on line for new things happening, but they haven’t gone that well to get ready. Then all this on top of it!
I am thankful for twitter even though i cannot update it as much as I’d like when in an issue such as this. Once we had servers coming up to learn it was about to happen again and we had to rush take some servers down, was a bit sickening, but I encouraged the elecrician to please let me shut down right if possible, as we’d already had two times on this one circuit with hard shutdowns in 12 hours.
My staff here really came together and worked well, they don’t even see, read or post here right now to read this, but I will print this up for them to read.
Surg and Ricky helped me a lot here to bring this back up, Mike from the electric company also really stepped up and ensured he didn’t just bring us up, but found the core issue at the root of the problem, which is what I’d wanted from the prior guy earlier in the day.
My thanks to you Stephen and all the rest of the staff that worked so hard at fixing the problems yesterday. I’m sure it was a situation that if it occurred somewhere else that the outage would have been for much longer..your expertise and hard work made a very scary situation be resolved in a relatively short period of time.
Toasting you and the staff with a cyber beer!
did not get the write up done yesterday, working on it today.
finally got a moment to breathe after numerous issues, and got it done!
Laugh at my drawings here 
I only got good comments about my little drawing saying it helped understand the issue, thanks guy for not making fun!