Saturday, June 04
I Hate Electricity
Power failure in Seattle's SoftLayer datacenter. I mean, SoftLayer's Seattle datacenter. I think. About 20 out of 30 servers at my day job fell over. Yes, they have redundant power supplies and are in theory connected to two UPSes each. Anyway....
By some stroke of good luck, all four key servers in our data path stayed up the entire time.
Everything else rebooted. Eventually. Except for our cloud components, which are dead as a doornail.
Comments are disabled.
Post is locked.
Power failure in Seattle's SoftLayer datacenter. I mean, SoftLayer's Seattle datacenter. I think. About 20 out of 30 servers at my day job fell over. Yes, they have redundant power supplies and are in theory connected to two UPSes each. Anyway....
By some stroke of good luck, all four key servers in our data path stayed up the entire time.
Everything else rebooted. Eventually. Except for our cloud components, which are dead as a doornail.
Posted by: Pixy Misa at
09:18 PM
| Comments (3)
| Add Comment
| Trackbacks (Suck)
Post contains 78 words, total size 1 kb.
1
Strange that should happen even though they are on UPSs.
Posted by: Steven Den Beste at Sunday, June 05 2011 06:24 AM (+rSRq)
2
I don't have all the details, but what happens all too often in big datacenters is that when the power goes off, either a UPS or power distribution circuit fails. Better than what happened a couple of years ago at The Planet - one of their UPSes exploded, and took out an entire wall.
When I was in the telco game, we had redundant power supplies and independent paths to everything - and a DR site on hot standby - but of course, that cost an absolute fortune.
When I was in the telco game, we had redundant power supplies and independent paths to everything - and a DR site on hot standby - but of course, that cost an absolute fortune.
Posted by: Pixy Misa at Sunday, June 05 2011 06:20 PM (PiXy!)
3
And the UPS is only effective if everything is plugged into it. Oh and its tested! And how often do you think they get the chance to do that lol. The classic one I say was that everything was working fine, until someone realised that the backup generator had no fuel in it! poof. Lights out.
Posted by: Tod at Friday, August 31 2012 10:14 PM (l96u5)
46kb generated in CPU 0.0179, elapsed 0.1074 seconds.
56 queries taking 0.0999 seconds, 340 records returned.
Powered by Minx 1.1.6c-pink.
56 queries taking 0.0999 seconds, 340 records returned.
Powered by Minx 1.1.6c-pink.
