Thursday, September 28


Well, That Was Fun

Had a little excitement at work today. Apparently several blocks of Sydney's CBD went dark, including, of course, our office. Our elderly UPS valiantly struggled along for nearly a minute before expiring; the blackout itself lasted about an hour and a half.

Then I had to fix pretty much everything. Crashed databases, lost routing tables, failed NFS mounts (the systems didn't neatly reboot in the required order), unending fscks (This volume has not been checked for 562 days* so I'm now going to scan every one of your seven million files and there's nothing you can do to stop me so nyah.), broken RAID sets, misconfigured network cards...


Knoppix was used. It would have been even more not fun without Knoppix.

* Actual number.

Posted by: Pixy Misa at 08:13 AM | Comments (6) | Add Comment | Trackbacks (Suck)
Post contains 133 words, total size 1 kb.

1 I take it that no one was able to log out properly during the 1 minute the servers were still up ...

And of course, every temp fix that could not withstand a reboot blew up at once.

Posted by: Kristopher at Thursday, September 28 2006 10:52 AM (O5Ju8)


Is this why your site had an odd look to it last night?  Or was that something else?

Posted by: Wonderduck at Thursday, September 28 2006 11:22 AM (6YRS5)

3 If you saw the forum-looking thing, that was a glitch in the Minx caching system.

Posted by: Pixy Misa at Thursday, September 28 2006 10:22 PM (FRalS)

4 That's what it was, yep.  "Dear Forum... I'm a student at a small midwestern college, and I never thought..."

Posted by: Wonderduck at Thursday, September 28 2006 10:30 PM (6YRS5)

5 Wonderduck, any college student who never thinks might as well just drop out.

Posted by: triticale at Friday, September 29 2006 10:44 PM (IdwjX)


Hmmm... 10 points for triticale for ultimate truthiness, minus several million for completely whiffing on the joke.

To be fair, I don't know where in the world Trit is located, so it's certainly possible that he's not familiar with Penthouse magazine...

Posted by: Wonderduck at Saturday, September 30 2006 02:37 AM (CJ5+Y)

Hide Comments | Add Comment

Comments are disabled. Post is locked.
46kb generated in CPU 0.0369, elapsed 0.1735 seconds.
56 queries taking 0.1481 seconds, 346 records returned.
Powered by Minx 1.1.6c-pink.