Sunday, January 19

A Minor And Temporary Inconvenience
Well, everything went down.
Well, everything went down.
The hosting company running our front-end server (separate from the application and database) got a complaint due to someone creating a scammy blog on the software and disabled the entire front-end server.
No data lost, everything fine, except that nobody could reach any of the sites.
I immediately zapped that site and anything that looked similar, and I've created a temporary front-end server while waiting for service to be restored, and manually routed the blogs I could remember are being actively used quickly to the new server, and things are working again. (I could route everything to the temporary server, but I'd rather not, for... Reasons.)
No data lost, everything fine, except that nobody could reach any of the sites.
I immediately zapped that site and anything that looked similar, and I've created a temporary front-end server while waiting for service to be restored, and manually routed the blogs I could remember are being actively used quickly to the new server, and things are working again. (I could route everything to the temporary server, but I'd rather not, for... Reasons.)
Running double-offsite backups just in case somehow bad things propagate to the other datacenter. Which shouldn't be possible but anyway...
Update: All sites should be back up, so I need to start scrubbing the database for any more crap. The most obvious ones are gone. Also the temporary server is still running so if something happens again we can quickly come back up with just a DNS update.
Posted by: Pixy Misa at
12:47 AM
| Comments (2)
| Add Comment
| Trackbacks (Suck)
Post contains 183 words, total size 1 kb.
49kb generated in CPU 0.0274, elapsed 0.2284 seconds.
58 queries taking 0.2199 seconds, 351 records returned.
Powered by Minx 1.1.6c-pink.
58 queries taking 0.2199 seconds, 351 records returned.
Powered by Minx 1.1.6c-pink.