Thursday, May 20

Blog

Google In The Apiary With A Lead Pipe

The server was getting overloaded with crappy requests again, but I couldn't see any difference between the crappy requests overloading the server and the usual crappy requests that only take about 50 milliseconds and cause no problems at all.

Except that we were also getting indexed by Google and the Google bot was tracking links to RSS feeds in places where RSS feeds don't really belong but the server will do its best to fulfil anyway.

So I blocked a couple of those.  Not all of them, just a couple.

And the problem was resolved.

Posted by: Pixy Misa at 03:51 PM | Comments (5) | Add Comment | Trackbacks (Suck)
Post contains 103 words, total size 1 kb.

1 Search is still busted. Works on ai.mee.nu, but not on zaitcev.mee.nu.

Posted by: Pete Zaitcev at Saturday, May 29 2021 03:50 PM (LZ7Bg)

2 Yep, I'll unblock that this weekend.

I did it while the main server was down after the datacenter fire, because we needed ever milligram of performance we could get.  If I'd figured out this RSS problem at the time I wouldn't have needed to disable search at all.

Posted by: Pixy Misa at Saturday, May 29 2021 03:55 PM (PiXy!)

3 Thanks. BTW, my blog sustained a massive data loss. Posts for 2013, 2014, and 2015 are lost. I have backups in text files and should be able to re-upload them (although without an API it means copy-pasting them by hand). Still, I wonder how that happened. This is the second time Mee.nu loses data for me, although the previous time it was just images.

Posted by: Pete Zaitcev at Monday, May 31 2021 10:07 AM (LZ7Bg)

4 Pete - those posts are hidden, not lost, part of the emergency performance hacks.  They'll be back (with all their comments) this week.

Posted by: Pixy Misa at Monday, May 31 2021 10:10 AM (PiXy!)

5 That is amazing, Pixy. Speaking as an amateur sysadmin, I wish I could look into your kitchen with just one eye, as they say.

Posted by: Pete Zaitcev at Monday, May 31 2021 10:23 AM (LZ7Bg)

Hide Comments | Add Comment




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




45kb generated in CPU 0.1, elapsed 0.2645 seconds.
58 queries taking 0.1872 seconds, 270 records returned.
Powered by Minx 1.1.6c-pink.