Monday, May 04

Geek

Invasion Of The Screen Scrapers

Someone found the author parameter and decided to try scraping every post on every blog on mee.nu.  From twenty different servers at once.  They've been blocked now.

Meanwhile, Akane running PyPy absolutely creams Aoi running Psyco.  PyPy was originally created by the same developer as Psyco but has a larger team and several years more active development, and it shows.  Combined with the faster CPU and the elimination of virtualisation overhead, the difference on this toy benchmark is on the order of 50x.

That's comparing our current JIT compiler to the new one, not interpreted to compiled.

Now I just have to update the template engine so that it doesn't trash that performance.  Accumulating the output using in-memory file operations should do the trick.

Update: Looks like PyPy is optimising some of the sub-tests into oblivion.  Adding some randomness into the benchmark to prevent that reduced it to only 6x faster.  Since the server also has twice the number of cores, that's 12x overall.

Posted by: Pixy Misa at 01:25 PM | No Comments | Add Comment | Trackbacks (Suck)
Post contains 169 words, total size 1 kb.




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




47kb generated in CPU 0.0178, elapsed 0.796 seconds.
56 queries taking 0.7843 seconds, 339 records returned.
Powered by Minx 1.1.6c-pink.