Monday, December 23

Geek

Dirty Deeds Done Dirt Cheap

So, this is what I've done.  Virtual server with 24GB memory for $24 per month...  So long as you don't want to use all 24GB at once.

top - 05:43:22 up 2:06, 3 users, load average: 0.13, 0.05, 0.04
Tasks: 403 total, 1 running, 359 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.7 us, 0.7 sy, 0.0 ni, 98.1 id, 0.3 wa, 0.0 hi, 0.2 si, 0.0 st
KiB Mem : 4039484 total, 106752 free, 2530504 used, 1402228 buff/cache
KiB Swap: 20971512 total, 20000504 free, 971008 used. 1252856 avail Mem

It seems to be working pretty well.  I have multiple copies of MySQL running, plus MongoDB, Elasticsearch, Redis, and RabbitMQ, and while it has pushed stuff out to swap, it's not actively swapping, because no single test environment needs more than 4GB.  And it swaps back in pretty fast when needed.

Now I just need to make sure that all the nonsense I've done since yesterday hasn't wrecked the awesome performance I was getting.

Update: Seems to be just as fast as before - over 100 messages per second with a single worker, with all application features enabled, plus ZFS compression.  Read requests in the short-form test suite are slightly slower (up from 6.6ms to 7.7ms on average), but that might be because the PyPy jit hadn't fully optimised that code path.  Doing a full test run now.

Update: Yep, that gave me an average read request time of 6.6ms over the full run.  That's pulling the latest 20 messages from your feed along with all associated information.  With no caching - I have a caching module but it's disabled for now to make sure the core engine is fast.

Also took a look at the ZFS stats.  Both my deduplication ratio and my compression ratio are running at around 2:1, so for the 12.9GB used in my test environments so far, I'm using 3.56GB of actual disk space.

And that's when TokuDB writes its data in compressed format already.  ZFS helps by compressing the unused sections of the TokuDB files, because it allocates 2MB at a time by default.  Since every table and index on TokuDB is a separate file, that can add up.

So in short: The new VPS works great, it runs my test suite close to three times faster than before (which is very welcome given how many times I expect to run it over the next three weeks), ZFS works great, TokuDB works great, LXD works great except for the networking stuff, and even that is manageable now that I know the /etc/hosts trick, and it's all about $20 per month cheaper than the old server.

Posted by: Pixy Misa at 03:44 PM | Comments (1) | Add Comment | Trackbacks (Suck)
Post contains 445 words, total size 3 kb.

1 BTW, bit of spam on Brickmuppet again.

Posted by: Mauser at Monday, December 23 2019 05:29 PM (Ix1l6)

Hide Comments | Add Comment




Apple pies are delicious. But never mind apple pies. What colour is a green orange?




49kb generated in CPU 0.015, elapsed 0.1086 seconds.
58 queries taking 0.0979 seconds, 339 records returned.
Powered by Minx 1.1.6c-pink.