Tuesday, February 09

Geek

Tiny Bee Pistols!

I'd forgotten about this one: mxBeeBase.  Open source B+tree Python library.

Perfect!

So that's R-trees, Quadtrees and B+trees done.  Within hours of deciding I was going to write my own database I already have all the indexing dealt with. wink

Oh, and Pita is going to be open source too.  BSD license, probably, unless I need to use something GPL.

Posted by: Pixy Misa at 02:31 AM | Comments (2) | Add Comment | Trackbacks (Suck)
Post contains 63 words, total size 1 kb.

1 For our business (not web related at all) we write our own database software. Processing time is phenomenally fast.   It's a hell of a lot of work, but the results have kept our little business going for over 30 years. I've worked for them for 20 years this year. (of course it helps that the guy I work for is an absolute genius... LOL).

Posted by: Teresa at Tuesday, February 09 2010 03:05 PM (ZCuP9)

2 A lot of the complexity of databases comes from the combination of ACID semantics (atomic, consistent, something*, durable), availability, and scalable performance on disk-based storage.

As soon as you can throw one of those requirements away, things start loosening up.  If you're a bank (say) and must have ACID, high availability, and scalable performance, you can still achieve that easily by installing a huge RamSan (hundreds of gigabytes of battery-backed, mirrored RAM that looks like a disk) but is a thousand times faster.  If you don't need full ACID, there's a ton of optimisations you can use.

For Minx I care a lot about the D in ACID, and about availability and performance.  But if a post gets half saved (or saved twice) in the event of a crash, that doesn't matter (as long as we don't crash too often).  Banks can't do that, but blogs can.  That means I can mostly do away with transations, which makes things a lot simpler.  And I already have an SSD in our server that can do 3500 IOPS - and 24GB of RAM for 15GB of databases - so I don't need to optimise the disk routines like crazy.

So I think it's actually feasible.  I'm willing to put a week or two of effort into it to find out, anyway.

* Isolated, but I had to look it up.

Posted by: Pixy Misa at Tuesday, February 09 2010 04:06 PM (PiXy!)

Hide Comments | Add Comment

Comments are disabled. Post is locked.
46kb generated in CPU 0.0175, elapsed 0.1102 seconds.
56 queries taking 0.0981 seconds, 340 records returned.
Powered by Minx 1.1.6c-pink.