Jetpants: a MySQL toolkit for managing billions of rows and hundreds of DBs
It looks interesting but one small thing. I looked into the transferring large files quickly link[1] and saw that they were using netcat and tar to transfer files. This is not necessarily optimal[2], and applying some compression can go a long way, although this will be dependent on the use case. Compression also has the added bonus of transferring less data across the network and (if you don't uncompress) less space at the other end.<p>SSH is also an option (a slow option, but an option) that provides certain things (encryption, authentication) that make it ideally suited for transfers across network boundaries.<p>[1] - <a href="http://engineering.tumblr.com/post/7658008285/efficiently-copying-files-to-multiple-destinations" rel="nofollow">http://engineering.tumblr.com/post/7658008285/efficiently-co...</a><p>[2] - <a href="http://www.ndchost.com/wiki/server-administration/netcat-over-ssh" rel="nofollow">http://www.ndchost.com/wiki/server-administration/netcat-ove...</a>