S3QL: an S3 FS with encryption, de-dup, immutable trees and snapshotting
I was recently looking into options for offsite, encrypted (at-rest & in-transit), deduplicated, snapshotted, backups to S3. S3QL was one of the options I investigated, but unfortunately their crypto is MAC-then-encrypt [0], which is no good.<p>A small sample of the other options considered:<p><pre><code>    * EncFS + rsnapshot/rdiff-backup
        * Weak cryptography in EncFS [1]
    * Duplicity
        * Uses forward snapshots, so recovery takes longer with each successive snapshot, unless you upload a "fresh" copy of the data
    * ext4 on LVM on LUKS on a loopback device provided by s3backer [2]
        * OK I'll admit this one is pretty far out there, but it actually works decently well (ignoring the massive FUSE overhead)
        * Downside: a slight hiccup in network connectivity guarantees data corruption
    * Attic
        * Known data corruption issues with large datasets [3]
</code></pre>
Does anyone know of anything that can provide the above requirements? At this point it's really more of a thought experiment, as I've decided to go with Tarsnap [4] for my use-case.<p>[0]: <a href="http://www.rath.org/s3ql-docs/impl_details.html" rel="nofollow">http://www.rath.org/s3ql-docs/impl_details.html</a><p>[1]: <a href="https://defuse.ca/audits/encfs.htm" rel="nofollow">https://defuse.ca/audits/encfs.htm</a><p>[2]: <a href="https://github.com/archiecobbs/s3backer" rel="nofollow">https://github.com/archiecobbs/s3backer</a><p>[3]: <a href="http://librelist.com/browser/attic/2015/3/31/comparison-of-attic-vs-bup-vs-obnam/#cbbe599389a20c787a74b137dc78fb1a" rel="nofollow">http://librelist.com/browser/attic/2015/3/31/comparison-of-a...</a><p>[4]: <a href="https://www.tarsnap.com/" rel="nofollow">https://www.tarsnap.com/</a>