Hyperdrive v10 – a peer-to-peer filesystem
This is really cool, but why reinvent the wheel? For instance SQLite already has tons of years of optimization regarding storing and accessing files on disk.<p>To make SQLite decentralized (like Hyperdrive) you can put in a torrent. Index it using full-text-search <a href="https://sqlite.org/fts5.html" rel="nofollow">https://sqlite.org/fts5.html</a> for instance. Then let the users seed it.<p>Users can use sqltorrent Virtual File System (<a href="https://github.com/bittorrent/sqltorrent" rel="nofollow">https://github.com/bittorrent/sqltorrent</a>) to query the db without downloading the entire torrent - essentially it knows to download only the pieces of the torrent to satisfy the query. This is similar techniques behind Hyperdrive I believe just again, using standard tools and tech that exists and highly optimized: <a href="https://www.sqlite.org/vfs.html" rel="nofollow">https://www.sqlite.org/vfs.html</a><p>Every time a new version of the SQLite db is published (say by wikipedia), the peers can change to the new torrent and reuse the pieces they already have - since SQLite is indexed in an optimal way to reduce file changes (and hence piece changes) when the data is updated.<p>I talk a bit about it here: <a href="https://medium.com/@lmatteis/torrentnet-bd4f6dab15e4" rel="nofollow">https://medium.com/@lmatteis/torrentnet-bd4f6dab15e4</a><p>Again not against redoing things better, but why not use existing proven tech for certain parts of the tool?