Storage Optimization, Software Architecture, AWS, Icebergs, Kafka.
storage. We take a “mark and sweep” kind of approach for the Garbage Collection. To start with, we keep all our bytes in AWS’s Simple Storage Service (S3). However, for each file in S3, we maintain some metadata for each file in Baggins. This metadata resides in the Cassandra database and includes