Storage Optimization, Software Architecture, AWS, Icebergs, Kafka.
is a component of our team’s Baggins service, which is an internal abstraction layer over S3 that caters to media-specific use cases. Architecture At a higher level, we have designed a Data Lifecycle Manager that passively monitors and sifts what data can be safely deleted or moved to colder