Storage Optimization, Software Architecture, AWS, Icebergs, Kafka.
a specified duration, transferring it to more cost-effective storage tiers when not in use, or at the very least, maintaining a justification for its indefinite retention for future reference and decision-making. The design should be versatile, that can be used in a wide array of tasks and