2

DRAMFlash Memory100 GB10 GBCPUGPU~ 1 GB/s~10 GB/s48163264ChunkSize(KB)0100020003000400050006000RandomReadThroughput(MB/s)UpperBound(SequentialRead)Threads32168422.2 Read Throughput
Flash memory systems perform optimally with
large sequential reads. For instance, benchmarks
on an Apple MacBook Pro M2 with 2TB flash
demonstrate speeds exceeding 6GiB/s for a 1GiB
linear read of an uncached file. However, this high
bandwidth is not replicated for smaller, random
reads due to the inherent multi-phase nature of
these reads, encompassing the operating system,
drivers, interrupt handling, and the flash controller,
among others. Each phase introduces latency, dis-
proportionately affecting smaller reads.
LLM in a flash