While OS-level buffer caching is advantageous
for general applications with high cache hit rates,
it lacks fine-grained control over cache usage per
process or buffer eviction at the application level.
In the context of on-device memory constraints
and large model sizes, this could lead to ineffec-
tive caching cycles and buffer eviction, leading to
minimal gains and potential issues with memory
allocation and Translation Lookaside Buffer (TLB)
churn.

4.1 Results for OPT 6.7B Model
This section presents the outcomes for the OPT
6.7B model, specifically under conditions where
the memory allocated for the model in DRAM is
approximately half of its baseline requirement.
LLM in a flash