<Tip>  
Model offloading requires 🤗 Accelerate version 0.17.0 or higher.  
</Tip>  
[Sequential CPU offloading](#cpu-offloading) preserves a lot of memory but it makes inference slower because submodules are moved to GPU as needed, and they're immediately returned to the CPU when a new module runs.