Yes, I was talking more about memory reservation, however pytorch pool memory allocator  should not have problems at this level, my intention was to have all memory allocated to avoid the typical problems that arise when you allocate and deallocate dynamically.