Solved by OrielBanne in post #2 
              
              
                Hi 
You tell very little about your model architecture and data structure. However, in even epoch cycles, you could copy the part of the batch you want and delete from memory the other parts before you start any computation. This way- when you start computing for the batch, memory is of the size you…