@ptrblck sir, I have the same problem here, can you help me determine where I put the cuda. empty_cache()?

  
    
    
    RuntimeError: CUDA out of memory? vision
  
  
    Check the attention_maps and raw_features, as well.  If they are not scalers, and they do not participate in the training (contribute to it, and you are just using them as pure outputs) considert doing a detach() on them as well.