Yes, decreasing the batch size would be a simple way to decrease the memory usage.
Another way could be to use e.g torch.utils.checkpoint to trade compute for memory or, if possible, decrease the spatial size of the inputs etc. (but this depends on the model).