Thanks for the information.
Since you’ve set torch.backends.cudnn.deterministic = True, the applied algorithms might have a different memory requirement for different data types, which seems to be higher in O1 than in O0 for this use case.