after I reduce the depth of the dl model,here is the report:
[epoch 0 step 0 loss 2560.6475]
[epoch 0 step 1 loss 2552.1030]
[epoch 0 step 2 loss 2326.0481]
[epoch 0 step 3 loss 2074.4417]
[epoch 0 step 4 loss 1908.8021]
[epoch 0 step 5 loss 1693.8888]
[epoch 0 step 6 loss 1524.7013]
[epoch 0 step 7 loss 1367.1302]
[epoch 0 step 8 loss 1221.5389]
[epoch 0 step 9 loss 1098.3346]
[epoch 0 step 10 loss 927.1423]
[epoch 0 step 11 loss 826.2545]
[epoch 0 step 12 loss 796.7938]
[epoch 0 val_loss 650.3557]
[epoch 1 step 0 loss 632.1362]
[epoch 1 step 1 loss 594.0154]
[epoch 1 step 2 loss 552.5127]
[epoch 1 step 3 loss 544.2441]
[epoch 1 step 4 loss 562.6210]
[epoch 1 step 5 loss 585.8839]
[epoch 1 step 6 loss 566.8837]
[epoch 1 step 9 loss 519.0481]
[epoch 1 step 10 loss 503.7430]
[epoch 1 step 11 loss 480.8072]
[epoch 1 step 12 loss 470.9222]
[epoch 1 val_loss 945.2809]
[epoch 2 step 0 loss 450.9913]
[epoch 2 step 1 loss 405.8258]
[epoch 2 step 2 loss 399.1376]
[epoch 2 step 3 loss 404.3622]
[epoch 2 step 4 loss 408.4886]
[epoch 2 step 5 loss 387.0332]
[epoch 2 step 6 loss 388.2880]
[epoch 2 step 7 loss 349.8983]
[epoch 2 step 8 loss 364.2084]
[epoch 2 step 9 loss 388.2591]
[epoch 2 step 10 loss 343.5857]
[epoch 2 step 11 loss 356.0178]
[epoch 2 step 12 loss 359.7800]
Traceback (most recent call last):
File “main.py”, line 158, in 
y_val = model(x_test)
File “/home/cwzhou/.conda/envs/pytorch/lib/python3.8/site-packages/torch/nn/modules/module.py”, line 550, in call
result = self.forward(*input, **kwargs)
File “/home/cwzhou/20200729_H2B_tocaiwei/networks.py”, line 210, in forward
x = F.relu(self.res_conv3(x) + resx)
File “/home/cwzhou/.conda/envs/pytorch/lib/python3.8/site-packages/torch/nn/modules/module.py”, line 550, in call
result = self.forward(*input, **kwargs)
File “/home/cwzhou/.conda/envs/pytorch/lib/python3.8/site-packages/torch/nn/modules/container.py”, line 100, in forward
input = module(input)
File “/home/cwzhou/.conda/envs/pytorch/lib/python3.8/site-packages/torch/nn/modules/module.py”, line 550, in call
result = self.forward(*input, **kwargs)
File “/home/cwzhou/.conda/envs/pytorch/lib/python3.8/site-packages/torch/nn/modules/activation.py”, line 94, in forward
return F.relu(input, inplace=self.inplace)
File “/home/cwzhou/.conda/envs/pytorch/lib/python3.8/site-packages/torch/nn/functional.py”, line 1063, in relu
result = torch.relu(input)
RuntimeError: CUDA out of memory. Tried to allocate 114.00 MiB (GPU 0; 10.92 GiB total capacity; 10.37 GiB already allocated; 3.06 MiB free; 10.39 GiB reserved in total by PyTorch)