Hi, could you give me any advice on training? Thank you. The training loss doesn’t decrease. Is it normal to have a such high loss, and stuck here? I tried  different learning rates, 1e-3, 1e-4, 1e-5, and used a scheduler multiple the learning rate by 0.1 every 40 epochs. If the learning rate is a bit big, the loss should have changed after 40 and 80 epochs, but it seems not.
---Epochs: 0/300---Training loss:378.9626 time per epoch: 22.2s
tensor(463.3724, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:463.3724
-------------------------------------------------
---Epochs: 1/300---Training loss:296.5503 time per epoch: 22.0s
tensor(376.3032, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:376.3032
-------------------------------------------------
---Epochs: 2/300---Training loss:251.9911 time per epoch: 22.0s
tensor(339.0182, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:339.0182
-------------------------------------------------
---Epochs: 3/300---Training loss:213.2080 time per epoch: 22.0s
tensor(321.4742, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:321.4742
-------------------------------------------------
---Epochs: 4/300---Training loss:208.8714 time per epoch: 22.1s
tensor(317.3396, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:317.3396
-------------------------------------------------
---Epochs: 5/300---Training loss:201.6067 time per epoch: 22.2s
tensor(313.2032, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:313.2032
-------------------------------------------------
---Epochs: 6/300---Training loss:197.0980 time per epoch: 22.1s
tensor(310.2551, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:310.2551
-------------------------------------------------
---Epochs: 7/300---Training loss:198.4707 time per epoch: 22.0s
tensor(307.9322, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:307.9322
-------------------------------------------------
---Epochs: 8/300---Training loss:192.7238 time per epoch: 22.0s
tensor(307.5226, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:307.5226
-------------------------------------------------
---Epochs: 9/300---Training loss:193.3006 time per epoch: 22.2s
tensor(307.2828, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:307.2828
-------------------------------------------------
---Epochs: 10/300---Training loss:196.9237 time per epoch: 22.0s
tensor(307.1403, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:307.1403
-------------------------------------------------
---Epochs: 11/300---Training loss:209.6514 time per epoch: 22.1s
tensor(307.0083, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:307.0083
-------------------------------------------------
---Epochs: 12/300---Training loss:181.3789 time per epoch: 22.1s
tensor(306.9789, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:306.9789
-------------------------------------------------
---Epochs: 13/300---Training loss:189.3164 time per epoch: 22.1s
tensor(306.9626, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:306.9626
-------------------------------------------------
---Epochs: 14/300---Training loss:207.4668 time per epoch: 22.1s
tensor(306.9458, device='cuda:0', grad_fn=<AddBackward0>)
---Validation loss:306.9458