I ran  your code and here is my result:
EPOCH # 0
The loss is: 1.2877309322357178
EPOCH # 1
The loss is: 2.0903804302215576
EPOCH # 2
The loss is: 1.9283970594406128
EPOCH # 3
The loss is: 0.9835712313652039
EPOCH # 4
The loss is: 0.45820337533950806
EPOCH # 5
The loss is: 1.0796217918395996
EPOCH # 6
The loss is: 1.0129979848861694
EPOCH # 7
The loss is: 0.5118906497955322
EPOCH # 8
The loss is: 0.4246406555175781
EPOCH # 9
The loss is: 0.6247745156288147
which means that it’s working, I think your main problem is solved, now you have to add validation set and some regularizers to decrease your loss