Hi Wassim,
Sounds like your model is over fitting to the training set. You could try adding regularization or dropout during training to avoid it. You can also read up more about how else to avoid overfitting to the training set online.
Hope this helps,
Best,
Prerna