Hi there!
I am running a project of visual speech recognition task, the network structure is 3DConv+Resnet18+15*depth-wise 1DConv, the loss is CTC loss, and I can get a relatively good performance under model.train(). When I change the mode to model.eval() in val stage, the performance get very poor, and basically remain unchanged. But when I don’t use model.train() in val stage, the performance has little difference with that of training.
How to solve this problem?  If anybody want more information about the project, just ask me.
Can anybody help me? Thanks very much!