I encountered a similar problem. Different batch sizes gave me different results. model.eval() is used in my testing.
Could you be more specific, which 1d tensor you used is causing the problem?
thanks,