No because the previous hidden state contains information about the sentences on that batch. On test time you would have hidden state of zero on a new sentence every time. So you want your network to learn around that