Yes. The same definition of batch_size applies to the RNN as well.
But the addition of time steps might make things a bit tricky (RNNs take input as batch x time x dim as input, assuming all the data instances in the batch are padded to have same number of time steps).
Also, take care of batch_first=True/False option in RNNs.