I started this thread not understanding at all how RNNs work in pytorch, now everything is clear to me. Thank you a lot!
The sequences are pretty short but I still want to do this the right way and send in the whole sequence instead as it makes for cleaner testing and evaluating.
Im going to mark the thread as solved if I figure out how to.