I will post my solution for this in two days or so when I get it done, but it will involve pickling the tensors and then just reading them into a batch then running through my model. Saving tensors to a pickle file does bring up a warning that pickle is not going to be supported in 1.5.