Wesley_Neill:

Is that bad/wrong?


With neural networks, that’s always a tricky question :).
Really complaining are networks only when the shapes of the tensors to workout as inputs for the layers. That’s essentially the only case where PyTorch throws errors. And since this seemed to be your concern here, I merely tried to get a sense of what’s going on based on the shapes.
If a network does not throw any error, one can sometimes quickly spot that something is off. For example, a couple of weeks ago, someone tried to figure out why his RNN-based classifier wasn’t working, and it turnout that he used the first and not the last hidden state for further processing.
Beyond that, if something is bad or wrong depends on the data, the task, and whatnot.