The main reason they will collapse the BATCH and SEQ_LENGTH axis to a single axis is because of the CrossEntropyLoss layer, which takes the tensor of shape “ITEMS*NUM_CLASSES”. Other than this they are pretty much the same.