Some other numbers: I have a 4x320 bidir LSTM network followed by a linear transform (typical setup with the CTC loss function).
The network computation takes 1.2sec, while packing takes 1.3 secs, which is more than half of the computation time.
A C++ implementation would be much appreciated.