I know that convnets could use  F.conv2d, but how about LSTMs, RNNs?
Is there a functional interface for LSTMs?
EDIT: It looks like 2nd order gradients are not supported for LSTMs anyway. So it is of no use to assign weights to LSTMs for now.