Found that same mask for each time step is also simple by just inheriting torch.nn._functions.dropout.Dropout and overriding as follows (assuming the input is seqlen X batchsize X dim):
def _make_noise:
	return input.new().resize_(1, input.size(1), input.size(2))'