For an equivalent of Keras TimeDistributed you want indeed just a single module.
Yes, as you noted, duplicating the module might not be the right thing.

As an aside, there is an old issue requesting this feature: https://github.com/pytorch/pytorch/issues/1927 180
Best regards
Thomas