While there might be a way to write a custom nn.Module accepting two inputs and somehow make sure the nn.Sequential contain won’t break, I think the best approach would still be to use your original model, which uses torch.cat in its forward.
nn.Sequential containers are used for simple sequential models, while custom modules allow more flexibility, which seems to perfectly fit your use case.
What’s the reason you want to transform it into an nn.Sequential?