model = MyModel()

you can get the dirct children (but it also contains the ParameterList/Dict, because they are also nn.Modules internally):
print([n for n, _ in model.named_children()])

If you want all submodules recursively (and the main model with the empty string), you can use named_modules instead of named_children.
Best regards
Thomas