This PR 87 should have added the support for indexing into nn.ModuleList. Which PyTorch version are you using? If you are using an older one (pre 1.5), could you update to the latest stable version and rerun your script, please?