Solved by ptrblck in post #6 
              
              
                I can reproduce the issue, which is raised by disabling the gradient calculation globally by the silero-models creation in this line of code. 
I don’t know, why it’s disabling the gradient calculation, but you can enable it again via: 
torch.set_grad_enabled(True)

after loading the model.