I can reproduce the issue, which is raised by disabling the gradient calculation globally by the silero-models creation in this line of code 15.
I don’t know, why it’s disabling the gradient calculation, but you can enable it again via:
torch.set_grad_enabled(True)

after loading the model.