Have you found a way to update the sparse parameters? If it did not work, have you tried it in tensorflow? After searching online it seems that this is currently impossible for pytorch but that in tensorflow there are workarounds. Have you looked into this?