It won’t save computing time unfortunately. Even if you have many zero entries, as long as it is a dense weight tensor, the computation is basically the same. This is true to most if not all DL frameworks.