aulakh83:

Then how can i make the model not to consider those again in other iterations.


One thing that might be worthwhile to try is progressively increasing the amount if that matches what you want to achieve.


One more question how can i calculate the inference time of the model


I don’t have a good answer, but two thoughts:

I don’t think unstructured sparsity is something lending itself easily to performance gains. (Though at 90%ish it might just work, but I would not know how to do it.)
I would probably measure time.

Best regards
Thomas