Thank you Thomas, I started experimenting these thoughts that why took long to reply. But today i got the results,  progressive increasing the amount till i reach threshold worked well and i am able to speed up the model by measuring the time before inference call and after that. My aim was not to have performance gains but just to reduce model size that i am  able to achieve thanks