Solved by TigerVersusT in post #2 
              
              
                Reply to myself: DEADLY simple, just navigate through the whole model find Conv layers and repalce them with new Conv module. I was using distiller and think this problem in an univresal view, It is quit hard if you want to prune filters for ALL CNN based model but deadly simple for a given CNN.