I guess you didn’t strip pruning wrapper layer. You can apply clustering to the vanilla model without pruning wrapper. See end of the section - Sparsity preserving clustering Keras example 1
Anyway, you can follow the instructions in there to run sparsity + clustering , as David suggested.