I don’t know how to perform pruning.   The idea is simple enough - cut out some of the attention heads that are not apparently doing anything useful - but the implementation will be tricky.
Have you considered fine-tuning a DistilBERT or ALBERT model instead?