Unfortunately I don’t know what the best approach would be.
If possible, I would try to add the fused layers from the beginning, but if your model is already trained and you would like to fuse these layers now, you would have to try out different approaches.