Dear Apaszke, thank you for your updates! But I am still a little confused about your answer. Like in your example, you have 3 modules (base, headA, headB),  but how could you decompose them into pieces that don’t share parameters? Looking forward to your answer, please! Thank you for your attention.