Oh right, this is probably because strict=False only checks for missing keys, not different sizes for the same keys.
What you could do is removing the fc from your destination model, and adding it again after loading the weights…