It is completely valid to combine the features extracted by two different models.
If it’s better is sort of up in the air. It really depends on what the two models are, if they were pretrained, how they were pretrained, and what your downstream task is. It’s really just something you need to experiment with.