Allow generic composite models to pass more kwargs
# What does this PR do?

Generic composite models: `(Text|Vision|Speech)EncoderDecoder`: their `forward` don't have the full info. in their 2 components.

Fix #24919
_The documentation is not available anymore as the PR was closed or merged._<|||||>Looking at the errors, we probably need to check whether the model has `self.encoder` or `self.model.encoder` <|||||>> Looking at the errors, we probably need to check whether the model has `self.encoder` or `self.model.encoder`

I can do this, but the `model` in `self.model` is not something from convention I guess: it's more a implementation detail of each (concrete) encoder decoder model class (like `bart`)<|||||>@gante 

Let me know if the latest change LGTY 🤗 . Thanks!