Allow passing arguments to model testers for CLIP-like models
# What does this PR do?

This is a continuation of PR #19954, but for model likes `CLIP`. Currently for such models, we have 
```python
class CLIPModelTester:
    def __init__(self, parent, is_training=True):
        self.parent = parent
        self.text_model_tester = CLIPTextModelTester(parent)
        self.vision_model_tester = CLIPVisionModelTester(parent)
```
and there is no way to pass any argument to the 2 component testers.

If this POC is approved, I will work on other models like `GroupViT`, `OwlViT`, `XCLIP` etc.


_The documentation is not available anymore as the PR was closed or merged._<|||||>`GroupViT`, `OwlViT`, `XCLIP`.

`Flava` too, but with name `image_model_tester` instead of `vision_model_tester`.



