Minimal model for writing tests.
# 🚀 Feature request

Add minimal models that satisfy different transformers interfaces.

## Motivation

I'd like to write some tests for a project that uses the transformers package in the background. To test my functionality I somehow need to use a transformers model (or a mock). However typically the models that are available are pretty huge, which typically causes bitbucket pipelines (or what ever CI pipeline) to fail due to memory limitations of the docker container.

Thus it would be really cool if you could provide minimal models that satisfy the transformers interfaces such that the `transformers.Trainer` object can use it for example.

If something like that is already available I couldn't really find it, but let me know if there is something.

Cheers :beer: 

Do the models available on https://huggingface.co/hf-internal-testing fit your use-case? That's what we use internally for our testing with dummy models.

These are randomly instantiated, however. They should only be used for mock testing.<|||||>Thanks, this is exactly what I was looking for! Are these not meant to be found, or did I just not search good enough? :smile: <|||||>They're used for our internal testing and not really intended for public usage, so we don't really communicate about it. Now that we're aware that some users may find them useful, we should do a better job of advertising them :)<|||||>Alright! Thanks for letting me know! :beer: <|||||>This is extremely useful, thank you!  I was looking for a way to ensure that connecting a transformer's encoding to our downstream models was working without downloading a giant model, even if it's not giving useful results.

However, as of March 2023, the models do not show up in searches, even if you specifically search for `hf-internal-testing`.  

This page is empty, for example:

https://huggingface.co/models?search=hf-internal-testing

As is this one:

https://huggingface.co/models?search=hf-internal-testing%20roberta

Is that something you could fix?  I understand you probably don't want to show the models all of the time, such as when someone is searching for a bert they actually want to use.  Perhaps it would work to change it so that if a search shows nothing at all, but some internal testing models matched, then the internal testing models show up