On the instance with the normal network run your program which will download and cache models (and optionally datasets if you use 🤗 Datasets). For example:
python examples/pytorch/translation/run_translation.py --model_name_or_path t5-small --dataset_name wmt16 --dataset_config ro-en ...
and then with the same filesystem you can now run the same program on a firewalled instance:
HF_DATASETS_OFFLINE=1 TRANSFORMERS_OFFLINE=1 \
python examples/pytorch/translation/run_translation.py --model_name_or_path t5-small --dataset_name wmt16 --dataset_config ro-en ...
and it should succeed without any hanging waiting to timeout.
Fetching models and tokenizers to use offline
When running a script the first time like mentioned above, the downloaded files will be cached for future reuse. 
However, it is also possible to download files and point to their local path instead.
