[test] split test into 4 sub-tests to avoid timeout
This PR splits the long test into 4 sub-tests to avoid timeout, as each sub-test is relatively slow.

This supercedes https://github.com/huggingface/transformers/pull/12699

@LysandreJik, @sgugger 

