TFAlbertModelTest::test_pt_tf_model_equivalence  -> Fatal Python Error on Mac
Running the unit tests locally on mac, I get "Fatal Python error: Aborted"

To reproduce, try `pytest tests/test_modeling_tf_albert.py::TFAlbertModelTest::test_pt_tf_model_equivalence ` 


### Environment Info

- `transformers` version: 2.4.1
- Platform: Darwin-19.0.0-x86_64-i386-64bit
- Python version: 3.7.5
- PyTorch version (GPU?): 1.3.1 (False)
- Tensorflow version (GPU?): 2.0.0 (False)

### Traceback

```
tests/test_modeling_tf_albert.py Fatal Python error: Aborted

Current thread 0x0000000110d2adc0 (most recent call first):
  File "/Users/shleifer/miniconda3/envs/nb/lib/python3.7/site-packages/torch/nn/functional.py", line 1372 in linear
  File "/Users/shleifer/miniconda3/envs/nb/lib/python3.7/site-packages/torch/nn/modules/linear.py", line 87 in forward
  File "/Users/shleifer/miniconda3/envs/nb/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541 in __call__
  File "/Users/shleifer/transformers_fork/src/transformers/modeling_albert.py", line 321 in forward
  File "/Users/shleifer/miniconda3/envs/nb/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541 in __call__
  File "/Users/shleifer/transformers_fork/src/transformers/modeling_albert.py", line 566 in forward
  File "/Users/shleifer/miniconda3/envs/nb/lib/python3.7/site-packages/torch/nn/modules/module.py", line 541 in __call__
  File "/Users/shleifer/transformers_fork/tests/test_modeling_tf_common.py", line 111 in test_pt_tf_model_equivalence

```

https://github.com/huggingface/transformers/issues/2240 has a different error message from a similar test.


Thanks!
#2240 was an error with DistilBERT and was fixed with https://github.com/huggingface/transformers/commit/ea2600bd5f1d36f2fb61958be21db5b901e33884 

Does this error happen every time you run the test suite?<|||||>yes!<|||||>I'm running on Darwin 19.2, Python 3.7.5, torch 1.3.1, tensorflow 2.0.0 and transformers from source and I can't replicate this bug 😕

I'm thinking this may be due to a memory issue but it's hard to say given the cryptic error message<|||||>I bumped tensorflow to 2.1 and cant replicate this failure **or** the flaky CircleCI test #2781
- `transformers` version: 2.4.1
- Platform: Darwin-19.0.0-x86_64-i386-64bit
- Python version: 3.7.5
- PyTorch version (GPU?): 1.4.0 (False)
- Tensorflow version (GPU?): 2.1.0 (False)
- Using GPU in script?: <fill in>
- Using distributed or parallel set-up in script?: <fill in><|||||>I also just tried to use python 3.5 and can't replicate.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
