model forwards can take an inputs_embeds param
# [Codecov](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=h1) Report
> Merging [#1695](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=desc) into [master](https://codecov.io/gh/huggingface/transformers/commit/68f7064a3ea979cdbdadfed62ad655eac4c53463?src=pr&el=desc) will **increase** coverage by `0.07%`.
> The diff coverage is `98.17%`.

[![Impacted file tree graph](https://codecov.io/gh/huggingface/transformers/pull/1695/graphs/tree.svg?width=650&token=9qOlN6Hb1c&height=150&src=pr)](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=tree)

```diff
@@            Coverage Diff             @@
##           master    #1695      +/-   ##
==========================================
+ Coverage   83.95%   84.03%   +0.07%     
==========================================
  Files          94       94              
  Lines       13951    14021      +70     
==========================================
+ Hits        11713    11782      +69     
- Misses       2238     2239       +1
```


| [Impacted Files](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=tree) | Coverage Δ | |
|---|---|---|
| [transformers/modeling\_tf\_distilbert.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX2Rpc3RpbGJlcnQucHk=) | `98.59% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_gpt2.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX2dwdDIucHk=) | `94.79% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_bert.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX2JlcnQucHk=) | `96.6% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_xlnet.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX3hsbmV0LnB5) | `87.82% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_openai.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX29wZW5haS5weQ==) | `96.04% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_utils.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX3V0aWxzLnB5) | `92.4% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_ctrl.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX2N0cmwucHk=) | `97.75% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_transfo\_xl.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX3RyYW5zZm9feGwucHk=) | `92.21% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_xlm.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX3hsbS5weQ==) | `90.39% <ø> (ø)` | :arrow_up: |
| [transformers/modeling\_tf\_roberta.py](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree#diff-dHJhbnNmb3JtZXJzL21vZGVsaW5nX3RmX3JvYmVydGEucHk=) | `89.9% <ø> (ø)` | :arrow_up: |
| ... and [11 more](https://codecov.io/gh/huggingface/transformers/pull/1695/diff?src=pr&el=tree-more) | |

------

[Continue to review full report at Codecov](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=continue).
> **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by [Codecov](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=footer). Last update [68f7064...00337e9](https://codecov.io/gh/huggingface/transformers/pull/1695?src=pr&el=lastupdated). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
<|||||>LGTM.
Feel free to add the TF version or merge if you don't want to add them now.