change num_attention_heads=[1, 2, 5, 8] to [1,2,4,8]
Hi @NielsRogge ,

Is this a typo in segformer? The default number of attention heads should be `[1,2,4,8]`.

https://github.com/huggingface/transformers/blob/4354005291dacd5c8264f0936a33678df4f4bb71/src/transformers/models/segformer/configuration_segformer.py#L107
@NielsRogge I'll work on this.<|||||>Hi,

Thanks for pointing out, actually that piece of code is correct, we should just update the docstring.

As seen below (table taken from the [paper](https://arxiv.org/abs/2105.15203)), (N1, N2, N3, N4) refer to the number of heads in each stage:

<img width="832" alt="Screenshot 2022-04-05 at 16 50 13" src="https://user-images.githubusercontent.com/48327001/161781658-53578f3d-462c-470c-846f-9f07ecae4872.png">

Can you open a PR to fix the docstring?



<|||||>Hi @NielsRogge ,

Thanks for your quick reply very much.

This is my misunderstanding. I'm sorry to waste your time.

Best regards,
Jun<|||||>Can you still open a PR to fix it in the docs?