Request support for RWKV-4-World model.
### Model description

As RWKV-4-World is using a different tokenizer and vocabs, the current RWKV support in transformers is incompatible.

### Open source status

- [X] The model implementation is available
- [X] The model weights are available

### Provide useful links for the implementation

https://huggingface.co/StarRing2022/RWKV-4-World-1.5B
@StarRing2022
@sgugger Is it possible to add the support for it? I'd like to use PEFT to fine tune the model.<|||||>We have implemented the function of fine-tuning the RWKV-World model using the peft library, and we will immediately publish it in HF<|||||>The relevant code will be provided under this issue<|||||>Please refer to：
https://github.com/StarRing2022/HF-For-RWKVWorld-LoraAlpaca
https://huggingface.co/StarRing2022/RWKV-4-World-7B<|||||>> Please refer to： https://github.com/StarRing2022/HF-For-RWKVWorld-LoraAlpaca https://huggingface.co/StarRing2022/RWKV-4-World-7B

@StarRing2022 Thank you for your great work.
Will you make a PR for it? Or will you just keep it a separate repo?
I'd like to see it PR back to hf transformers. And others can get your work easily.

https://github.com/StarRing2022/RingRWKV
I think this should be mentioned in the example github repo as well.<|||||>cc @younesbelkada <|||||>Thanks，there are indeed some issues with the RWKV in HF format on the official transformers. Recently, we have found that there are issues such as CFG and sample_ Logits, PR is necessary, and we also hope that the official can provide improvements