Update README.md
Browse files
README.md
CHANGED
|
@@ -49,7 +49,7 @@ This is an **early preview** of our 7B parameter RNN-based model, trained on 2k
|
|
| 49 |
```shell
|
| 50 |
pip3 install --upgrade rwkv-fla transformers
|
| 51 |
```
|
| 52 |
-
|
| 53 |
```python
|
| 54 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 55 |
|
|
|
|
| 49 |
```shell
|
| 50 |
pip3 install --upgrade rwkv-fla transformers
|
| 51 |
```
|
| 52 |
+
Before training: `export WKV_MODE=chunk`
|
| 53 |
```python
|
| 54 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 55 |
|