Fix: Cannot tokenize with bf16 and on cpu (#766)
Browse files
README.md
CHANGED
|
@@ -819,7 +819,7 @@ accelerate launch -m axolotl.cli.train your_config.yml
|
|
| 819 |
|
| 820 |
You can optionally pre-tokenize dataset with the following before finetuning:
|
| 821 |
```bash
|
| 822 |
-
CUDA_VISIBLE_DEVICES=
|
| 823 |
```
|
| 824 |
|
| 825 |
##### Config
|
|
|
|
| 819 |
|
| 820 |
You can optionally pre-tokenize dataset with the following before finetuning:
|
| 821 |
```bash
|
| 822 |
+
CUDA_VISIBLE_DEVICES=0 accelerate launch -m axolotl.cli.train your_config.yml --prepare_ds_only
|
| 823 |
```
|
| 824 |
|
| 825 |
##### Config
|