Wovchena commited on
Commit
fee8687
·
verified ·
1 Parent(s): 4a0d683

Update generation_config.json

Browse files

Extend `eos_token_id` with pad token because that's the token stored in `processor.tokenizer.eos_token_id`. That also simplifies the sample from the model card from
```py
generate_ids = model.generate(**inputs,
eos_token_id=processor.tokenizer.eos_token_id,
**generation_args
)
```
to
```py
generate_ids = model.generate(**inputs,
**generation_args
)
```

Files changed (1) hide show
  1. generation_config.json +4 -1
generation_config.json CHANGED
@@ -1,7 +1,10 @@
1
  {
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
- "eos_token_id": 2,
 
 
 
5
  "pad_token_id": 32000,
6
  "transformers_version": "4.38.1"
7
  }
 
1
  {
2
  "_from_model_config": true,
3
  "bos_token_id": 1,
4
+ "eos_token_id": [
5
+ 2,
6
+ 32000
7
+ ],
8
  "pad_token_id": 32000,
9
  "transformers_version": "4.38.1"
10
  }