bapatra philschmid HF staff commited on
Commit
5e0fbf0
1 Parent(s): 2fe15b2

Add attention_bias to make TGI work (#4)

Browse files

- Add attention_bias to make TGI work (9c9f6d150c9c19b659f2f452e92c64687ce8c249)
- Update config.json (b62ee4629858d8d25483d626ee5753baf6e05547)


Co-authored-by: Philipp Schmid <[email protected]>

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -182,5 +182,6 @@
182
  "torch_dtype": "bfloat16",
183
  "transformers_version": "4.38.1",
184
  "use_cache": true,
 
185
  "vocab_size": 100352
186
  }
 
182
  "torch_dtype": "bfloat16",
183
  "transformers_version": "4.38.1",
184
  "use_cache": true,
185
+ "attention_bias": false,
186
  "vocab_size": 100352
187
  }