Rico
commited on
Commit
·
e0dc63b
1
Parent(s):
b736f3d
[UPDATE] update readme
Browse files
README.md
CHANGED
|
@@ -335,7 +335,7 @@ Note: Parts of the evaluation results are reproduced using the same settings.
|
|
| 335 |
|
| 336 |
### Inference with Hugging Face Transformers
|
| 337 |
|
| 338 |
-
We introduce how to use our model at inference stage using transformers library. It is recommended to use python=3.10, torch>=2.1.0, and transformers=4.54.0 as the development environment.We currently only support bf16 inference, and multi-patch is supported by default. This behavior is aligned with vllm and sglang.
|
| 339 |
|
| 340 |
|
| 341 |
```python
|
|
|
|
| 335 |
|
| 336 |
### Inference with Hugging Face Transformers
|
| 337 |
|
| 338 |
+
We introduce how to use our model at inference stage using transformers library. It is recommended to use python=3.10, torch>=2.1.0, and transformers=4.54.0 as the development environment.We currently only support bf16 inference, and multi-patch for image preprocessing is supported by default. This behavior is aligned with vllm and sglang.
|
| 339 |
|
| 340 |
|
| 341 |
```python
|