prithivMLmods commited on
Commit
25d08ba
·
verified ·
1 Parent(s): 2a92805

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -22,6 +22,8 @@ Blazer.1-2B-Vision `4-bit precision` is based on the Qwen2-VL model, fine-tuned
22
 
23
  # **Use it With Transformer**
24
 
 
 
25
  ```python
26
  from transformers import Qwen2VLForConditionalGeneration, AutoTokenizer, AutoProcessor
27
  from qwen_vl_utils import process_vision_info
 
22
 
23
  # **Use it With Transformer**
24
 
25
+ The bitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions.
26
+
27
  ```python
28
  from transformers import Qwen2VLForConditionalGeneration, AutoTokenizer, AutoProcessor
29
  from qwen_vl_utils import process_vision_info