chatglm-6b-int4 / demo_call_api.py
NewBreaker's picture
add questions all
45cb7a0
raw
history blame
221 Bytes
from transformers import AutoTokenizer, AutoModelForQuestionAnswering
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm-6b-int4")
model = AutoModelForQuestionAnswering.from_pretrained("THUDM/chatglm-6b-int4")