New discussion

Plz fix it!!!

#33 opened 4 months ago by DonDonDon

Sequence length / batch size

#25 opened 8 months ago by BramVanroy

Data Wrong, THUDM/chatglm3-6b

1
#20 opened 10 months ago by YEKANGMING

GPTQ group size effects vRAM usage

2
#18 opened about 1 year ago by sgjohnson

Add memory calculation for ZeRO stages

1
#14 opened about 1 year ago by deleted

Analyzing tool for inference

#13 opened about 1 year ago by cllatMTK

Model dropdown

#12 opened about 1 year ago by muellerzr

Memory scaling on input length

1
#7 opened about 1 year ago by marksverdhei

Support `AutoProcessor` models

#6 opened about 1 year ago by muellerzr

Dropdown menu of models

3
#2 opened about 1 year ago by Ouz-G