Kaiz Zhao

ishotoli's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in TheBloke/Yi-34B-200K-Llamafied-GPTQ over 1 year ago

When loading 8-bits 128g onto A40 (48GB VRAM), an error occurs: CUDA out of memory.

3

#2 opened over 1 year ago by

ishotoli

New activity in CalderaAI/30B-Lazarus-GPTQ4bit about 2 years ago

Can you please provide the quantize_config.json file?

5

#1 opened about 2 years ago by

ishotoli