Noam

nsegev's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in TheBloke/Falcon-180B-Chat-GPTQ over 1 year ago

Can run on SageMaker g5 instance?

5

#4 opened almost 2 years ago by

nsegev

New activity in TheBloke/Falcon-180B-Chat-GPTQ almost 2 years ago

3bit on single A100 good quality, poor speed

3

#3 opened almost 2 years ago by

Gian-hf

New activity in tiiuae/falcon-180B-chat almost 2 years ago

Error on num_kv_heads when using TGI

2

#5 opened almost 2 years ago by

nsegev