Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
Falcon-180B-Chat-GPTQ

Text Generation
Transformers
Safetensors
falcon
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions Community
9
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

ModuleNotFoundError: No module named 'optimum'

#9 opened over 1 year ago by
netranga

Model card parameters

1
#8 opened over 1 year ago by
amartino

Model outputs 1 word or letter ("I", "Hey")

#7 opened over 1 year ago by
fanwave-rr

very slow inference speed on 2x A100 80GB with 4-bit (main branch)

#6 opened over 1 year ago by
willowill5

AttributeError: 'FalconForCausalLM' object has no attribute 'device_to_buffers

#5 opened over 1 year ago by
yuchenlin

Can run on SageMaker g5 instance?

5
#4 opened over 1 year ago by
nsegev

3bit on single A100 good quality, poor speed

3
#3 opened over 1 year ago by
Gian-hf

Brilliant!

15
#1 opened over 1 year ago by
shafiqalibhai
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs