Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

bartowski
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
imatrix
conversational
Model card Files Files and versions
xet
Community
8
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Missing Tensors in Q5_K_S + Q5_K_M

12
#8 opened 11 months ago by
Digital-At-Work-Christopher

Abliterated quant?

4
#7 opened 11 months ago by
AIGUYCONTENT

tensor 'output_norm.weight' not found

1
#5 opened 11 months ago by
LD-inform

<23GB quant for 24GB GPUs? IQ2_XS or IQ2_XXS?

3
#4 opened 11 months ago by
kerrmetric

Q5KL has wrong number of tensors

7
#3 opened 11 months ago by
JWDzGulh
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs