Hugging Face's logo

featherless-ai-quants
/
unsloth-Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community
m8than commited on
Commit
0d4e178
·
verified ·
1 Parent(s): b21b140

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +104 -0
  2. README.md +47 -0
  3. featherless-quants.png +3 -0
  4. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00001-of-00008.gguf +3 -0
  5. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00002-of-00008.gguf +3 -0
  6. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00003-of-00008.gguf +3 -0
  7. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00004-of-00008.gguf +3 -0
  8. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00005-of-00008.gguf +3 -0
  9. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00006-of-00008.gguf +3 -0
  10. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00007-of-00008.gguf +3 -0
  11. unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00008-of-00008.gguf +3 -0
  12. unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00001-of-00006.gguf +3 -0
  13. unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00002-of-00006.gguf +3 -0
  14. unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00003-of-00006.gguf +3 -0
  15. unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00004-of-00006.gguf +3 -0
  16. unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00005-of-00006.gguf +3 -0
  17. unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00006-of-00006.gguf +3 -0
  18. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00001-of-00008.gguf +3 -0
  19. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00002-of-00008.gguf +3 -0
  20. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00003-of-00008.gguf +3 -0
  21. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00004-of-00008.gguf +3 -0
  22. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00005-of-00008.gguf +3 -0
  23. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00006-of-00008.gguf +3 -0
  24. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00007-of-00008.gguf +3 -0
  25. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00008-of-00008.gguf +3 -0
  26. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00001-of-00007.gguf +3 -0
  27. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00002-of-00007.gguf +3 -0
  28. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00003-of-00007.gguf +3 -0
  29. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00004-of-00007.gguf +3 -0
  30. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00005-of-00007.gguf +3 -0
  31. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00006-of-00007.gguf +3 -0
  32. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00007-of-00007.gguf +3 -0
  33. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00001-of-00007.gguf +3 -0
  34. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00002-of-00007.gguf +3 -0
  35. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00003-of-00007.gguf +3 -0
  36. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00004-of-00007.gguf +3 -0
  37. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00005-of-00007.gguf +3 -0
  38. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00006-of-00007.gguf +3 -0
  39. unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00007-of-00007.gguf +3 -0
  40. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00001-of-00009.gguf +3 -0
  41. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00002-of-00009.gguf +3 -0
  42. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00003-of-00009.gguf +3 -0
  43. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00004-of-00009.gguf +3 -0
  44. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00005-of-00009.gguf +3 -0
  45. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00006-of-00009.gguf +3 -0
  46. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00007-of-00009.gguf +3 -0
  47. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00008-of-00009.gguf +3 -0
  48. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00009-of-00009.gguf +3 -0
  49. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00001-of-00009.gguf +3 -0
  50. unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00002-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,107 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
37
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
38
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
39
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
40
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
41
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
42
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
43
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
44
+ unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
45
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
46
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
47
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
48
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
49
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
50
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
52
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
53
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
54
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
55
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
56
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
57
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
58
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
59
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
60
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
61
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
62
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
63
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
64
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
65
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
66
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
67
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
68
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
69
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
70
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
71
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
72
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
73
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
74
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
75
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
76
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
79
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
81
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
82
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
83
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
84
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
85
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
86
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
87
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
88
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
89
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
90
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
91
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00001-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
92
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00002-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
93
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00003-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
94
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00004-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
95
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00005-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
96
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00006-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
97
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00007-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
98
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00008-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
99
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00009-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
100
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00010-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
101
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M-00011-of-00011.gguf filter=lfs diff=lfs merge=lfs -text
102
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
103
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
104
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
105
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
106
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
107
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
108
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
109
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
110
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
111
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
112
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
113
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
114
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00003-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
115
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00004-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
116
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00005-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
117
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00006-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
118
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00007-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
119
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00008-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
120
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00009-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
121
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00010-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
122
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00011-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
123
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K-00012-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
124
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00001-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
125
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
126
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00003-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
127
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00004-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
128
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00005-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
129
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00006-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
130
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00007-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
131
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00008-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
132
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00009-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
133
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00010-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
134
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00011-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
135
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00012-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
136
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00013-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
137
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00014-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
138
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00015-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
139
+ unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0-00016-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/Meta-Llama-3.1-70B-Instruct
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # unsloth/Meta-Llama-3.1-70B-Instruct GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | IQ4_XS | [unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS) | 36496.80 MB (folder) |
21
+ | Q2_K | [unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K) | 25153.27 MB (folder) |
22
+ | Q3_K_L | [unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L) | 35420.03 MB (folder) |
23
+ | Q3_K_M | [unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M) | 32680.03 MB (folder) |
24
+ | Q3_K_S | [unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S) | 29480.03 MB (folder) |
25
+ | Q4_K_M | [unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M) | 40550.61 MB (folder) |
26
+ | Q4_K_S | [unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S) | 38478.11 MB (folder) |
27
+ | Q5_K_M | [unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_M) | 47635.86 MB (folder) |
28
+ | Q5_K_S | [unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q5_K_S) | 46403.36 MB (folder) |
29
+ | Q6_K | [unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q6_K) | 55206.44 MB (folder) |
30
+ | Q8_0 | [unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0](https://huggingface.co/featherless-ai-quants/unsloth-Meta-Llama-3.1-70B-Instruct-GGUF/tree/main/unsloth-Meta-Llama-3.1-70B-Instruct-Q8_0) | 71501.79 MB (folder) |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
featherless-quants.png ADDED

Git LFS Details

  • SHA256: 2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.61 MB
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9355904411419de915148fbcb812ffe02886a6871a4af63457c132c80d6c66a8
3
+ size 4999738752
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c85a661a18a826a8a76036e0a0147733ba5c125c42693c106379ffc6d79a31a3
3
+ size 4974876320
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86e07fca7653dc85e7bbfddc3468f198d41289446eb43fc7fe7a0fe6d4bf3f12
3
+ size 4886009568
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e42bfbc1c2e4aa14399adcd5fe115970413bf3ef4ef7a572ea30c40046bea38f
3
+ size 4890498912
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45a54c312f1c263352fa57981246832b387bfda05cbb592d9c66ce68205b2674
3
+ size 4890498912
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99f51c872dd93915ccf001af959e440d4a4e87c7f7f08631130c0da87965395a
3
+ size 4973827808
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb0778d492ee5e8a074bb5dd41f970ec5ec8c09da4f27ea261a2b8dde7380305
3
+ size 4979627872
unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS/unsloth-Meta-Llama-3.1-70B-Instruct-IQ4_XS-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8326df46ab1032f0dd56d96d2be364de0a6b739de5ab3616a58e0deb1f9547ab
3
+ size 3674590784
unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4253c9903e42e0bf5431c9cb85840b626ee03a57cb1474ec7f1b22fc2b66dc7
3
+ size 4933714048
unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d73cb0d3a7713dd5a3b928c8635a07f68bafc9ffa44a0426503332d55f9ac381
3
+ size 4955054560
unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60d12761da5962156da857e2edf83e5451046618dab55ee70db7c5c997611188
3
+ size 4990575328
unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4ceb5ff5f4e33daa2036df6ed169d15fd20ecf57a43348f6797bf874c45363c
3
+ size 4972749088
unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f8dbc884ade57c0c58446676073dd89bd3253f960a1191281ca039dd1d59d7c
3
+ size 4926152992
unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K/unsloth-Meta-Llama-3.1-70B-Instruct-Q2_K-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f97cbd2bf832bdee11abb497bf50498392798040c4f5cdf7b6cffca5c883b0fa
3
+ size 1596868032
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00001-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aca90c676c755c57d0b667dfa233cbf08aac3e4eb94eb67e3ef64715bf74d28f
3
+ size 4936742816
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00002-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8734bfdbbcfcc52a554c423ad9a6ff72e541197b96a1169a5d1923a827b834d2
3
+ size 4963375168
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00003-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:438b1b01f6eff15f9f14368becd6eb65eefd7e96a15c21acdba0d840540722c2
3
+ size 4971304928
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00004-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb3ca1d7e8f3447b354bd48200a0837b8d9bb1441480efbe617af46b9b916435
3
+ size 4991457056
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00005-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e6b136dd14deb09825e2528832a1f73782b57a6045b982e5e36b20b693754a6
3
+ size 4979955616
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00006-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2613bf7b3051eabf9227a8089627a33cd02e841855baa7f55c270f41d8757ed1
3
+ size 4982151072
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00007-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4576a25e257a2d3eca708b09a9ed35748c44cf83b8a619b95466f79f5a11e80
3
+ size 4925167520
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_L-00008-of-00008.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11f9192990a22ba582cb7d74220959c682478abe3848323bc2aaad971f939581
3
+ size 2390444192
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c1cdb66f8f05ba22f1f029482206c56633092fd2948333b6660dd0491c9ed1b
3
+ size 4939102240
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ac425a194d7c312d7b116d36ed80c431ac797eadbd3f26a8301d28a20443139
3
+ size 4919925184
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f6d8a34d310ec90c524c80309962060a8de07591546f4c1f18a410aeb8220b8
3
+ size 4919925184
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89022aa5905716fe23f7307ef986d50024eb9193ea70ce35e871e6439c1cc585
3
+ size 4995881632
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d33671d5a6f1e7eb5ba74c0b3d82edb653066e6e7007742084e6615bbd47040
3
+ size 4986280352
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45ef89d8a7ac0dfb91f550887a981521696dadecb7ca2c569de014aadd88c235
3
+ size 4954528288
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_M-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7202bf558baaa30ad82755bc148b1fb127ed1e20d95717102a4b405d73fce15
3
+ size 4551857088
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00001-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0e76221a31030b2fd3d0077ceab1f0788a535eef879d25230cba05402e53089
3
+ size 4998839264
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00002-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4df161607b5009a9f4b8eeade84730627853554c00ea89c7fc4d78ce926816bc
3
+ size 4909472832
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00003-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ebef4543eb77caddb8dfe5861ffb6af2d57e5f16a154e1e00b56ea2cd6b3a18
3
+ size 4976549216
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00004-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89b0c901fc94698741ac3eaab3ed1685508c937750d1f53c03f9692ccfe2ef40
3
+ size 4909440000
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00005-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c004d370c216770c0ebdd2cd0c67ebeb0f52294cf04e44655438402a79175b60
3
+ size 4909440000
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00006-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:096d0370e50f558f3415b03f9dec2c9852e075ccf2e00df44c43bf428bd3ee13
3
+ size 4976549216
unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q3_K_S-00007-of-00007.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67a171f402ef05b5e809ca1161787c1f3cb6528b74d99f118e35a33f70dcf479
3
+ size 1231766208
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3963c3cd5488fddc20cf2e9c9fef7ddc5faa323064f370b080235749990ba1ec
3
+ size 4951503744
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b154a670e8bfe5d0634423cbfa7c80e048caa282fbc8ab5b1da48e72b798144f
3
+ size 4989490304
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee91040b75e04a31e72d2908bdcb9e5c08edc2005f6d4cd677beec4babc590fa
3
+ size 4932801728
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83a1fa4e847003a66d2f881336324e5bf4ca44de69736b421b9ebd102922dcc8
3
+ size 4878112064
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c049e2f7316d1dbb0734ba859ba4beac4eaa72f07f0527a06781baffd0b4b2b
3
+ size 4876997952
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89c91a666adaf2d13b73b8e2ff5da1655e59f0ad4a8aead7a70b737988ac5b75
3
+ size 4965569728
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:def013f603ffebe6e7b839128102fbc60101bad8c760ed695625fe0fcd40dacd
3
+ size 4895052928
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4f33b56f9eacbf8612c49c447a20bc44e48217c5b349da00fc72b5a4dbe570f
3
+ size 4992668928
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8615e50732b8c8d3664412eee475ff4db4cd77f7a47a678c584fb86458d422e
3
+ size 3038202144
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69d346361f3ff2c4d4cd36947135b9c80ef8c33f9460c023076ddcd4aea699bb
3
+ size 4986631168
unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S/unsloth-Meta-Llama-3.1-70B-Instruct-Q4_K_S-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fca3df10d820cf731eb04cec79e6e03967e04176a59c7294149464a6063f7b0e
3
+ size 4939454048