GGUF
Not-For-All-Audiences
InferenceIllusionist commited on
Commit
4923e02
·
verified ·
1 Parent(s): 9fe3b45

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -0
README.md CHANGED
@@ -1,3 +1,75 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ base_model: envoid/Verdict-8x7B
4
+ inference: false
5
+ model_creator: Envoid
6
+ model_type: mixtral
7
+ tags:
8
+ - gguf
9
+ - not-for-all-audiences
10
  ---
11
+
12
+ # Model Card for Verdict-8x7B-GGUF
13
+ - Model creator: [Envoid](https://huggingface.co/envoid)
14
+ - Original model: [Verdict-8x7B](https://huggingface.co/Envoid/Verdict-8x7B)
15
+
16
+ # Verdict-8x7B-GGUF
17
+
18
+ Quantized from fp16 with love.
19
+
20
+ Uploading Q8_0 & Q5_K_M for starters, other sizes available upon request.
21
+
22
+
23
+ See original model card details below.
24
+
25
+
26
+ ---
27
+ # Warning this model may output mature or disturbing content
28
+ ![](https://files.catbox.moe/q2rrja.jpg)
29
+ ## Verdict-8x7B
30
+
31
+ This model has been through so many merge steps that I failed to keep track of due to constantly needing to shift drive space around that I will simply give accredition to all of its component models.
32
+
33
+ retrieval-bar/Mixtral-8x7B-v0.1_case-briefs (no longer available)
34
+
35
+ ## New version available at:
36
+
37
+ [retrieval-bar/Mixtral-8x7B-v0.1_case-briefs](https://huggingface.co/retrieval-bar/Mixtral-8x7B-v0.1_case-briefs)
38
+
39
+ [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
40
+
41
+ [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)
42
+
43
+ [Envoid/Augmentasanguis-8x7B](https://huggingface.co/Envoid/Augmentasanguis-8x7B)
44
+
45
+ [Envoid/CATA-8x7B](https://huggingface.co/Envoid/CATA-8x7B)
46
+
47
+ [crestf411/daybreak-mixtral-8x7b-hf](https://huggingface.co/crestf411/daybreak-mixtral-8x7b-hf)
48
+
49
+ [IBI-CAAI/MELT-Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/IBI-CAAI/MELT-Mixtral-8x7B-Instruct-v0.1)
50
+
51
+ unreleased experimental model that gets mentioned quite frequently
52
+
53
+ ### Many of the models were included multiple times in multiple intermediate steps
54
+
55
+ using a combination of slerp, linear, dare_ties and task_arithmetic
56
+
57
+ ## Model was tested in q8 gguf form (not included due to being from an old pull of llama.cpp that I'm too lazy to update)
58
+
59
+ # Warning: This models alignment is heavily diminished.
60
+
61
+ It responds to mixtral instruct formatting
62
+
63
+ # Example:
64
+ ```
65
+ [INST]Write me a haiku about violence.[/INST]
66
+ Fist clenched in anger,
67
+ Echoes of pain in the air,
68
+ Silence after storm.
69
+ ```
70
+
71
+ It can be a bit unruly in roleplay- sometimes to its advantage, sometimes to its detriment.
72
+
73
+ It's a perfectly usable instruct model and good for creative writing via instruct- its diminished alignment allowing it to respond to requests for more nuanced scences.
74
+
75
+ All-in-all I'm happy enough with the results that I plan to use it as a daily driver for a while to see what cracks show from long term use.