Upload README.md

README.md

@@ -1,3 +1,58 @@
----
-license: llama3.3
----
+---
+base_model_relation: quantized
+library_name: transformers
+tags:
+- mergekit
+- merge
+base_model:
+- TareksLab/Deviant-EXPERIMENTAL-V3-70B
+---
+# Deviant
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [Linear DELLA](https://arxiv.org/abs/2406.11617) merge method using [huihui-ai/Llama-3.3-70B-Instruct-abliterated](https://huggingface.co/huihui-ai/Llama-3.3-70B-Instruct-abliterated) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [ReadyArt/Forgotten-Safeword-70B-3.6](https://huggingface.co/ReadyArt/Forgotten-Safeword-70B-3.6)
+* [allura-org/Bigger-Body-70b](https://huggingface.co/allura-org/Bigger-Body-70b)
+* [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B)
+* [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
+    parameters:
+      weight: 0.25
+      density: 0.7
+  - model: ReadyArt/Forgotten-Safeword-70B-3.6
+    parameters:
+      weight: 0.25
+      density: 0.7
+  - model: allura-org/Bigger-Body-70b
+    parameters:
+      weight: 0.25
+      density: 0.7
+  - model: SicariusSicariiStuff/Negative_LLAMA_70B
+    parameters:
+      weight: 0.25
+      density: 0.7
+merge_method: della_linear
+base_model: huihui-ai/Llama-3.3-70B-Instruct-abliterated
+parameters:
+  epsilon: 0.2
+  lambda: 1.1
+  int8_mask: true
+dtype: bfloat16
+tokenizer:
+ source: base
+```