Abdulhanan2006
commited on
Commit
•
0d7356b
1
Parent(s):
b007d9d
Update README.md
Browse files
README.md
CHANGED
@@ -20,27 +20,6 @@ LogicLumina-L3-13B-v2 is a merge of the following models using [LazyMergekit](ht
|
|
20 |
## Changed Model Weights and reapplied merging
|
21 |
|
22 |
|
23 |
-
## 🧩 Configuration
|
24 |
-
|
25 |
-
```yaml
|
26 |
-
slices:
|
27 |
-
- sources:
|
28 |
-
- model: PygmalionAI/pygmalion-2-13b
|
29 |
-
layer_range: [0, 40]
|
30 |
-
- model: Abdulhanan2006/LogicLumina-L3-13B
|
31 |
-
layer_range: [0, 40]
|
32 |
-
merge_method: slerp
|
33 |
-
base_model: PygmalionAI/pygmalion-2-13b
|
34 |
-
parameters:
|
35 |
-
t:
|
36 |
-
- filter: self_attn
|
37 |
-
value: [0, 0.5, 0.3, 0.7, 1]
|
38 |
-
- filter: mlp
|
39 |
-
value: [1, 0.5, 0.7, 0.3, 0]
|
40 |
-
- value: 0.4
|
41 |
-
dtype: bfloat16
|
42 |
-
```
|
43 |
-
|
44 |
## 💻 Usage
|
45 |
|
46 |
```python
|
|
|
20 |
## Changed Model Weights and reapplied merging
|
21 |
|
22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
## 💻 Usage
|
24 |
|
25 |
```python
|