Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
---
|
2 |
base_model:
|
3 |
-
- kweinmeister/distilbert-base-
|
4 |
- kweinmeister/distilbert-anli
|
5 |
library_name: transformers
|
6 |
tags:
|
@@ -21,7 +21,7 @@ This model was merged using the SLERP merge method.
|
|
21 |
### Models Merged
|
22 |
|
23 |
The following models were included in the merge:
|
24 |
-
* [kweinmeister/distilbert-
|
25 |
* [kweinmeister/distilbert-anli](https://huggingface.co/kweinmeister/distilbert-anli)
|
26 |
|
27 |
### Configuration
|
@@ -32,12 +32,12 @@ The following YAML configuration was used to produce this model:
|
|
32 |
|
33 |
slices:
|
34 |
- sources:
|
35 |
-
- model: kweinmeister/distilbert-
|
36 |
layer_range: [0, 6]
|
37 |
- model: kweinmeister/distilbert-anli
|
38 |
layer_range: [0, 6]
|
39 |
merge_method: slerp
|
40 |
-
base_model: kweinmeister/distilbert-
|
41 |
parameters:
|
42 |
t: 0.1
|
43 |
dtype: bfloat16
|
|
|
1 |
---
|
2 |
base_model:
|
3 |
+
- kweinmeister/distilbert-base-mnli
|
4 |
- kweinmeister/distilbert-anli
|
5 |
library_name: transformers
|
6 |
tags:
|
|
|
21 |
### Models Merged
|
22 |
|
23 |
The following models were included in the merge:
|
24 |
+
* [kweinmeister/distilbert-mnli](https://huggingface.co/kweinmeister/distilbert-mnli)
|
25 |
* [kweinmeister/distilbert-anli](https://huggingface.co/kweinmeister/distilbert-anli)
|
26 |
|
27 |
### Configuration
|
|
|
32 |
|
33 |
slices:
|
34 |
- sources:
|
35 |
+
- model: kweinmeister/distilbert-mnli
|
36 |
layer_range: [0, 6]
|
37 |
- model: kweinmeister/distilbert-anli
|
38 |
layer_range: [0, 6]
|
39 |
merge_method: slerp
|
40 |
+
base_model: kweinmeister/distilbert-mnli
|
41 |
parameters:
|
42 |
t: 0.1
|
43 |
dtype: bfloat16
|