FlameF0X commited on
Commit
05b0865
·
verified ·
1 Parent(s): d802155

Upload 7 files

Browse files
Files changed (4) hide show
  1. README.md +1 -16
  2. config.json +0 -1
  3. model.safetensors +2 -2
  4. pytorch_model.bin +1 -1
README.md CHANGED
@@ -1,18 +1,3 @@
1
- ---
2
- datasets:
3
- - FlameF0X/DialogMLM-50K
4
- language:
5
- - en
6
- tags:
7
- - text-generation-inference
8
- library_name: transformers
9
- pipeline_tag: text-generation
10
- ---
11
-
12
- > I know that you dont see any differences in the README.md, but I've trained the model to val loss 1.6836 than the previous version.
13
- > I aslo try to fix all the previous errors when you tired to laod the model.
14
- > Please tell me if you find any bugs or anything useful!
15
-
16
  # Snowflake-G0-Release
17
 
18
  This is the initial release of the Snowflake series language models, trained on the DialogMLM-50K dataset with optimized memory usage.
@@ -45,4 +30,4 @@ model = AutoModel.from_pretrained("path/to/snowflake_g0_release")
45
  - Weight tying between embedding and output layers
46
  - Half-precision model storage
47
 
48
- The model weights are stored in both PyTorch (.bin) and safetensors format for improved security, loading efficiency, and compatibility.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Snowflake-G0-Release
2
 
3
  This is the initial release of the Snowflake series language models, trained on the DialogMLM-50K dataset with optimized memory usage.
 
30
  - Weight tying between embedding and output layers
31
  - Half-precision model storage
32
 
33
+ The model weights are stored in both PyTorch (.bin) and safetensors format for improved security, loading efficiency, and compatibility.
config.json CHANGED
@@ -2,7 +2,6 @@
2
  "architectures": [
3
  "SnowflakeCore"
4
  ],
5
- "model_type": "gpt2",
6
  "hidden_size": 384,
7
  "intermediate_size": 768,
8
  "max_position_embeddings": 384,
 
2
  "architectures": [
3
  "SnowflakeCore"
4
  ],
 
5
  "hidden_size": 384,
6
  "intermediate_size": 768,
7
  "max_position_embeddings": 384,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:71cc42d8dfe014ef49409730a63eb30e085822c768360f8263b9c0428372086d
3
- size 33274540
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3566ff5e952ec4dfab158f1534ba1b16ae9e765d7e8b3e69bc05b6ad8d5a7abf
3
+ size 33274556
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1bb569d5315b86cd6109c43c565f3400e3127765ffa7fe7c8ca9f53b757377a1
3
  size 66559270
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90a8941a9e5e6156cc133140a869315ddec182a11532c26f1f281ff42f3b2496
3
  size 66559270