tangshiping DreamGenX commited on
Commit
5c68357
0 Parent(s):

Duplicate from dreamgen/WizardLM-2-8x22B

Browse files

Co-authored-by: DreamGen <[email protected]>

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +35 -0
  2. README.md +106 -0
  3. config.json +31 -0
  4. generation_config.json +6 -0
  5. huggingface-metadata.txt +64 -0
  6. model-00001-of-00059.safetensors +3 -0
  7. model-00002-of-00059.safetensors +3 -0
  8. model-00003-of-00059.safetensors +3 -0
  9. model-00004-of-00059.safetensors +3 -0
  10. model-00005-of-00059.safetensors +3 -0
  11. model-00006-of-00059.safetensors +3 -0
  12. model-00007-of-00059.safetensors +3 -0
  13. model-00008-of-00059.safetensors +3 -0
  14. model-00009-of-00059.safetensors +3 -0
  15. model-00010-of-00059.safetensors +3 -0
  16. model-00011-of-00059.safetensors +3 -0
  17. model-00012-of-00059.safetensors +3 -0
  18. model-00013-of-00059.safetensors +3 -0
  19. model-00014-of-00059.safetensors +3 -0
  20. model-00015-of-00059.safetensors +3 -0
  21. model-00016-of-00059.safetensors +3 -0
  22. model-00017-of-00059.safetensors +3 -0
  23. model-00018-of-00059.safetensors +3 -0
  24. model-00019-of-00059.safetensors +3 -0
  25. model-00020-of-00059.safetensors +3 -0
  26. model-00021-of-00059.safetensors +3 -0
  27. model-00022-of-00059.safetensors +3 -0
  28. model-00023-of-00059.safetensors +3 -0
  29. model-00024-of-00059.safetensors +3 -0
  30. model-00025-of-00059.safetensors +3 -0
  31. model-00026-of-00059.safetensors +3 -0
  32. model-00027-of-00059.safetensors +3 -0
  33. model-00028-of-00059.safetensors +3 -0
  34. model-00029-of-00059.safetensors +3 -0
  35. model-00030-of-00059.safetensors +3 -0
  36. model-00031-of-00059.safetensors +3 -0
  37. model-00032-of-00059.safetensors +3 -0
  38. model-00033-of-00059.safetensors +3 -0
  39. model-00034-of-00059.safetensors +3 -0
  40. model-00035-of-00059.safetensors +3 -0
  41. model-00036-of-00059.safetensors +3 -0
  42. model-00037-of-00059.safetensors +3 -0
  43. model-00038-of-00059.safetensors +3 -0
  44. model-00039-of-00059.safetensors +3 -0
  45. model-00040-of-00059.safetensors +3 -0
  46. model-00041-of-00059.safetensors +3 -0
  47. model-00042-of-00059.safetensors +3 -0
  48. model-00043-of-00059.safetensors +3 -0
  49. model-00044-of-00059.safetensors +3 -0
  50. model-00045-of-00059.safetensors +3 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,106 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+
6
+
7
+ <p style="font-size:20px;" align="center">
8
+ 🏠 <a href="https://wizardlm.github.io/WizardLM2" target="_blank">WizardLM-2 Release Blog</a> </p>
9
+ <p align="center">
10
+ 🤗 <a href="https://huggingface.co/collections/microsoft/wizardlm-2-661d403f71e6c8257dbd598a" target="_blank">HF Repo</a> •🐱 <a href="https://github.com/victorsungo/WizardLM/tree/main/WizardLM-2" target="_blank">Github Repo</a> • 🐦 <a href="https://twitter.com/WizardLM_AI" target="_blank">Twitter</a> • 📃 <a href="https://arxiv.org/abs/2304.12244" target="_blank">[WizardLM]</a> • 📃 <a href="https://arxiv.org/abs/2306.08568" target="_blank">[WizardCoder]</a> • 📃 <a href="https://arxiv.org/abs/2308.09583" target="_blank">[WizardMath]</a> <br>
11
+ </p>
12
+ <p align="center">
13
+ 👋 Join our <a href="https://discord.gg/VZjjHtWrKs" target="_blank">Discord</a>
14
+ </p>
15
+
16
+
17
+ ## News 🔥🔥🔥 [2024/04/15]
18
+
19
+ We introduce and opensource WizardLM-2, our next generation state-of-the-art large language models,
20
+ which have improved performance on complex chat, multilingual, reasoning and agent.
21
+ New family includes three cutting-edge models: WizardLM-2 8x22B, WizardLM-2 70B, and WizardLM-2 7B.
22
+
23
+ - WizardLM-2 8x22B is our most advanced model, demonstrates highly competitive performance compared to those leading proprietary works
24
+ and consistently outperforms all the existing state-of-the-art opensource models.
25
+ - WizardLM-2 70B reaches top-tier reasoning capabilities and is the first choice in the same size.
26
+ - WizardLM-2 7B is the fastest and achieves comparable performance with existing 10x larger opensource leading models.
27
+
28
+ For more details of WizardLM-2 please read our [release blog post](https://wizardlm.github.io/WizardLM2) and upcoming paper.
29
+
30
+
31
+ ## Model Details
32
+
33
+ * **Model name**: WizardLM-2 8x22B
34
+ * **Developed by**: WizardLM@Microsoft AI
35
+ * **Model type**: Mixture of Experts (MoE)
36
+ * **Base model**: [mistral-community/Mixtral-8x22B-v0.1](https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1)
37
+ * **Parameters**: 141B
38
+ * **Language(s)**: Multilingual
39
+ * **Blog**: [Introducing WizardLM-2](https://wizardlm.github.io/WizardLM2)
40
+ * **Repository**: [https://github.com/nlpxucan/WizardLM](https://github.com/nlpxucan/WizardLM)
41
+ * **Paper**: WizardLM-2 (Upcoming)
42
+ * **License**: Apache2.0
43
+
44
+
45
+ ## Model Capacities
46
+
47
+
48
+ **MT-Bench**
49
+
50
+ We also adopt the automatic MT-Bench evaluation framework based on GPT-4 proposed by lmsys to assess the performance of models.
51
+ The WizardLM-2 8x22B even demonstrates highly competitive performance compared to the most advanced proprietary models.
52
+ Meanwhile, WizardLM-2 7B and WizardLM-2 70B are all the top-performing models among the other leading baselines at 7B to 70B model scales.
53
+
54
+ <p align="center" width="100%">
55
+ <a ><img src="https://raw.githubusercontent.com/WizardLM/WizardLM2/main/static/images/mtbench.png" alt="MTBench" style="width: 96%; min-width: 300px; display: block; margin: auto;"></a>
56
+ </p>
57
+
58
+
59
+ **Human Preferences Evaluation**
60
+
61
+ We carefully collected a complex and challenging set consisting of real-world instructions, which includes main requirements of humanity, such as writing, coding, math, reasoning, agent, and multilingual.
62
+ We report the win:loss rate without tie:
63
+
64
+ - WizardLM-2 8x22B is just slightly falling behind GPT-4-1106-preview, and significantly stronger than Command R Plus and GPT4-0314.
65
+ - WizardLM-2 70B is better than GPT4-0613, Mistral-Large, and Qwen1.5-72B-Chat.
66
+ - WizardLM-2 7B is comparable with Qwen1.5-32B-Chat, and surpasses Qwen1.5-14B-Chat and Starling-LM-7B-beta.
67
+
68
+ <p align="center" width="100%">
69
+ <a ><img src="https://raw.githubusercontent.com/WizardLM/WizardLM2/main/static/images/winall.png" alt="Win" style="width: 96%; min-width: 300px; display: block; margin: auto;"></a>
70
+ </p>
71
+
72
+
73
+
74
+
75
+
76
+ ## Method Overview
77
+ We built a **fully AI powered synthetic training system** to train WizardLM-2 models, please refer to our [blog](https://wizardlm.github.io/WizardLM2) for more details of this system.
78
+
79
+ <p align="center" width="100%">
80
+ <a ><img src="https://raw.githubusercontent.com/WizardLM/WizardLM2/main/static/images/exp_1.png" alt="Method" style="width: 96%; min-width: 300px; display: block; margin: auto;"></a>
81
+ </p>
82
+
83
+
84
+
85
+
86
+
87
+ ## Usage
88
+
89
+ ❗<b>Note for model system prompts usage:</b>
90
+
91
+
92
+ <b>WizardLM-2</b> adopts the prompt format from <b>Vicuna</b> and supports **multi-turn** conversation. The prompt should be as following:
93
+
94
+ ```
95
+ A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful,
96
+ detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s>
97
+ USER: Who are you? ASSISTANT: I am WizardLM.</s>......
98
+ ```
99
+
100
+ <b> Inference WizardLM-2 Demo Script</b>
101
+
102
+ We provide a WizardLM-2 inference demo [code](https://github.com/nlpxucan/WizardLM/tree/main/demo) on our github.
103
+
104
+
105
+
106
+
config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "",
3
+ "architectures": [
4
+ "MixtralForCausalLM"
5
+ ],
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 1,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "silu",
10
+ "hidden_size": 6144,
11
+ "initializer_range": 0.02,
12
+ "intermediate_size": 16384,
13
+ "max_position_embeddings": 65536,
14
+ "model_type": "mixtral",
15
+ "num_attention_heads": 48,
16
+ "num_experts_per_tok": 2,
17
+ "num_hidden_layers": 56,
18
+ "num_key_value_heads": 8,
19
+ "num_local_experts": 8,
20
+ "output_router_logits": false,
21
+ "rms_norm_eps": 1e-05,
22
+ "rope_theta": 1000000,
23
+ "router_aux_loss_coef": 0.001,
24
+ "router_jitter_noise": 0.0,
25
+ "sliding_window": null,
26
+ "tie_word_embeddings": false,
27
+ "torch_dtype": "bfloat16",
28
+ "transformers_version": "4.36.2",
29
+ "use_cache": false,
30
+ "vocab_size": 32000
31
+ }
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "eos_token_id": 2,
5
+ "transformers_version": "4.36.2"
6
+ }
huggingface-metadata.txt ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ url: https://huggingface.co/microsoft/WizardLM-2-8x22B
2
+ branch: main
3
+ download date: 2024-04-15 16:48:15
4
+ sha256sum:
5
+ 9e5cc2f91f7830364eff657b53df4f855091996cb2db7de2b69b8f11fa06be0a model-00001-of-00059.safetensors
6
+ 24dbc249686530b5bcf630c6edae25fff212900d340946fb868ebd3dd8c62851 model-00002-of-00059.safetensors
7
+ d8ebc25463564c00d8e5d3f8a08ca5ce60c0efd53dd23aecfa7a2e3b0112b941 model-00003-of-00059.safetensors
8
+ 81abed9dadae5877c49a57990fe5d8a449ed507987517728b1da7c195eacdd54 model-00004-of-00059.safetensors
9
+ 45a5914445b0d8a95e02881d342a37b7d7c69943980b373b78331cf5c406191f model-00005-of-00059.safetensors
10
+ ea96b16084f0b6fddf232343e2ea55734ec324aeaa2eb60759fca724b80e292d model-00006-of-00059.safetensors
11
+ a78d60bb853a77110a815f6a20c5819cef21bcc0b4d50e700b560be54d6f53b5 model-00007-of-00059.safetensors
12
+ ba757c9109937a28e912c10bdb18042d347c55e768ec2dc89859c0e25823fa35 model-00008-of-00059.safetensors
13
+ ab90762b6b58313c37b2d1e09a8f9ae956bc4b5d0cc52c379b0937ce752dca98 model-00009-of-00059.safetensors
14
+ 0b167436f7049226dbe7153e1ec602bf06d4cc384e5c16289e7207408c66068a model-00010-of-00059.safetensors
15
+ c4cc3a3f71b37f107b20f96d04067abbaee78f16e74196cdc68469d551bbe38c model-00011-of-00059.safetensors
16
+ b045740b8c2377430a5f42e06d9eec2606b8db45c3e5ac87a316fbc715569cc0 model-00012-of-00059.safetensors
17
+ 175977b687acd05686a22c0f2b89f0ab0afb79c03db3480fa7fd989aec786287 model-00013-of-00059.safetensors
18
+ 2703b8b32154f524baf105cb15f54ffbf134d13ccd923a30315e698fb85e54ff model-00014-of-00059.safetensors
19
+ bbe6004093d3a5e29f26c5e3f75e4e0b8a40c16498102dac31b0180746880671 model-00015-of-00059.safetensors
20
+ 54c8f475521181cb4b93031b17c2a5c08ad0de1a81b035c2864c2bce19234c21 model-00016-of-00059.safetensors
21
+ 0b4e356a83fc7e42a056d790213fee7624abc0d12b8ca113dbe734a139a99491 model-00017-of-00059.safetensors
22
+ 188a8a3611852f704dae7804b47cfabb5a2ccf6c7f19226ae4e3fce6a3aa0506 model-00018-of-00059.safetensors
23
+ 36d1e452bb1e962a83fdd712f4b018195a0a6102f378e9297291acf2d82cb3c0 model-00019-of-00059.safetensors
24
+ f99ae9d9cf903af58255d0774edec5ec1382c0d56a609108a59ce111518d40f0 model-00020-of-00059.safetensors
25
+ 1223e5b007d833bcb459b23f3d7f59f646b16acf2a1a685085389b8de2dc6128 model-00021-of-00059.safetensors
26
+ 48a99d78aaea1949ad85dce7847fa7d033173a22a58add4b2cd732410e7e15cf model-00022-of-00059.safetensors
27
+ db3c4baffbc4fc5a4eb34926e342d91fe4bcae59e0f712d06db4c2c4deb985da model-00023-of-00059.safetensors
28
+ 141a6b26fb0a959967c24629bbfcf0c970a475d7698d2125e622cb38fb385b9b model-00024-of-00059.safetensors
29
+ 433db989f798b99a87a64829f0a9d067e89daf1352cda3014e15c5414cbd33d2 model-00025-of-00059.safetensors
30
+ 6cc8f60655049f3c1cc04c74cc3f02f72a3f820dcac263b483fa8bcba026ac6c model-00026-of-00059.safetensors
31
+ 20b6cc117252f16fcb3d41f2372aca13a8f7426c13c86ad623c43cf0b96b5e72 model-00027-of-00059.safetensors
32
+ 8bbbb1329d0fbe43933a49d37dada0518609bc18cc762549c67f677051ac46e8 model-00028-of-00059.safetensors
33
+ 0734dbd916a3e5789d4338fdb053da6882fb7a6d636fd1495710557c032b5a24 model-00029-of-00059.safetensors
34
+ 01f5ace1d4086c96950f57604626a30821ff3ca6f60dddea74678d914d93dd72 model-00030-of-00059.safetensors
35
+ 8c362f13e9e0889f09bb552e57e5e7ac45e2f28510a9ad9fab5b50147b9c6dab model-00031-of-00059.safetensors
36
+ e93b983001b7b890da1a96405c630efb3eee7617482af1491822f213a6640b38 model-00032-of-00059.safetensors
37
+ 61bcaf0a63535ba8f756509e7cca4b6ce1c4b741aca01f2afba40f5c3a727cfd model-00033-of-00059.safetensors
38
+ 1c97dd5624ad3332e21c86836fc063059caab9262125a986e6f331c4ecf5aeff model-00034-of-00059.safetensors
39
+ 8e9e4be3a6296da50cc1b4af53115818aa75d266c430a6baa2f91709885d18df model-00035-of-00059.safetensors
40
+ a699b76e6a8633bd6ba0527270bb81a4c91604cd3a7118de09c9361fda3b144e model-00036-of-00059.safetensors
41
+ ff7bbbeb2f68415f368f2e99e91b905e145c87beadcf352d0311f85ec6ddaf6c model-00037-of-00059.safetensors
42
+ 2fe8533aac43a8c1c7b0885efef6a3080fdc6a61c880746c47520c25a10bf17d model-00038-of-00059.safetensors
43
+ 4846e39f398d04411859f18b2697f4e70e70ad33deeefa93135911d10c5a23e8 model-00039-of-00059.safetensors
44
+ 4b7de8e7af1d27c665f9e8dee5c904f9ee88ccd48c831361fc5999b979c16897 model-00040-of-00059.safetensors
45
+ 02c8320c607f11bbd377930a056873d84f0192d950176fc22e3c59d1dfb5995d model-00041-of-00059.safetensors
46
+ 68a8a3b2780336a8012b795aa6295fd9248c322f939e8131315a520fe4e43480 model-00042-of-00059.safetensors
47
+ d859d466ef5da5d0cf036bc6ed57fa0033d15c3921eb042d1a31617c6f0eef34 model-00043-of-00059.safetensors
48
+ 06d32c1ed652616e42fffdcce1735fad67b50a4f13397cfd030a4304ce035a08 model-00044-of-00059.safetensors
49
+ beb9181e4b827f0136d213c11a05c569e0bcb85b7e68ade06b38c5d3da2d1ae0 model-00045-of-00059.safetensors
50
+ 44a573a390174b0f0a41f8c0b198761384c46ae328a089f97d3e622468507224 model-00046-of-00059.safetensors
51
+ 32a3bc20ff1805ae3e14e0bcf7ac3a1f9c21a31fb04922d3d31e440e658c32b6 model-00047-of-00059.safetensors
52
+ 69a198153c9725aa0b6de50831b55fb0f04fc7a0f402731257836110358b7bde model-00048-of-00059.safetensors
53
+ a9d4adc81dbb3f12ec1300cb9c53bae070b7dbe41a66e30b5160841504fb5ba3 model-00049-of-00059.safetensors
54
+ 9d7cf6acb12c6907a102f9b836e3db345d2aa885493b3904084b95d0ac55c739 model-00050-of-00059.safetensors
55
+ 582322e446962d374f4b6fd5e469040d331150f7ef3d4a69fa460deded7c3ebc model-00051-of-00059.safetensors
56
+ d6fe7d0d82aa12dd5f40c083b4046ac6ef15ed0627433d63795bed9e50c55fb4 model-00052-of-00059.safetensors
57
+ af0c588e8ffe2e87ce5dee116d70ec083a3bfd2f4c4a09618d8a2791de5cd55f model-00053-of-00059.safetensors
58
+ ecda36174ea4e376919360f6e08c17d5b3d0a870469e9fd52cac0b7c8e12351e model-00054-of-00059.safetensors
59
+ 5d7c98c60576932850e8ef8945e38f24ca0f37cca895bf04c4a23d251081859c model-00055-of-00059.safetensors
60
+ 7410c9689fd0d2d384f4b2886707fb377327457937c91da914c725b7c35c2396 model-00056-of-00059.safetensors
61
+ 5c684ae59038495c44d01507e8047511db57fa720cc9997f7719fba76dbc29ee model-00057-of-00059.safetensors
62
+ b1234554df96e1f1e2a7adcef5f680e7b57e9b6ae4f4a16ceff8225b20921c5d model-00058-of-00059.safetensors
63
+ e36fa9e3f053db7a27e06f5b2804a2aa650a026a66e3f7db9efd35c5103cd9ae model-00059-of-00059.safetensors
64
+ dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055 tokenizer.model
model-00001-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e5cc2f91f7830364eff657b53df4f855091996cb2db7de2b69b8f11fa06be0a
3
+ size 4998663696
model-00002-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24dbc249686530b5bcf630c6edae25fff212900d340946fb868ebd3dd8c62851
3
+ size 4806799120
model-00003-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8ebc25463564c00d8e5d3f8a08ca5ce60c0efd53dd23aecfa7a2e3b0112b941
3
+ size 4806799120
model-00004-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81abed9dadae5877c49a57990fe5d8a449ed507987517728b1da7c195eacdd54
3
+ size 4806799120
model-00005-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45a5914445b0d8a95e02881d342a37b7d7c69943980b373b78331cf5c406191f
3
+ size 4806799120
model-00006-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea96b16084f0b6fddf232343e2ea55734ec324aeaa2eb60759fca724b80e292d
3
+ size 4806799120
model-00007-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a78d60bb853a77110a815f6a20c5819cef21bcc0b4d50e700b560be54d6f53b5
3
+ size 4806799120
model-00008-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba757c9109937a28e912c10bdb18042d347c55e768ec2dc89859c0e25823fa35
3
+ size 4806799120
model-00009-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab90762b6b58313c37b2d1e09a8f9ae956bc4b5d0cc52c379b0937ce752dca98
3
+ size 4806799120
model-00010-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b167436f7049226dbe7153e1ec602bf06d4cc384e5c16289e7207408c66068a
3
+ size 4806799120
model-00011-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4cc3a3f71b37f107b20f96d04067abbaee78f16e74196cdc68469d551bbe38c
3
+ size 4806799136
model-00012-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b045740b8c2377430a5f42e06d9eec2606b8db45c3e5ac87a316fbc715569cc0
3
+ size 4806799152
model-00013-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:175977b687acd05686a22c0f2b89f0ab0afb79c03db3480fa7fd989aec786287
3
+ size 4806799152
model-00014-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2703b8b32154f524baf105cb15f54ffbf134d13ccd923a30315e698fb85e54ff
3
+ size 4806799152
model-00015-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbe6004093d3a5e29f26c5e3f75e4e0b8a40c16498102dac31b0180746880671
3
+ size 4806799152
model-00016-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54c8f475521181cb4b93031b17c2a5c08ad0de1a81b035c2864c2bce19234c21
3
+ size 4806799152
model-00017-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b4e356a83fc7e42a056d790213fee7624abc0d12b8ca113dbe734a139a99491
3
+ size 4806799152
model-00018-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:188a8a3611852f704dae7804b47cfabb5a2ccf6c7f19226ae4e3fce6a3aa0506
3
+ size 4806799152
model-00019-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36d1e452bb1e962a83fdd712f4b018195a0a6102f378e9297291acf2d82cb3c0
3
+ size 4806799152
model-00020-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f99ae9d9cf903af58255d0774edec5ec1382c0d56a609108a59ce111518d40f0
3
+ size 4806799152
model-00021-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1223e5b007d833bcb459b23f3d7f59f646b16acf2a1a685085389b8de2dc6128
3
+ size 4806799152
model-00022-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48a99d78aaea1949ad85dce7847fa7d033173a22a58add4b2cd732410e7e15cf
3
+ size 4806799152
model-00023-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db3c4baffbc4fc5a4eb34926e342d91fe4bcae59e0f712d06db4c2c4deb985da
3
+ size 4806799152
model-00024-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:141a6b26fb0a959967c24629bbfcf0c970a475d7698d2125e622cb38fb385b9b
3
+ size 4932529864
model-00025-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:433db989f798b99a87a64829f0a9d067e89daf1352cda3014e15c5414cbd33d2
3
+ size 4995542848
model-00026-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cc8f60655049f3c1cc04c74cc3f02f72a3f820dcac263b483fa8bcba026ac6c
3
+ size 4995542848
model-00027-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20b6cc117252f16fcb3d41f2372aca13a8f7426c13c86ad623c43cf0b96b5e72
3
+ size 4932628288
model-00028-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bbbb1329d0fbe43933a49d37dada0518609bc18cc762549c67f677051ac46e8
3
+ size 4806774344
model-00029-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0734dbd916a3e5789d4338fdb053da6882fb7a6d636fd1495710557c032b5a24
3
+ size 4806799144
model-00030-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01f5ace1d4086c96950f57604626a30821ff3ca6f60dddea74678d914d93dd72
3
+ size 4806799144
model-00031-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c362f13e9e0889f09bb552e57e5e7ac45e2f28510a9ad9fab5b50147b9c6dab
3
+ size 4806799144
model-00032-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e93b983001b7b890da1a96405c630efb3eee7617482af1491822f213a6640b38
3
+ size 4806799144
model-00033-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61bcaf0a63535ba8f756509e7cca4b6ce1c4b741aca01f2afba40f5c3a727cfd
3
+ size 4806799152
model-00034-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c97dd5624ad3332e21c86836fc063059caab9262125a986e6f331c4ecf5aeff
3
+ size 4806799152
model-00035-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e9e4be3a6296da50cc1b4af53115818aa75d266c430a6baa2f91709885d18df
3
+ size 4806799152
model-00036-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a699b76e6a8633bd6ba0527270bb81a4c91604cd3a7118de09c9361fda3b144e
3
+ size 4806799152
model-00037-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff7bbbeb2f68415f368f2e99e91b905e145c87beadcf352d0311f85ec6ddaf6c
3
+ size 4806799152
model-00038-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fe8533aac43a8c1c7b0885efef6a3080fdc6a61c880746c47520c25a10bf17d
3
+ size 4806799152
model-00039-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4846e39f398d04411859f18b2697f4e70e70ad33deeefa93135911d10c5a23e8
3
+ size 4806799152
model-00040-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b7de8e7af1d27c665f9e8dee5c904f9ee88ccd48c831361fc5999b979c16897
3
+ size 4806799152
model-00041-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02c8320c607f11bbd377930a056873d84f0192d950176fc22e3c59d1dfb5995d
3
+ size 4806799152
model-00042-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68a8a3b2780336a8012b795aa6295fd9248c322f939e8131315a520fe4e43480
3
+ size 4806799152
model-00043-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d859d466ef5da5d0cf036bc6ed57fa0033d15c3921eb042d1a31617c6f0eef34
3
+ size 4806799152
model-00044-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06d32c1ed652616e42fffdcce1735fad67b50a4f13397cfd030a4304ce035a08
3
+ size 4806799152
model-00045-of-00059.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beb9181e4b827f0136d213c11a05c569e0bcb85b7e68ade06b38c5d3da2d1ae0
3
+ size 4806799152