diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..d859b8101436786db759804ffb60794915101679 --- /dev/null +++ b/README.md @@ -0,0 +1,63 @@ +--- +base_model: + - black-forest-labs/FLUX.1-schnell +base_model_relation: quantized +pipeline_tag: text-to-image +tags: +- dfloat11 +- df11 +- lossless compression +- 70% size, 100% accuracy +--- + +## DFloat11 Compressed Model: `black-forest-labs/FLUX.1-schnell` + +This is a **losslessly compressed** version of [`black-forest-labs/FLUX.1-schnell`](https://huggingface.co/black-forest-labs/FLUX.1-schnell) using our custom **DFloat11** format. The outputs of this compressed model are **bit-for-bit identical** to the original BFloat16 model, while reducing GPU memory consumption by approximately **30%**. + +### ๐Ÿ” How It Works + +DFloat11 compresses model weights using **Huffman coding** of BFloat16 exponent bits, combined with **hardware-aware algorithmic designs** that enable efficient on-the-fly decompression directly on the GPU. During inference, the weights remain compressed in GPU memory and are **decompressed just before matrix multiplications**, then **immediately discarded after use** to minimize memory footprint. + +Key benefits: + +* **No CPU decompression or host-device data transfer** --- all operations are handled entirely on the GPU. +* DFloat11 is **much faster than CPU-offloading approaches**, enabling practical deployment in memory-constrained environments. +* The compression is **fully lossless**, guaranteeing that the modelโ€™s outputs are **bit-for-bit identical** to those of the original model. + +### ๐Ÿ”ง How to Use + +1. Install the DFloat11 pip package *(installs the CUDA kernel automatically; requires a CUDA-compatible GPU and PyTorch installed)*: + + ```bash + pip install dfloat11[cuda12] + # or if you have CUDA version 11: + # pip install dfloat11[cuda11] + ``` + +2. To use the DFloat11 model, run the following example code in Python: + ```python + import torch + from diffusers import FluxPipeline + from dfloat11 import DFloat11Model + + pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-schnell", torch_dtype=torch.bfloat16) + pipe.enable_model_cpu_offload() + + DFloat11Model.from_pretrained('DFloat11/FLUX.1-schnell-DF11', device='cpu', bfloat16_model=pipe.transformer) + + prompt = "A futuristic cityscape at sunset, with flying cars, neon lights, and reflective water canals" + image = pipe( + prompt, + guidance_scale=0.0, + num_inference_steps=4, + max_sequence_length=256, + generator=torch.Generator("cpu").manual_seed(0) + ).images[0] + image.save("flux-schnell.png") + ``` + +### ๐Ÿ“„ Learn More + +* **Paper**: [70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float](https://arxiv.org/abs/2504.11651) +* **GitHub**: [https://github.com/LeanModels/DFloat11](https://github.com/LeanModels/DFloat11) +* **HuggingFace**: [https://huggingface.co/DFloat11](https://huggingface.co/DFloat11) \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000000000000000000000000000000000000..6d42e25282df040793c9b7cfd93dcf79781300ea --- /dev/null +++ b/config.json @@ -0,0 +1,37 @@ +{ + "dfloat11_config": { + "bytes_per_thread": 8, + "pattern_dict": { + "transformer_blocks.\\d+": [ + "norm1.linear", + "norm1_context.linear", + "attn.to_q", + "attn.to_k", + "attn.to_v", + "attn.add_k_proj", + "attn.add_v_proj", + "attn.add_q_proj", + "attn.to_out.0", + "attn.to_add_out", + "ff.net.0.proj", + "ff.net.2", + "ff_context.net.0.proj", + "ff_context.net.2" + ], + "single_transformer_blocks.\\d+": [ + "norm.linear", + "proj_mlp", + "proj_out", + "attn.to_q", + "attn.to_k", + "attn.to_v" + ] + }, + "threads_per_block": [ + 512 + ], + "version": "0.2.0" + }, + "model_type": "llama" + } + \ No newline at end of file diff --git a/diffusion_pytorch_model.safetensors b/diffusion_pytorch_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ad2f912e3be6489fe92b4720f9432b6db3dffe2b --- /dev/null +++ b/diffusion_pytorch_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:edf0d7390cbcf66cb4a294c4bb1099323db3d9cc0d3b3a3ee35cc1881fc1a7ba +size 107792160 diff --git a/single_transformer_blocks_0.safetensors b/single_transformer_blocks_0.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a46e345fd46a268405f13bf52d5451f08f1fca2d --- /dev/null +++ b/single_transformer_blocks_0.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0037a1846cd6ee4532aa1f5f15ffdcb968aa77c5d4d30acf3ee51321df20a99d +size 191953015 diff --git a/single_transformer_blocks_1.safetensors b/single_transformer_blocks_1.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a96a9542066feec0ce33d202facb71f06416e063 --- /dev/null +++ b/single_transformer_blocks_1.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e64a69f314d23e045686e2b3636f3b65613ff1bbe61df3a70db2c4fe836d5842 +size 192032207 diff --git a/single_transformer_blocks_10.safetensors b/single_transformer_blocks_10.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8be663bb0507ecd15d10b3b80e7206b61db264e7 --- /dev/null +++ b/single_transformer_blocks_10.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bf8e859cadea7b8ac2dc91fbbbd40d925604f65adfe719317efd8db7a0e7275f +size 193121523 diff --git a/single_transformer_blocks_11.safetensors b/single_transformer_blocks_11.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..977928ec47a41db074edb669496d956fd9a57347 --- /dev/null +++ b/single_transformer_blocks_11.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75830d953639891dcee2360ea47183d418db5280e8309806cb3dc23f0d6781bc +size 193355293 diff --git a/single_transformer_blocks_12.safetensors b/single_transformer_blocks_12.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b4b321bd9f6346eaf4fa7c4fbcf958dac988ef47 --- /dev/null +++ b/single_transformer_blocks_12.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:66eefa3597c8db8f24d534a23a58df26f6563e8a0e6dbb1894f760ef26c44d09 +size 193529273 diff --git a/single_transformer_blocks_13.safetensors b/single_transformer_blocks_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..380dfca6b70faea45d8cd622391445a2e8ab00d4 --- /dev/null +++ b/single_transformer_blocks_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d110c7421a3d5aa2b076bc362c61cf7c516bd93380bd49e9aa1c7375d79d5dec +size 193556587 diff --git a/single_transformer_blocks_14.safetensors b/single_transformer_blocks_14.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3256229dff1beb78d6c42cc1d6d84c59ddad0e17 --- /dev/null +++ b/single_transformer_blocks_14.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8bee3032ad669b6639711bb06fc65d6aaecde8bf7dee72f2e3629fe22e97b572 +size 193552945 diff --git a/single_transformer_blocks_15.safetensors b/single_transformer_blocks_15.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..35065dbcaf27affd9d5abff6a1dc2f088b679631 --- /dev/null +++ b/single_transformer_blocks_15.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1991916050f222ec1c50ca20c22a59102f8ae4cc8322e56247a8045f176afc65 +size 193512820 diff --git a/single_transformer_blocks_16.safetensors b/single_transformer_blocks_16.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..27f8f04b203cdb1f1fa975937ee513b12e077d23 --- /dev/null +++ b/single_transformer_blocks_16.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:751724fc51ebb59a99987ab5631b82f35a68d06863de5614198a3edda54045f2 +size 193540148 diff --git a/single_transformer_blocks_17.safetensors b/single_transformer_blocks_17.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..89576eacb3bd3514bb378bc8658a392ee011fc3a --- /dev/null +++ b/single_transformer_blocks_17.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:863cd3099cc41e40e90c38967eecb0951583cf784b682695e09c06cc06d72bc1 +size 193663027 diff --git a/single_transformer_blocks_18.safetensors b/single_transformer_blocks_18.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..cb47ada72183b62a80f826ed2804afa89e69618c --- /dev/null +++ b/single_transformer_blocks_18.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:694dfbe171f862a637c8a22825356fa5254f70d8a7fb94c142693881a6865f75 +size 193744130 diff --git a/single_transformer_blocks_19.safetensors b/single_transformer_blocks_19.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a8b0edc2534d920ff057748a28a566a514701bab --- /dev/null +++ b/single_transformer_blocks_19.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:74d568dfb324f67f17ab544a8f1100a14eafc9699522861df07e6f2ebb5edcec +size 193748170 diff --git a/single_transformer_blocks_2.safetensors b/single_transformer_blocks_2.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9e5c0fc5433dcb464c1af5a1588aa9eb9dfe4987 --- /dev/null +++ b/single_transformer_blocks_2.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cf5000a2bc92c45c465654b53fce5518e3cc2d8c05aac975a4b41862aa835873 +size 192074001 diff --git a/single_transformer_blocks_20.safetensors b/single_transformer_blocks_20.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8706387a3d227e71475c96d801cb9b8c96a9605b --- /dev/null +++ b/single_transformer_blocks_20.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:910f97e188c44085496a57276d4e10ca06a09a07476e51aad500b1d119392647 +size 193812404 diff --git a/single_transformer_blocks_21.safetensors b/single_transformer_blocks_21.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1f86c7a612fb2a103811e2972708d7437918cb0d --- /dev/null +++ b/single_transformer_blocks_21.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:72e55153332eee80cd3c6d7f9e32c1a2000958aee3bc1554bddb7af44d4b5172 +size 194050033 diff --git a/single_transformer_blocks_22.safetensors b/single_transformer_blocks_22.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d7fbd6dcf552db610b7590e1de6057747eab8a92 --- /dev/null +++ b/single_transformer_blocks_22.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca4f002463a8be9d28f958df090a959b824becb06190566f045076bca657820e +size 194185169 diff --git a/single_transformer_blocks_23.safetensors b/single_transformer_blocks_23.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f5d0a877bd8df4e7c47d569203beb0c88c6ca1e4 --- /dev/null +++ b/single_transformer_blocks_23.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6f467b516919c81a3798511f45039f980272bba7dd7bfae083fa834421271fdf +size 194411637 diff --git a/single_transformer_blocks_24.safetensors b/single_transformer_blocks_24.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8e3f4e5b9b49f3d78b5f25eba8cb1995fd8a9420 --- /dev/null +++ b/single_transformer_blocks_24.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:42e32898cac5408801b18579072c80d5fb2af1f51c4348e96060a3064e78fa14 +size 194459327 diff --git a/single_transformer_blocks_25.safetensors b/single_transformer_blocks_25.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..7a49c409b81e33649547c37e7006520b147068c3 --- /dev/null +++ b/single_transformer_blocks_25.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:baade5dffabea356302ce414d4736732333fbb19e5acaf888d75a75ff4898db1 +size 194751756 diff --git a/single_transformer_blocks_26.safetensors b/single_transformer_blocks_26.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e99298c254462105b9c05fc0581b54efe8ba754d --- /dev/null +++ b/single_transformer_blocks_26.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4d671332cfe58cdc332edfb220a5b6cfe317a7bfe5607058282b8054a4e875e +size 194837141 diff --git a/single_transformer_blocks_27.safetensors b/single_transformer_blocks_27.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a53f32ac5b8751c2f873f76035618b7c0b25524e --- /dev/null +++ b/single_transformer_blocks_27.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:377bbdbff2ed7b787071ab459c6e17eba5bccc467e0387b4ccd2b7aa86db79c4 +size 195176223 diff --git a/single_transformer_blocks_28.safetensors b/single_transformer_blocks_28.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..92fe75b058e114ec048f476c4e29b8f8f9aea247 --- /dev/null +++ b/single_transformer_blocks_28.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57d69b2b853301e6ab4be36a19dde058f4932fb5fea6f4e3dba6734ace7147fe +size 195365552 diff --git a/single_transformer_blocks_29.safetensors b/single_transformer_blocks_29.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ed8591e2041cbf9a9307da149dc0c10bb9dcb415 --- /dev/null +++ b/single_transformer_blocks_29.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f6ed53cbe68061e33f2f61acd11a8b5e0a4af96e2c264fb17f000dc48a139dc +size 195189385 diff --git a/single_transformer_blocks_3.safetensors b/single_transformer_blocks_3.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f20f417fee1d16798e678f99c50c79f636b44690 --- /dev/null +++ b/single_transformer_blocks_3.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:47792ba1e34c3b2b9644721f29cc79768ebaf18cd8f1dba68dd28d4456049645 +size 192146012 diff --git a/single_transformer_blocks_30.safetensors b/single_transformer_blocks_30.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6fa99e59519b9bc3ccd1ed6a0cf1db4ceb1e0ad1 --- /dev/null +++ b/single_transformer_blocks_30.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5bda3e305c44032910e47151e4318354b1ae5d3afff88644f8c8889d26e15fe1 +size 195679215 diff --git a/single_transformer_blocks_31.safetensors b/single_transformer_blocks_31.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b14654e4fac53997670ee4286c91ce5dfc531f71 --- /dev/null +++ b/single_transformer_blocks_31.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e1286e2c52052514ad7f90850d769513f4439de3194d903efd8a8d6932c98a43 +size 195832841 diff --git a/single_transformer_blocks_32.safetensors b/single_transformer_blocks_32.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b1ad9728beba7e6d024247fe2a60819c194c6f2e --- /dev/null +++ b/single_transformer_blocks_32.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff0a7c59d4dcb60307c425597ba1580358c35f9963a7928501bb969325180695 +size 195791381 diff --git a/single_transformer_blocks_33.safetensors b/single_transformer_blocks_33.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8e894489729aa4aab5f9bd8cd2fd11b644c858b7 --- /dev/null +++ b/single_transformer_blocks_33.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05ed812665609b75a82562c7cdfc4ae48b588d1b39fcd728fb3698345885f87e +size 195843235 diff --git a/single_transformer_blocks_34.safetensors b/single_transformer_blocks_34.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1d78ea9ed097a615a785daa664bb57e1b0e1038f --- /dev/null +++ b/single_transformer_blocks_34.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6cfb93e29930842cb807d760679cc1218757063863d6f8735c0adbbb83d8125 +size 196142671 diff --git a/single_transformer_blocks_35.safetensors b/single_transformer_blocks_35.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..efb89aa43a5fb05be1fea7f429e56f472ada52fc --- /dev/null +++ b/single_transformer_blocks_35.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b56c0b4224153f10cdd37c17314c240e51d20015eb84aabe79654dacba2a64b +size 196397938 diff --git a/single_transformer_blocks_36.safetensors b/single_transformer_blocks_36.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9d28d5489b535434c17d37bf8bca7fc04278a0e5 --- /dev/null +++ b/single_transformer_blocks_36.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9f20bb1166dd733b1b6c7a0af5ea820f7549100874d383721df9eaf30212e37f +size 194733332 diff --git a/single_transformer_blocks_37.safetensors b/single_transformer_blocks_37.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..bb4654039cd0fe42b54374de5b847115c481cb86 --- /dev/null +++ b/single_transformer_blocks_37.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f7b43788887b371039f8c3cab9d564e7d5f26285b85adece74e3f65963ef2a20 +size 196538942 diff --git a/single_transformer_blocks_4.safetensors b/single_transformer_blocks_4.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..0be2a09d9f72915753bded61696e1b1ceaa62148 --- /dev/null +++ b/single_transformer_blocks_4.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:386508cff8883f508bca451562cc35a5158a400da97e02caeaaf3c5276d32946 +size 192209800 diff --git a/single_transformer_blocks_5.safetensors b/single_transformer_blocks_5.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ed792d6e27fa54a828ceb16bb17185b66f181210 --- /dev/null +++ b/single_transformer_blocks_5.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a19666cd7ce2275b283ce0499edc53f78733bc146c711b034af1760d6c1d38bd +size 192383459 diff --git a/single_transformer_blocks_6.safetensors b/single_transformer_blocks_6.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5bd80c60e292dc11dae68044a4a217aa5254a426 --- /dev/null +++ b/single_transformer_blocks_6.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:84fa6d67ec1e8d3326c38900293f6632d78e827b257c67526d3d8cbfd5ac732d +size 192510255 diff --git a/single_transformer_blocks_7.safetensors b/single_transformer_blocks_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d373442cf634ed38201cda76f6a6448ad1d6dea3 --- /dev/null +++ b/single_transformer_blocks_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b5d7b1308b9f7d4d316778ec1dc499eda842cba6a3d2081d4f90c78d27dc8470 +size 192611186 diff --git a/single_transformer_blocks_8.safetensors b/single_transformer_blocks_8.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..af9946d9e03df5cd23a768548dea6560aa641235 --- /dev/null +++ b/single_transformer_blocks_8.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:866c2cacf8c95a513e6de2230676557ba320fdfc95f66f49939a9741067c53dc +size 192849476 diff --git a/single_transformer_blocks_9.safetensors b/single_transformer_blocks_9.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f270309ebdba95b30ed64dd63779f7b855a4c0c1 --- /dev/null +++ b/single_transformer_blocks_9.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aea5aa932b175287a5981eaaba361e41ca18c214ad8ad501b01ab63264d1abf7 +size 192984853 diff --git a/transformer_blocks_0.safetensors b/transformer_blocks_0.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a1a6b38053f74a16f63ce163d22b7275d8a93c7a --- /dev/null +++ b/transformer_blocks_0.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:505ce0fdf7761acffc150842a96b27b796385eb432e1e2f444ee8a65c795f8b3 +size 471202099 diff --git a/transformer_blocks_1.safetensors b/transformer_blocks_1.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6d6d70f2585488a95b42dfcd05a6730f2692bcac --- /dev/null +++ b/transformer_blocks_1.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f2d9a014f8d72c81128abdd3b7a0e0ca91fae5d5f3e3216181bebc53ae3261a6 +size 471627688 diff --git a/transformer_blocks_10.safetensors b/transformer_blocks_10.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c71637876f00256a927026c53035a640d32bb2e7 --- /dev/null +++ b/transformer_blocks_10.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3fe0eb093f2e720b433b5eed39d77ee9f0c5ddb2e81a0801d3269375987dff3 +size 463500213 diff --git a/transformer_blocks_11.safetensors b/transformer_blocks_11.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..115f2ae7a1a7186bc283cb88217a2f362a73aabd --- /dev/null +++ b/transformer_blocks_11.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:236d05af08f23ae7bb90cc3ceb376da4f958e3a17cc960620bc5d7d97eaa74b7 +size 462862609 diff --git a/transformer_blocks_12.safetensors b/transformer_blocks_12.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..26807f471332269c379ba8097608017edf505099 --- /dev/null +++ b/transformer_blocks_12.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8496d0d29be9c3ed9c1826937a25d5fadf85753f2e224b12359789984e55c694 +size 462757049 diff --git a/transformer_blocks_13.safetensors b/transformer_blocks_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ed17440ff800f6b6d338f4b08e5156e7d8bae3e8 --- /dev/null +++ b/transformer_blocks_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b9733d95a6ded2ff70591ef8eb5abf230715d88e7506a54c551804beecc55566 +size 463790209 diff --git a/transformer_blocks_14.safetensors b/transformer_blocks_14.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3bfc0ccbad27b7d2eed3a73bf38cddda9d7feed1 --- /dev/null +++ b/transformer_blocks_14.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:453d1f4fed9deaedb1441b693b93d9af412cfafe9c9c1bc8cabc96e589da65d5 +size 462434248 diff --git a/transformer_blocks_15.safetensors b/transformer_blocks_15.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3f3ad398f5f58f115ea26f25c206c7cf4d29dcce --- /dev/null +++ b/transformer_blocks_15.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3ae0ec8d7dfaef9ba71fe2ede6b4b3e5815234f9d9b2400359bf1bba3e40acb6 +size 461533069 diff --git a/transformer_blocks_16.safetensors b/transformer_blocks_16.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..fbfdb392060da3f4dac5b8c0f5211ddf2613413a --- /dev/null +++ b/transformer_blocks_16.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a4a657aed5321a001c88410e46dcd103b0bb4f247d839d9c9adae9d980923c9a +size 461588247 diff --git a/transformer_blocks_17.safetensors b/transformer_blocks_17.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..64bd49d0c9852d77459167f8a9037baaa6f35a28 --- /dev/null +++ b/transformer_blocks_17.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75d76435e5e49effd193bd6b1c85c1fff3a2a72221a96be5466ecd1954cba279 +size 461427736 diff --git a/transformer_blocks_18.safetensors b/transformer_blocks_18.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3588e5e2391a812a830553af42cfd3f9b17f226d --- /dev/null +++ b/transformer_blocks_18.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:599c96c46b203fd146d6c52720fe9403a2a6cfc98b25b9dc608b4a68eadd504c +size 461830452 diff --git a/transformer_blocks_2.safetensors b/transformer_blocks_2.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..7a762961684f3a131b114a2540535c30c63d9824 --- /dev/null +++ b/transformer_blocks_2.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d6547d06c17910e24712d53e6c8985bf2ec95951bd7c6f10546a103e69651dde +size 472252858 diff --git a/transformer_blocks_3.safetensors b/transformer_blocks_3.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..baec2694c76b3101ab7fe9e70a54ed97f8bd0e70 --- /dev/null +++ b/transformer_blocks_3.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dbae666e7cdf4e9b2d6389774b91dfeab2ca6a409d47c9b3b68404ad42d06c5c +size 467678294 diff --git a/transformer_blocks_4.safetensors b/transformer_blocks_4.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..48775c3dfac4ab2faefae8de695bc96da65e0f4a --- /dev/null +++ b/transformer_blocks_4.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a4c6f669dcad79534a9a6b29874bb58ed841549a84ab620f2ffad4829764774e +size 465374283 diff --git a/transformer_blocks_5.safetensors b/transformer_blocks_5.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9f710642d9abda781f06702f8d09ca97d451e871 --- /dev/null +++ b/transformer_blocks_5.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c1025577ad0cdd6bd30e75e187aae8406dc088b26ff9201650151905af5e5134 +size 464662539 diff --git a/transformer_blocks_6.safetensors b/transformer_blocks_6.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..dc5e49d7817e6b759079759650c8d8edca516253 --- /dev/null +++ b/transformer_blocks_6.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9b62a37465b7b5a7f32a82f1685db532a8d964c85a756c03bafdc90b4f3d69f +size 464584625 diff --git a/transformer_blocks_7.safetensors b/transformer_blocks_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..30d1055085a2d6840e3fd09e0b41bca02d1ad61a --- /dev/null +++ b/transformer_blocks_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:48a96cabb1549911dd571316b6ee4be83cf4e37b3eacf287ea15699b7168ff76 +size 464052050 diff --git a/transformer_blocks_8.safetensors b/transformer_blocks_8.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a1ad45666d24796b01b5662f972864f676584bd7 --- /dev/null +++ b/transformer_blocks_8.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4ad344ba735748f87b81f3eab63cf99e66ff71a2b3544432db2cb5d179807ec0 +size 463384375 diff --git a/transformer_blocks_9.safetensors b/transformer_blocks_9.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c8aae3545588b355530c78642f256fa052229448 --- /dev/null +++ b/transformer_blocks_9.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fcae76d89149ceb16a27752efc4cc59c9c843ad1a043f4c0cd0c1e77a1c300fe +size 462429578