Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,16 @@ tags:
|
|
| 6 |
- quantization
|
| 7 |
---
|
| 8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
|
| 10 |
# Usage with Diffusers
|
| 11 |
|
|
@@ -45,22 +55,6 @@ image = pipe(
|
|
| 45 |
image.save("flux.png")
|
| 46 |
```
|
| 47 |
|
| 48 |
-
<table>
|
| 49 |
-
<td style="text-align: center;">
|
| 50 |
-
BF16<br>
|
| 51 |
-
<medium-zoom background="rgba(0,0,0,.7)"><img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/quantization-backends-diffusers/combined_flux-dev_bf16_combined.png" alt="Flux-dev output with BF16: Baroque, Futurist, Noir styles"></medium-zoom>
|
| 52 |
-
</td>
|
| 53 |
-
<td style="text-align: center;">
|
| 54 |
-
BnB 4-bit<br>
|
| 55 |
-
<medium-zoom background="rgba(0,0,0,.7)"><img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/quantization-backends-diffusers/combined_flux-dev_bnb_4bit_combined.png" alt="Flux-dev output with BnB 4-bit: Baroque, Futurist, Noir styles"></medium-zoom>
|
| 56 |
-
</td>
|
| 57 |
-
<tr>
|
| 58 |
-
<td colspan="3" style="text-align: center;"><em>Visual comparison of Flux-dev model outputs using BF16 (left), BnB 4-bit (right) (Click on an image to zoom) </em></td>
|
| 59 |
-
</tr>
|
| 60 |
-
</table>
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
# How to generate this quantized checkpoint ?
|
| 65 |
|
| 66 |
This checkpoint was created with the following script using "black-forest-labs/FLUX.1-dev" checkpoint:
|
|
|
|
| 6 |
- quantization
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# Visual comparison of Flux-dev model outputs using BF16 and BnB 8-bit quantization
|
| 10 |
+
|
| 11 |
+
<td style="text-align: center;">
|
| 12 |
+
BF16<br>
|
| 13 |
+
<medium-zoom background="rgba(0,0,0,.7)"><img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/quantization-backends-diffusers/combined_flux-dev_bf16_combined.png" alt="Flux-dev output with BF16: Baroque, Futurist, Noir styles"></medium-zoom>
|
| 14 |
+
</td>
|
| 15 |
+
<td style="text-align: center;">
|
| 16 |
+
BnB 8-bit<br>
|
| 17 |
+
<medium-zoom background="rgba(0,0,0,.7)"><img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/quantization-backends-diffusers/combined_flux-dev_bnb_8bit_combined.png" alt="Flux-dev output with BnB 8-bit: Baroque, Futurist, Noir styles"></medium-zoom>
|
| 18 |
+
</td>
|
| 19 |
|
| 20 |
# Usage with Diffusers
|
| 21 |
|
|
|
|
| 55 |
image.save("flux.png")
|
| 56 |
```
|
| 57 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
# How to generate this quantized checkpoint ?
|
| 59 |
|
| 60 |
This checkpoint was created with the following script using "black-forest-labs/FLUX.1-dev" checkpoint:
|