docs: Add initial draft of main README.md
Browse filesThis commit introduces an initial draft for the `README.md` file on the project page. The document currently serves as a preliminary version and will be enhanced with additional details in subsequent updates.
README.md
CHANGED
@@ -1,3 +1,36 @@
|
|
1 |
-
---
|
2 |
-
license: mit
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
base_model:
|
4 |
+
- PixArt-alpha/PixArt-Sigma-XL-2-1024-MS
|
5 |
+
- stable-diffusion-v1-5/stable-diffusion-v1-5
|
6 |
+
---
|
7 |
+
|
8 |
+
# TinyBreaker: Hybrid Image Generation Model
|
9 |
+
|
10 |
+
## Overview
|
11 |
+
|
12 |
+
**TinyBreaker** is a hybrid model designed for efficient image generation even on mid and low-end hardware! By integrating the strengths of both PixArt and SD1.5 (Photon) models, TinyBreaker offers an elegant solution that doesn't compromise on quality or performance.
|
13 |
+
|
14 |
+
### Key Features
|
15 |
+
|
16 |
+
- **Hybrid Model Architecture**: Combines base image generation with PixArt and refinement using Photon (or any SD1 model), optimized for minimal parameter use.
|
17 |
+
- **Efficient Parameter Use**: A lean 0.6 billion parameters in the base model enable high-quality images without hefty computational demands.
|
18 |
+
- **Quick Performance**: Generate stunning images of size 1536×1024 in approximately ~12 seconds on an NVIDIA RTX 3080 GPU, with ongoing efforts to achieve sub-10-second generation times.
|
19 |
+
- **High Prompt Adherence**: Ensures generated images are closely aligned with user instructions and expectations due to PixArt model integration.
|
20 |
+
- **Optimized Latent Space Handling**: Utilizes Tiny Autoencoders for efficient latent space conversion, streamlining the input-to-image process.
|
21 |
+
|
22 |
+
### Current Usage
|
23 |
+
|
24 |
+
TinyBreaker is currently utilizable via ComfyUI. To use TinyBreaker, you'll need to install custom nodes specific to this model through [ComfyUI-TinyBreaker on GitHub](https://github.com/martin-rizzo/ComfyUI-TinyBreaker).
|
25 |
+
|
26 |
+
Note: The current prototype0 version of TinyBreaker utilizes PixArt Sigma 1024 + Photon (SD1.5) without additional training or fine-tuning.
|
27 |
+
|
28 |
+
|
29 |
+
## Limitations
|
30 |
+
|
31 |
+
- **Text Generation**: Currently, generating legible text within images is a challenge due to PixArt's training limitations. Enhancements in this area may require extensive retraining.
|
32 |
+
|
33 |
+
## Future Directions
|
34 |
+
|
35 |
+
I'm dedicated to enhancing TinyBreaker's speed and accessibility, particularly for users with mid-range or lower-end hardware setups. Look forward to future updates as I work on enhancing TinyBreaker's capabilities.
|
36 |
+
|