martin-rizzo commited on
Commit
210e942
·
verified ·
1 Parent(s): 4c9dd0d

docs: Add initial draft of main README.md

Browse files

This commit introduces an initial draft for the `README.md` file on the project page. The document currently serves as a preliminary version and will be enhanced with additional details in subsequent updates.

Files changed (1) hide show
  1. README.md +36 -3
README.md CHANGED
@@ -1,3 +1,36 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model:
4
+ - PixArt-alpha/PixArt-Sigma-XL-2-1024-MS
5
+ - stable-diffusion-v1-5/stable-diffusion-v1-5
6
+ ---
7
+
8
+ # TinyBreaker: Hybrid Image Generation Model
9
+
10
+ ## Overview
11
+
12
+ **TinyBreaker** is a hybrid model designed for efficient image generation even on mid and low-end hardware! By integrating the strengths of both PixArt and SD1.5 (Photon) models, TinyBreaker offers an elegant solution that doesn't compromise on quality or performance.
13
+
14
+ ### Key Features
15
+
16
+ - **Hybrid Model Architecture**: Combines base image generation with PixArt and refinement using Photon (or any SD1 model), optimized for minimal parameter use.
17
+ - **Efficient Parameter Use**: A lean 0.6 billion parameters in the base model enable high-quality images without hefty computational demands.
18
+ - **Quick Performance**: Generate stunning images of size 1536×1024 in approximately ~12 seconds on an NVIDIA RTX 3080 GPU, with ongoing efforts to achieve sub-10-second generation times.
19
+ - **High Prompt Adherence**: Ensures generated images are closely aligned with user instructions and expectations due to PixArt model integration.
20
+ - **Optimized Latent Space Handling**: Utilizes Tiny Autoencoders for efficient latent space conversion, streamlining the input-to-image process.
21
+
22
+ ### Current Usage
23
+
24
+ TinyBreaker is currently utilizable via ComfyUI. To use TinyBreaker, you'll need to install custom nodes specific to this model through [ComfyUI-TinyBreaker on GitHub](https://github.com/martin-rizzo/ComfyUI-TinyBreaker).
25
+
26
+ Note: The current prototype0 version of TinyBreaker utilizes PixArt Sigma 1024 + Photon (SD1.5) without additional training or fine-tuning.
27
+
28
+
29
+ ## Limitations
30
+
31
+ - **Text Generation**: Currently, generating legible text within images is a challenge due to PixArt's training limitations. Enhancements in this area may require extensive retraining.
32
+
33
+ ## Future Directions
34
+
35
+ I'm dedicated to enhancing TinyBreaker's speed and accessibility, particularly for users with mid-range or lower-end hardware setups. Look forward to future updates as I work on enhancing TinyBreaker's capabilities.
36
+