Upload folder using huggingface_hub
Browse files- .gitattributes +18 -0
- README.md +58 -0
- config.yaml +79 -0
- flux_1_dev_wikiart_impressionism_2000_step_style.safetensors +3 -0
- flux_1_dev_wikiart_impressionism_2000_step_style_000000500.safetensors +3 -0
- flux_1_dev_wikiart_impressionism_2000_step_style_000001000.safetensors +3 -0
- flux_1_dev_wikiart_impressionism_2000_step_style_000001500.safetensors +3 -0
- metadata.json +86 -0
- optimizer.pt +3 -0
- samples/1743126213856__000000000_0.jpg +0 -0
- samples/1743126232276__000000000_1.jpg +0 -0
- samples/1743126250687__000000000_2.jpg +3 -0
- samples/1743126269107__000000000_3.jpg +3 -0
- samples/1743126850153__000000250_0.jpg +0 -0
- samples/1743126868582__000000250_1.jpg +0 -0
- samples/1743126887006__000000250_2.jpg +3 -0
- samples/1743126905428__000000250_3.jpg +3 -0
- samples/1743127494078__000000500_0.jpg +0 -0
- samples/1743127512507__000000500_1.jpg +0 -0
- samples/1743127530941__000000500_2.jpg +3 -0
- samples/1743127549376__000000500_3.jpg +3 -0
- samples/1743128151538__000000750_0.jpg +0 -0
- samples/1743128170007__000000750_1.jpg +0 -0
- samples/1743128188481__000000750_2.jpg +3 -0
- samples/1743128206968__000000750_3.jpg +3 -0
- samples/1743128825917__000001000_0.jpg +0 -0
- samples/1743128844394__000001000_1.jpg +0 -0
- samples/1743128862854__000001000_2.jpg +3 -0
- samples/1743128881320__000001000_3.jpg +3 -0
- samples/1743129478236__000001250_0.jpg +0 -0
- samples/1743129496696__000001250_1.jpg +0 -0
- samples/1743129515167__000001250_2.jpg +3 -0
- samples/1743129533651__000001250_3.jpg +3 -0
- samples/1743130134894__000001500_0.jpg +0 -0
- samples/1743130153352__000001500_1.jpg +0 -0
- samples/1743130171829__000001500_2.jpg +3 -0
- samples/1743130190311__000001500_3.jpg +3 -0
- samples/1743130799929__000001750_0.jpg +0 -0
- samples/1743130818393__000001750_1.jpg +0 -0
- samples/1743130836888__000001750_2.jpg +3 -0
- samples/1743130855361__000001750_3.jpg +3 -0
- samples/1743131461121__000002000_0.jpg +0 -0
- samples/1743131479533__000002000_1.jpg +0 -0
- samples/1743131497938__000002000_2.jpg +3 -0
- samples/1743131516353__000002000_3.jpg +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,21 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
samples/1743126250687__000000000_2.jpg filter=lfs diff=lfs merge=lfs -text
|
37 |
+
samples/1743126269107__000000000_3.jpg filter=lfs diff=lfs merge=lfs -text
|
38 |
+
samples/1743126887006__000000250_2.jpg filter=lfs diff=lfs merge=lfs -text
|
39 |
+
samples/1743126905428__000000250_3.jpg filter=lfs diff=lfs merge=lfs -text
|
40 |
+
samples/1743127530941__000000500_2.jpg filter=lfs diff=lfs merge=lfs -text
|
41 |
+
samples/1743127549376__000000500_3.jpg filter=lfs diff=lfs merge=lfs -text
|
42 |
+
samples/1743128188481__000000750_2.jpg filter=lfs diff=lfs merge=lfs -text
|
43 |
+
samples/1743128206968__000000750_3.jpg filter=lfs diff=lfs merge=lfs -text
|
44 |
+
samples/1743128862854__000001000_2.jpg filter=lfs diff=lfs merge=lfs -text
|
45 |
+
samples/1743128881320__000001000_3.jpg filter=lfs diff=lfs merge=lfs -text
|
46 |
+
samples/1743129515167__000001250_2.jpg filter=lfs diff=lfs merge=lfs -text
|
47 |
+
samples/1743129533651__000001250_3.jpg filter=lfs diff=lfs merge=lfs -text
|
48 |
+
samples/1743130171829__000001500_2.jpg filter=lfs diff=lfs merge=lfs -text
|
49 |
+
samples/1743130190311__000001500_3.jpg filter=lfs diff=lfs merge=lfs -text
|
50 |
+
samples/1743130836888__000001750_2.jpg filter=lfs diff=lfs merge=lfs -text
|
51 |
+
samples/1743130855361__000001750_3.jpg filter=lfs diff=lfs merge=lfs -text
|
52 |
+
samples/1743131497938__000002000_2.jpg filter=lfs diff=lfs merge=lfs -text
|
53 |
+
samples/1743131516353__000002000_3.jpg filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- flux
|
4 |
+
- stable-diffusion
|
5 |
+
- text-to-image
|
6 |
+
- lora
|
7 |
+
- flux dev
|
8 |
+
- diffusers
|
9 |
+
- impressionism
|
10 |
+
library_name: diffusers
|
11 |
+
pipeline_tag: text-to-image
|
12 |
+
base_model: black-forest-labs/FLUX.1-dev
|
13 |
+
---
|
14 |
+
|
15 |
+
# FLUX.1-dev Impressionism fine-tuning with LoRA
|
16 |
+
|
17 |
+
This is a LoRA fine-tuning of the FLUX.1 model trained on a curated dataset of impressionist paintings from WikiArt.
|
18 |
+
|
19 |
+
## Dataset
|
20 |
+
The model was trained on the [WikiArt Impressionism Curated Dataset](https://huggingface.co/datasets/dolphinium/wikiart-impressionism-curated), which contains 1,000 high-quality Impressionist paintings with the following distribution:
|
21 |
+
|
22 |
+
- Landscapes: 300 images (30%)
|
23 |
+
- Portraits: 300 images (30%)
|
24 |
+
- Urban Scenes: 200 images (20%)
|
25 |
+
- Still Life: 200 images (20%)
|
26 |
+
|
27 |
+
## Model Details
|
28 |
+
- Base Model: [FLUX.1](https://huggingface.co/black-forest-labs/FLUX.1-dev)
|
29 |
+
- LoRA Rank: 16
|
30 |
+
- Training Steps: 2000
|
31 |
+
- Resolution: 512-1024px
|
32 |
+
|
33 |
+
## Usage
|
34 |
+
|
35 |
+
```python
|
36 |
+
from diffusers import StableDiffusionPipeline
|
37 |
+
import torch
|
38 |
+
|
39 |
+
model_id = "black-forest-labs/FLUX.1-dev"
|
40 |
+
lora_model_path = "dolphinium/FLUX.1-dev-wikiart-impressionism-v2"
|
41 |
+
|
42 |
+
pipe = StableDiffusionPipeline.from_pretrained(
|
43 |
+
model_id,
|
44 |
+
torch_dtype=torch.float16
|
45 |
+
).to("cuda")
|
46 |
+
|
47 |
+
# Load LoRA weights
|
48 |
+
pipe.unet.load_attn_procs(lora_model_path)
|
49 |
+
|
50 |
+
# Generate image
|
51 |
+
prompt = "an impressionist style landscape with rolling hills and autumn trees"
|
52 |
+
image = pipe(prompt).images[0]
|
53 |
+
image.save("impressionist_landscape.png")
|
54 |
+
```
|
55 |
+
|
56 |
+
|
57 |
+
## License
|
58 |
+
This model inherits the license of the base FLUX.1 model and the WikiArt dataset.
|
config.yaml
ADDED
@@ -0,0 +1,79 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
job: extension
|
2 |
+
config:
|
3 |
+
name: flux_1_dev_wikiart_impressionism_2000_step_style
|
4 |
+
process:
|
5 |
+
- type: sd_trainer
|
6 |
+
training_folder: /content/output
|
7 |
+
performance_log_every: 500
|
8 |
+
device: cuda:0
|
9 |
+
trigger_word: dolpImp
|
10 |
+
network:
|
11 |
+
type: lora
|
12 |
+
linear: 16
|
13 |
+
linear_alpha: 16
|
14 |
+
save:
|
15 |
+
dtype: float16
|
16 |
+
save_every: 500
|
17 |
+
max_step_saves_to_keep: 10
|
18 |
+
datasets:
|
19 |
+
- folder_path: /content/dataset
|
20 |
+
caption_ext: txt
|
21 |
+
caption_dropout_rate: 0.05
|
22 |
+
shuffle_tokens: true
|
23 |
+
cache_latents_to_disk: true
|
24 |
+
resolution:
|
25 |
+
- 512
|
26 |
+
- 768
|
27 |
+
- 1024
|
28 |
+
train:
|
29 |
+
batch_size: 1
|
30 |
+
steps: 2000
|
31 |
+
gradient_accumulation_steps: 1
|
32 |
+
train_unet: true
|
33 |
+
train_text_encoder: false
|
34 |
+
content_or_style: style
|
35 |
+
gradient_checkpointing: true
|
36 |
+
noise_scheduler: flowmatch
|
37 |
+
optimizer: adamw8bit
|
38 |
+
lr: 0.0001
|
39 |
+
ema_config:
|
40 |
+
use_ema: true
|
41 |
+
ema_decay: 0.99
|
42 |
+
dtype: bf16
|
43 |
+
model:
|
44 |
+
name_or_path: black-forest-labs/FLUX.1-dev
|
45 |
+
is_flux: true
|
46 |
+
quantize: true
|
47 |
+
sample:
|
48 |
+
sampler: flowmatch
|
49 |
+
sample_every: 250
|
50 |
+
width: 1024
|
51 |
+
height: 1024
|
52 |
+
prompts:
|
53 |
+
- '[trigger] An impressionist painting depicts a wide, sandy beach under a cloudy
|
54 |
+
sky, with figures scattered along the shore, rendered with loose, visible
|
55 |
+
brushstrokes in muted tones of blue, brown, and white, creating a tranquil
|
56 |
+
and airy atmosphere'
|
57 |
+
- "[trigger] An impressionist portrait captures the delicate expression of a\
|
58 |
+
\ woman bathed in soft, natural light. The artist employs bold, yet subtle\
|
59 |
+
\ brushstrokes to emphasize the subject\u2019s serene features and gentle\
|
60 |
+
\ contours, all set against a background of softly blended pastel tones that\
|
61 |
+
\ evoke introspection and grace."
|
62 |
+
- '[trigger] An impressionist painting depicts a stone bridge arching over a
|
63 |
+
ravine, with a church tower on the left and a hillside in the background,
|
64 |
+
rendered in warm earth tones and blues with visible, textured brushstrokes,
|
65 |
+
creating a hazy and tranquil atmosphere'
|
66 |
+
- '[trigger] An impressionist painting of a still life featuring a bouquet of
|
67 |
+
red and yellow roses wrapped in white paper, an ornate vase holding dried
|
68 |
+
grasses and a decorative fan, and a stack of old books, all arranged on a
|
69 |
+
table against a warm, orange-toned background with a framed picture hanging
|
70 |
+
above, rendered with visible brushstrokes and soft, diffused lighting to create
|
71 |
+
a cozy and intimate atmosphere.'
|
72 |
+
neg: ''
|
73 |
+
seed: 1337
|
74 |
+
walk_seed: false
|
75 |
+
guidance_scale: 4
|
76 |
+
sample_steps: 20
|
77 |
+
meta:
|
78 |
+
name: flux_1_dev_wikiart_impressionism_2000_step_style
|
79 |
+
version: '1.0'
|
flux_1_dev_wikiart_impressionism_2000_step_style.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6e9181f66d44105c2c27e5cf8c77748fd2835d98fab4e2637c8b35f269e171d4
|
3 |
+
size 171969472
|
flux_1_dev_wikiart_impressionism_2000_step_style_000000500.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f996bbdcc4452ce496e9d0845b0f504342aeddf5debb4fc06fd3455027cab63b
|
3 |
+
size 171969472
|
flux_1_dev_wikiart_impressionism_2000_step_style_000001000.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3bf2f160da4b349198e7169be05f506e728c62f4bc7dd6caf3a79a6b8e39ed44
|
3 |
+
size 171969472
|
flux_1_dev_wikiart_impressionism_2000_step_style_000001500.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0957eed0b010f798b36f501e0632fbfd5ebffb3f7be267c2560b8fe44da64398
|
3 |
+
size 171969472
|
metadata.json
ADDED
@@ -0,0 +1,86 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"base_model": "black-forest-labs/FLUX.1-dev",
|
3 |
+
"dataset": "dolphinium/wikiart-impressionism-curated",
|
4 |
+
"training_config": {
|
5 |
+
"job": "extension",
|
6 |
+
"config": {
|
7 |
+
"name": "flux_1_dev_wikiart_impressionism_2000_step_style",
|
8 |
+
"process": [
|
9 |
+
{
|
10 |
+
"type": "sd_trainer",
|
11 |
+
"training_folder": "/content/output",
|
12 |
+
"performance_log_every": 500,
|
13 |
+
"device": "cuda:0",
|
14 |
+
"trigger_word": "dolpImp",
|
15 |
+
"network": {
|
16 |
+
"type": "lora",
|
17 |
+
"linear": 16,
|
18 |
+
"linear_alpha": 16
|
19 |
+
},
|
20 |
+
"save": {
|
21 |
+
"dtype": "float16",
|
22 |
+
"save_every": 500,
|
23 |
+
"max_step_saves_to_keep": 10
|
24 |
+
},
|
25 |
+
"datasets": [
|
26 |
+
{
|
27 |
+
"folder_path": "/content/dataset",
|
28 |
+
"caption_ext": "txt",
|
29 |
+
"caption_dropout_rate": 0.05,
|
30 |
+
"shuffle_tokens": true,
|
31 |
+
"cache_latents_to_disk": true,
|
32 |
+
"resolution": [
|
33 |
+
512,
|
34 |
+
768,
|
35 |
+
1024
|
36 |
+
]
|
37 |
+
}
|
38 |
+
],
|
39 |
+
"train": {
|
40 |
+
"batch_size": 1,
|
41 |
+
"steps": 2000,
|
42 |
+
"gradient_accumulation_steps": 1,
|
43 |
+
"train_unet": true,
|
44 |
+
"train_text_encoder": false,
|
45 |
+
"content_or_style": "style",
|
46 |
+
"gradient_checkpointing": true,
|
47 |
+
"noise_scheduler": "flowmatch",
|
48 |
+
"optimizer": "adamw8bit",
|
49 |
+
"lr": 0.0001,
|
50 |
+
"ema_config": {
|
51 |
+
"use_ema": true,
|
52 |
+
"ema_decay": 0.99
|
53 |
+
},
|
54 |
+
"dtype": "bf16"
|
55 |
+
},
|
56 |
+
"model": {
|
57 |
+
"name_or_path": "black-forest-labs/FLUX.1-dev",
|
58 |
+
"is_flux": true,
|
59 |
+
"quantize": true
|
60 |
+
},
|
61 |
+
"sample": {
|
62 |
+
"sampler": "flowmatch",
|
63 |
+
"sample_every": 250,
|
64 |
+
"width": 1024,
|
65 |
+
"height": 1024,
|
66 |
+
"prompts": [
|
67 |
+
"[trigger] An impressionist painting depicts a wide, sandy beach under a cloudy sky, with figures scattered along the shore, rendered with loose, visible brushstrokes in muted tones of blue, brown, and white, creating a tranquil and airy atmosphere",
|
68 |
+
"[trigger] An impressionist portrait captures the delicate expression of a woman bathed in soft, natural light. The artist employs bold, yet subtle brushstrokes to emphasize the subject\u2019s serene features and gentle contours, all set against a background of softly blended pastel tones that evoke introspection and grace.",
|
69 |
+
"[trigger] An impressionist painting depicts a stone bridge arching over a ravine, with a church tower on the left and a hillside in the background, rendered in warm earth tones and blues with visible, textured brushstrokes, creating a hazy and tranquil atmosphere",
|
70 |
+
"[trigger] An impressionist painting of a still life featuring a bouquet of red and yellow roses wrapped in white paper, an ornate vase holding dried grasses and a decorative fan, and a stack of old books, all arranged on a table against a warm, orange-toned background with a framed picture hanging above, rendered with visible brushstrokes and soft, diffused lighting to create a cozy and intimate atmosphere."
|
71 |
+
],
|
72 |
+
"neg": "",
|
73 |
+
"seed": 1337,
|
74 |
+
"walk_seed": false,
|
75 |
+
"guidance_scale": 4,
|
76 |
+
"sample_steps": 20
|
77 |
+
}
|
78 |
+
}
|
79 |
+
]
|
80 |
+
},
|
81 |
+
"meta": {
|
82 |
+
"name": "[name]",
|
83 |
+
"version": "1.0"
|
84 |
+
}
|
85 |
+
}
|
86 |
+
}
|
optimizer.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9d2f24bc53b26ee51c48d5eb5949251c92ebf4a43c2894643b28bec40d88d1ae
|
3 |
+
size 175676612
|
samples/1743126213856__000000000_0.jpg
ADDED
![]() |
samples/1743126232276__000000000_1.jpg
ADDED
![]() |
samples/1743126250687__000000000_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743126269107__000000000_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743126850153__000000250_0.jpg
ADDED
![]() |
samples/1743126868582__000000250_1.jpg
ADDED
![]() |
samples/1743126887006__000000250_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743126905428__000000250_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743127494078__000000500_0.jpg
ADDED
![]() |
samples/1743127512507__000000500_1.jpg
ADDED
![]() |
samples/1743127530941__000000500_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743127549376__000000500_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743128151538__000000750_0.jpg
ADDED
![]() |
samples/1743128170007__000000750_1.jpg
ADDED
![]() |
samples/1743128188481__000000750_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743128206968__000000750_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743128825917__000001000_0.jpg
ADDED
![]() |
samples/1743128844394__000001000_1.jpg
ADDED
![]() |
samples/1743128862854__000001000_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743128881320__000001000_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743129478236__000001250_0.jpg
ADDED
![]() |
samples/1743129496696__000001250_1.jpg
ADDED
![]() |
samples/1743129515167__000001250_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743129533651__000001250_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743130134894__000001500_0.jpg
ADDED
![]() |
samples/1743130153352__000001500_1.jpg
ADDED
![]() |
samples/1743130171829__000001500_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743130190311__000001500_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743130799929__000001750_0.jpg
ADDED
![]() |
samples/1743130818393__000001750_1.jpg
ADDED
![]() |
samples/1743130836888__000001750_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743130855361__000001750_3.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743131461121__000002000_0.jpg
ADDED
![]() |
samples/1743131479533__000002000_1.jpg
ADDED
![]() |
samples/1743131497938__000002000_2.jpg
ADDED
![]() |
Git LFS Details
|
samples/1743131516353__000002000_3.jpg
ADDED
![]() |
Git LFS Details
|