dolphinium commited on
Commit
4030b56
·
verified ·
1 Parent(s): 7b05988

Upload folder using huggingface_hub

Browse files
Files changed (45) hide show
  1. .gitattributes +18 -0
  2. README.md +58 -0
  3. config.yaml +79 -0
  4. flux_1_dev_wikiart_impressionism_2000_step_style.safetensors +3 -0
  5. flux_1_dev_wikiart_impressionism_2000_step_style_000000500.safetensors +3 -0
  6. flux_1_dev_wikiart_impressionism_2000_step_style_000001000.safetensors +3 -0
  7. flux_1_dev_wikiart_impressionism_2000_step_style_000001500.safetensors +3 -0
  8. metadata.json +86 -0
  9. optimizer.pt +3 -0
  10. samples/1743126213856__000000000_0.jpg +0 -0
  11. samples/1743126232276__000000000_1.jpg +0 -0
  12. samples/1743126250687__000000000_2.jpg +3 -0
  13. samples/1743126269107__000000000_3.jpg +3 -0
  14. samples/1743126850153__000000250_0.jpg +0 -0
  15. samples/1743126868582__000000250_1.jpg +0 -0
  16. samples/1743126887006__000000250_2.jpg +3 -0
  17. samples/1743126905428__000000250_3.jpg +3 -0
  18. samples/1743127494078__000000500_0.jpg +0 -0
  19. samples/1743127512507__000000500_1.jpg +0 -0
  20. samples/1743127530941__000000500_2.jpg +3 -0
  21. samples/1743127549376__000000500_3.jpg +3 -0
  22. samples/1743128151538__000000750_0.jpg +0 -0
  23. samples/1743128170007__000000750_1.jpg +0 -0
  24. samples/1743128188481__000000750_2.jpg +3 -0
  25. samples/1743128206968__000000750_3.jpg +3 -0
  26. samples/1743128825917__000001000_0.jpg +0 -0
  27. samples/1743128844394__000001000_1.jpg +0 -0
  28. samples/1743128862854__000001000_2.jpg +3 -0
  29. samples/1743128881320__000001000_3.jpg +3 -0
  30. samples/1743129478236__000001250_0.jpg +0 -0
  31. samples/1743129496696__000001250_1.jpg +0 -0
  32. samples/1743129515167__000001250_2.jpg +3 -0
  33. samples/1743129533651__000001250_3.jpg +3 -0
  34. samples/1743130134894__000001500_0.jpg +0 -0
  35. samples/1743130153352__000001500_1.jpg +0 -0
  36. samples/1743130171829__000001500_2.jpg +3 -0
  37. samples/1743130190311__000001500_3.jpg +3 -0
  38. samples/1743130799929__000001750_0.jpg +0 -0
  39. samples/1743130818393__000001750_1.jpg +0 -0
  40. samples/1743130836888__000001750_2.jpg +3 -0
  41. samples/1743130855361__000001750_3.jpg +3 -0
  42. samples/1743131461121__000002000_0.jpg +0 -0
  43. samples/1743131479533__000002000_1.jpg +0 -0
  44. samples/1743131497938__000002000_2.jpg +3 -0
  45. samples/1743131516353__000002000_3.jpg +3 -0
.gitattributes CHANGED
@@ -33,3 +33,21 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/1743126250687__000000000_2.jpg filter=lfs diff=lfs merge=lfs -text
37
+ samples/1743126269107__000000000_3.jpg filter=lfs diff=lfs merge=lfs -text
38
+ samples/1743126887006__000000250_2.jpg filter=lfs diff=lfs merge=lfs -text
39
+ samples/1743126905428__000000250_3.jpg filter=lfs diff=lfs merge=lfs -text
40
+ samples/1743127530941__000000500_2.jpg filter=lfs diff=lfs merge=lfs -text
41
+ samples/1743127549376__000000500_3.jpg filter=lfs diff=lfs merge=lfs -text
42
+ samples/1743128188481__000000750_2.jpg filter=lfs diff=lfs merge=lfs -text
43
+ samples/1743128206968__000000750_3.jpg filter=lfs diff=lfs merge=lfs -text
44
+ samples/1743128862854__000001000_2.jpg filter=lfs diff=lfs merge=lfs -text
45
+ samples/1743128881320__000001000_3.jpg filter=lfs diff=lfs merge=lfs -text
46
+ samples/1743129515167__000001250_2.jpg filter=lfs diff=lfs merge=lfs -text
47
+ samples/1743129533651__000001250_3.jpg filter=lfs diff=lfs merge=lfs -text
48
+ samples/1743130171829__000001500_2.jpg filter=lfs diff=lfs merge=lfs -text
49
+ samples/1743130190311__000001500_3.jpg filter=lfs diff=lfs merge=lfs -text
50
+ samples/1743130836888__000001750_2.jpg filter=lfs diff=lfs merge=lfs -text
51
+ samples/1743130855361__000001750_3.jpg filter=lfs diff=lfs merge=lfs -text
52
+ samples/1743131497938__000002000_2.jpg filter=lfs diff=lfs merge=lfs -text
53
+ samples/1743131516353__000002000_3.jpg filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - flux
4
+ - stable-diffusion
5
+ - text-to-image
6
+ - lora
7
+ - flux dev
8
+ - diffusers
9
+ - impressionism
10
+ library_name: diffusers
11
+ pipeline_tag: text-to-image
12
+ base_model: black-forest-labs/FLUX.1-dev
13
+ ---
14
+
15
+ # FLUX.1-dev Impressionism fine-tuning with LoRA
16
+
17
+ This is a LoRA fine-tuning of the FLUX.1 model trained on a curated dataset of impressionist paintings from WikiArt.
18
+
19
+ ## Dataset
20
+ The model was trained on the [WikiArt Impressionism Curated Dataset](https://huggingface.co/datasets/dolphinium/wikiart-impressionism-curated), which contains 1,000 high-quality Impressionist paintings with the following distribution:
21
+
22
+ - Landscapes: 300 images (30%)
23
+ - Portraits: 300 images (30%)
24
+ - Urban Scenes: 200 images (20%)
25
+ - Still Life: 200 images (20%)
26
+
27
+ ## Model Details
28
+ - Base Model: [FLUX.1](https://huggingface.co/black-forest-labs/FLUX.1-dev)
29
+ - LoRA Rank: 16
30
+ - Training Steps: 2000
31
+ - Resolution: 512-1024px
32
+
33
+ ## Usage
34
+
35
+ ```python
36
+ from diffusers import StableDiffusionPipeline
37
+ import torch
38
+
39
+ model_id = "black-forest-labs/FLUX.1-dev"
40
+ lora_model_path = "dolphinium/FLUX.1-dev-wikiart-impressionism-v2"
41
+
42
+ pipe = StableDiffusionPipeline.from_pretrained(
43
+ model_id,
44
+ torch_dtype=torch.float16
45
+ ).to("cuda")
46
+
47
+ # Load LoRA weights
48
+ pipe.unet.load_attn_procs(lora_model_path)
49
+
50
+ # Generate image
51
+ prompt = "an impressionist style landscape with rolling hills and autumn trees"
52
+ image = pipe(prompt).images[0]
53
+ image.save("impressionist_landscape.png")
54
+ ```
55
+
56
+
57
+ ## License
58
+ This model inherits the license of the base FLUX.1 model and the WikiArt dataset.
config.yaml ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ job: extension
2
+ config:
3
+ name: flux_1_dev_wikiart_impressionism_2000_step_style
4
+ process:
5
+ - type: sd_trainer
6
+ training_folder: /content/output
7
+ performance_log_every: 500
8
+ device: cuda:0
9
+ trigger_word: dolpImp
10
+ network:
11
+ type: lora
12
+ linear: 16
13
+ linear_alpha: 16
14
+ save:
15
+ dtype: float16
16
+ save_every: 500
17
+ max_step_saves_to_keep: 10
18
+ datasets:
19
+ - folder_path: /content/dataset
20
+ caption_ext: txt
21
+ caption_dropout_rate: 0.05
22
+ shuffle_tokens: true
23
+ cache_latents_to_disk: true
24
+ resolution:
25
+ - 512
26
+ - 768
27
+ - 1024
28
+ train:
29
+ batch_size: 1
30
+ steps: 2000
31
+ gradient_accumulation_steps: 1
32
+ train_unet: true
33
+ train_text_encoder: false
34
+ content_or_style: style
35
+ gradient_checkpointing: true
36
+ noise_scheduler: flowmatch
37
+ optimizer: adamw8bit
38
+ lr: 0.0001
39
+ ema_config:
40
+ use_ema: true
41
+ ema_decay: 0.99
42
+ dtype: bf16
43
+ model:
44
+ name_or_path: black-forest-labs/FLUX.1-dev
45
+ is_flux: true
46
+ quantize: true
47
+ sample:
48
+ sampler: flowmatch
49
+ sample_every: 250
50
+ width: 1024
51
+ height: 1024
52
+ prompts:
53
+ - '[trigger] An impressionist painting depicts a wide, sandy beach under a cloudy
54
+ sky, with figures scattered along the shore, rendered with loose, visible
55
+ brushstrokes in muted tones of blue, brown, and white, creating a tranquil
56
+ and airy atmosphere'
57
+ - "[trigger] An impressionist portrait captures the delicate expression of a\
58
+ \ woman bathed in soft, natural light. The artist employs bold, yet subtle\
59
+ \ brushstrokes to emphasize the subject\u2019s serene features and gentle\
60
+ \ contours, all set against a background of softly blended pastel tones that\
61
+ \ evoke introspection and grace."
62
+ - '[trigger] An impressionist painting depicts a stone bridge arching over a
63
+ ravine, with a church tower on the left and a hillside in the background,
64
+ rendered in warm earth tones and blues with visible, textured brushstrokes,
65
+ creating a hazy and tranquil atmosphere'
66
+ - '[trigger] An impressionist painting of a still life featuring a bouquet of
67
+ red and yellow roses wrapped in white paper, an ornate vase holding dried
68
+ grasses and a decorative fan, and a stack of old books, all arranged on a
69
+ table against a warm, orange-toned background with a framed picture hanging
70
+ above, rendered with visible brushstrokes and soft, diffused lighting to create
71
+ a cozy and intimate atmosphere.'
72
+ neg: ''
73
+ seed: 1337
74
+ walk_seed: false
75
+ guidance_scale: 4
76
+ sample_steps: 20
77
+ meta:
78
+ name: flux_1_dev_wikiart_impressionism_2000_step_style
79
+ version: '1.0'
flux_1_dev_wikiart_impressionism_2000_step_style.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e9181f66d44105c2c27e5cf8c77748fd2835d98fab4e2637c8b35f269e171d4
3
+ size 171969472
flux_1_dev_wikiart_impressionism_2000_step_style_000000500.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f996bbdcc4452ce496e9d0845b0f504342aeddf5debb4fc06fd3455027cab63b
3
+ size 171969472
flux_1_dev_wikiart_impressionism_2000_step_style_000001000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bf2f160da4b349198e7169be05f506e728c62f4bc7dd6caf3a79a6b8e39ed44
3
+ size 171969472
flux_1_dev_wikiart_impressionism_2000_step_style_000001500.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0957eed0b010f798b36f501e0632fbfd5ebffb3f7be267c2560b8fe44da64398
3
+ size 171969472
metadata.json ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "base_model": "black-forest-labs/FLUX.1-dev",
3
+ "dataset": "dolphinium/wikiart-impressionism-curated",
4
+ "training_config": {
5
+ "job": "extension",
6
+ "config": {
7
+ "name": "flux_1_dev_wikiart_impressionism_2000_step_style",
8
+ "process": [
9
+ {
10
+ "type": "sd_trainer",
11
+ "training_folder": "/content/output",
12
+ "performance_log_every": 500,
13
+ "device": "cuda:0",
14
+ "trigger_word": "dolpImp",
15
+ "network": {
16
+ "type": "lora",
17
+ "linear": 16,
18
+ "linear_alpha": 16
19
+ },
20
+ "save": {
21
+ "dtype": "float16",
22
+ "save_every": 500,
23
+ "max_step_saves_to_keep": 10
24
+ },
25
+ "datasets": [
26
+ {
27
+ "folder_path": "/content/dataset",
28
+ "caption_ext": "txt",
29
+ "caption_dropout_rate": 0.05,
30
+ "shuffle_tokens": true,
31
+ "cache_latents_to_disk": true,
32
+ "resolution": [
33
+ 512,
34
+ 768,
35
+ 1024
36
+ ]
37
+ }
38
+ ],
39
+ "train": {
40
+ "batch_size": 1,
41
+ "steps": 2000,
42
+ "gradient_accumulation_steps": 1,
43
+ "train_unet": true,
44
+ "train_text_encoder": false,
45
+ "content_or_style": "style",
46
+ "gradient_checkpointing": true,
47
+ "noise_scheduler": "flowmatch",
48
+ "optimizer": "adamw8bit",
49
+ "lr": 0.0001,
50
+ "ema_config": {
51
+ "use_ema": true,
52
+ "ema_decay": 0.99
53
+ },
54
+ "dtype": "bf16"
55
+ },
56
+ "model": {
57
+ "name_or_path": "black-forest-labs/FLUX.1-dev",
58
+ "is_flux": true,
59
+ "quantize": true
60
+ },
61
+ "sample": {
62
+ "sampler": "flowmatch",
63
+ "sample_every": 250,
64
+ "width": 1024,
65
+ "height": 1024,
66
+ "prompts": [
67
+ "[trigger] An impressionist painting depicts a wide, sandy beach under a cloudy sky, with figures scattered along the shore, rendered with loose, visible brushstrokes in muted tones of blue, brown, and white, creating a tranquil and airy atmosphere",
68
+ "[trigger] An impressionist portrait captures the delicate expression of a woman bathed in soft, natural light. The artist employs bold, yet subtle brushstrokes to emphasize the subject\u2019s serene features and gentle contours, all set against a background of softly blended pastel tones that evoke introspection and grace.",
69
+ "[trigger] An impressionist painting depicts a stone bridge arching over a ravine, with a church tower on the left and a hillside in the background, rendered in warm earth tones and blues with visible, textured brushstrokes, creating a hazy and tranquil atmosphere",
70
+ "[trigger] An impressionist painting of a still life featuring a bouquet of red and yellow roses wrapped in white paper, an ornate vase holding dried grasses and a decorative fan, and a stack of old books, all arranged on a table against a warm, orange-toned background with a framed picture hanging above, rendered with visible brushstrokes and soft, diffused lighting to create a cozy and intimate atmosphere."
71
+ ],
72
+ "neg": "",
73
+ "seed": 1337,
74
+ "walk_seed": false,
75
+ "guidance_scale": 4,
76
+ "sample_steps": 20
77
+ }
78
+ }
79
+ ]
80
+ },
81
+ "meta": {
82
+ "name": "[name]",
83
+ "version": "1.0"
84
+ }
85
+ }
86
+ }
optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d2f24bc53b26ee51c48d5eb5949251c92ebf4a43c2894643b28bec40d88d1ae
3
+ size 175676612
samples/1743126213856__000000000_0.jpg ADDED
samples/1743126232276__000000000_1.jpg ADDED
samples/1743126250687__000000000_2.jpg ADDED

Git LFS Details

  • SHA256: 3f0f53786c40f5a09e54e0229ab4aa497b813f0aca82299c5841d2dbdb43c01e
  • Pointer size: 131 Bytes
  • Size of remote file: 150 kB
samples/1743126269107__000000000_3.jpg ADDED

Git LFS Details

  • SHA256: fae2509f14fc77830026b055f99db0ebb52c17c40e33da006e8d257c1821468e
  • Pointer size: 131 Bytes
  • Size of remote file: 159 kB
samples/1743126850153__000000250_0.jpg ADDED
samples/1743126868582__000000250_1.jpg ADDED
samples/1743126887006__000000250_2.jpg ADDED

Git LFS Details

  • SHA256: 1ce28d774aa9c00a27aa28e28eecf6cc0ac83f2ac45bbfbcdfebf04d339b254c
  • Pointer size: 131 Bytes
  • Size of remote file: 172 kB
samples/1743126905428__000000250_3.jpg ADDED

Git LFS Details

  • SHA256: 3187bd67657dad53eaf55ff0a09cfef06d946a694d134a51670d8bc699fd26d9
  • Pointer size: 131 Bytes
  • Size of remote file: 170 kB
samples/1743127494078__000000500_0.jpg ADDED
samples/1743127512507__000000500_1.jpg ADDED
samples/1743127530941__000000500_2.jpg ADDED

Git LFS Details

  • SHA256: b82db24dd7458ea531cb17e7a4d19de8e49d4e86c50aaa6f013a27011d163e38
  • Pointer size: 131 Bytes
  • Size of remote file: 177 kB
samples/1743127549376__000000500_3.jpg ADDED

Git LFS Details

  • SHA256: 12714c9f80e8c0ed6818fda4b436bb8401447d1638ee4280d514fe68305c1929
  • Pointer size: 131 Bytes
  • Size of remote file: 160 kB
samples/1743128151538__000000750_0.jpg ADDED
samples/1743128170007__000000750_1.jpg ADDED
samples/1743128188481__000000750_2.jpg ADDED

Git LFS Details

  • SHA256: c3ac5068ead9c77afabae941e08702e1aa62b9d3b571e3b619d5785d101096c8
  • Pointer size: 131 Bytes
  • Size of remote file: 181 kB
samples/1743128206968__000000750_3.jpg ADDED

Git LFS Details

  • SHA256: 3655c94d6d6c1d6c19807247244b2798e1d315f0d23ff22ec395bba0255b33d2
  • Pointer size: 131 Bytes
  • Size of remote file: 159 kB
samples/1743128825917__000001000_0.jpg ADDED
samples/1743128844394__000001000_1.jpg ADDED
samples/1743128862854__000001000_2.jpg ADDED

Git LFS Details

  • SHA256: f3f36d2cb7cac2c6207b2b00ef50dea4d0d2b5062b45a43a17be238c607a8bdc
  • Pointer size: 131 Bytes
  • Size of remote file: 197 kB
samples/1743128881320__000001000_3.jpg ADDED

Git LFS Details

  • SHA256: fca4630b53d8033c8772f5f3493e5d3a74a362f21201ae0e84f8fda2f583b151
  • Pointer size: 131 Bytes
  • Size of remote file: 166 kB
samples/1743129478236__000001250_0.jpg ADDED
samples/1743129496696__000001250_1.jpg ADDED
samples/1743129515167__000001250_2.jpg ADDED

Git LFS Details

  • SHA256: fd1e0b680288e8816186626a442915a954ea974aee36ea9eb68aa078d66b4cfb
  • Pointer size: 131 Bytes
  • Size of remote file: 227 kB
samples/1743129533651__000001250_3.jpg ADDED

Git LFS Details

  • SHA256: 40e05e99b63382539f5004c552d16d18e180f1be8a85176d29204bba35b35e94
  • Pointer size: 131 Bytes
  • Size of remote file: 167 kB
samples/1743130134894__000001500_0.jpg ADDED
samples/1743130153352__000001500_1.jpg ADDED
samples/1743130171829__000001500_2.jpg ADDED

Git LFS Details

  • SHA256: 2edac7ff77da8a2fac377d1c3be080f66c6c4593766d43f97086a52d581866b6
  • Pointer size: 131 Bytes
  • Size of remote file: 213 kB
samples/1743130190311__000001500_3.jpg ADDED

Git LFS Details

  • SHA256: 62d85711cd319f2c6a9c2ee574a4d67deaf8d8fd037c300d19f2b26f62b1828c
  • Pointer size: 131 Bytes
  • Size of remote file: 160 kB
samples/1743130799929__000001750_0.jpg ADDED
samples/1743130818393__000001750_1.jpg ADDED
samples/1743130836888__000001750_2.jpg ADDED

Git LFS Details

  • SHA256: 5960d11c437c61c3719f8cda1a3b5bc06605dbd18187f93b1ca30366bc332585
  • Pointer size: 131 Bytes
  • Size of remote file: 239 kB
samples/1743130855361__000001750_3.jpg ADDED

Git LFS Details

  • SHA256: 04bed696099fb2b1fdea0bc8f44e3d4b0854b80adfdc089f61c15ef79ba7a7b6
  • Pointer size: 131 Bytes
  • Size of remote file: 167 kB
samples/1743131461121__000002000_0.jpg ADDED
samples/1743131479533__000002000_1.jpg ADDED
samples/1743131497938__000002000_2.jpg ADDED

Git LFS Details

  • SHA256: 997686f86c6f38e3582c45cb41efad91bdff6248e88d65cda49710f5591be7b6
  • Pointer size: 131 Bytes
  • Size of remote file: 236 kB
samples/1743131516353__000002000_3.jpg ADDED

Git LFS Details

  • SHA256: 900aff9989a322e93542d0a3ab43bbbb768e47b557fc507fe435656196c2bcd5
  • Pointer size: 131 Bytes
  • Size of remote file: 168 kB