I have Compared Kohya vs OneTrainer for FLUX Dev Finetuning / DreamBooth Training
text
I have Compared Kohya vs OneTrainer for FLUX Dev Finetuning / DreamBooth Training
new_line
new_line
OneTrainer can train FLUX Dev with Text-Encoders unlike Kohya so I wanted to try it.
text
OneTrainer can train FLUX Dev with Text-Encoders unlike Kohya so I wanted to try it.
new_line
new_line
Unfortunately, the developer doesn't want to add feature to save trained Clip L or T5 XXL as safetensors or merge them into output so basically they are useless without so much extra effort.
text
Unfortunately, the developer doesn't want to add feature to save trained Clip L or T5 XXL as safetensors or merge them into output so basically they are useless without so much extra effort.
new_line
new_line
 I still went ahead and wanted to test EMA training. EMA normally improves quality significantly in SD 1.5 training. With FLUX I have to use CPU for EMA and it was really slow but i wanted to test.
text
 I still went ahead and wanted to test EMA training. EMA normally improves quality significantly in SD 1.5 training. With FLUX I have to use CPU for EMA and it was really slow but i wanted to test.
new_line
new_line
I have tried to replicate Kohya config. The below you will see results. Sadly the quality is nothing sort of. More research has to be made and since we still don't get text-encoder training due to developer decision, I don't see any benefit of using OneTrainer for FLUX training instead of using Koha.
text
I have tried to replicate Kohya config. The below you will see results. Sadly the quality is nothing sort of. More research has to be made and since we still don't get text-encoder training due to developer decision, I don't see any benefit of using OneTrainer for FLUX training instead of using Koha.
new_line
new_line
1st image : Kohya best config : 
text
1st image : Kohya best config : 
https://www.patreon.com/posts/112099700
https://www.patreon.com/posts/112099700
link
new_line
new_line
2nd image : One Trainer Kohya config with EMA update every 1 step
text
2nd image : One Trainer Kohya config with EMA update every 1 step
new_line
new_line
3rd image : One Trainer Kohya config with EMA update every 5 steps
text
3rd image : One Trainer Kohya config with EMA update every 5 steps
new_line
new_line
4th image : One Trainer Kohya config
text
4th image : One Trainer Kohya config
new_line
new_line
5th image : One Trainer Kohya config but Timestep Shift is 1 instead of 3.1582
text
5th image : One Trainer Kohya config but Timestep Shift is 1 instead of 3.1582
new_line
new_line
I am guessing that Timestep Shift of OneTrainer is not same as Discrete Flow Shift of Kohya
text
I am guessing that Timestep Shift of OneTrainer is not same as Discrete Flow Shift of Kohya
new_line
new_line
Probably I need to work and do more test and i can improve results but i don't see any reason to do atm. If Clip Training + merging it into safetensors file was working, I was gonna pursue it
text
Probably I need to work and do more test and i can improve results but i don't see any reason to do atm. If Clip Training + merging it into safetensors file was working, I was gonna pursue it
new_line
new_line
These are not cherry pick results all are from 1st test grid
text
These are not cherry pick results all are from 1st test grid
new_line
new_line
I have Compared Kohya vs OneTrainer for FLUX Dev Finetuning / DreamBooth Training

OneTrainer can train FLUX Dev with Text-Encoders unlike Kohya so I wanted to try it.

Unfortunately, the developer doesn't want to add feature to save trained Clip L or T5 XXL as safetensors or merge them into output so basically they are useless without so much extra effort.

 I still went ahead and wanted to test EMA training. EMA normally improves quality significantly in SD 1.5 training. With FLUX I have to use CPU for EMA and it was really slow but i wanted to test.

I have tried to replicate Kohya config. The below you will see results. Sadly the quality is nothing sort of. More research has to be made and since we still don't get text-encoder training due to developer decision, I don't see any benefit of using OneTrainer for FLUX training instead of using Koha.

1st image : Kohya best config : https://www.patreon.com/posts/112099700

2nd image : One Trainer Kohya config with EMA update every 1 step

3rd image : One Trainer Kohya config with EMA update every 5 steps

4th image : One Trainer Kohya config

5th image : One Trainer Kohya config but Timestep Shift is 1 instead of 3.1582

I am guessing that Timestep Shift of OneTrainer is not same as Discrete Flow Shift of Kohya

Probably I need to work and do more test and i can improve results but i don't see any reason to do atm. If Clip Training + merging it into safetensors file was working, I was gonna pursue it

These are not cherry pick results all are from 1st test grid


🔥
MonsterMMORPG Takugen dantezxcd riokenzie on3dj Chunte cucunaga
❤️
MonsterMMORPG dantezxcd Chunte cucunaga AlkaouDembele
👀
MonsterMMORPG John6666 dantezxcd Chunte
🤗
MonsterMMORPG dantezxcd Chunte cucunaga
🚀
MonsterMMORPG dantezxcd Chunte
😎
MonsterMMORPG dantezxcd Chunte
➕
MonsterMMORPG dantezxcd Chunte
🧠
MonsterMMORPG dantezxcd Chunte
👍
MonsterMMORPG dantezxcd Chunte
🤝
MonsterMMORPG dantezxcd Chunte
🤯
MonsterMMORPG dantezxcd Chunte