description: <h1 id="full-training-tutorial-and-guide-and-research-for-a-flux-style-4w5sbd66q"><strong>Full Training Tutorial and Guide and Research For a FLUX Style</strong></h1><p><strong>Hugging Face repo with all full workflow, full research details, processes, conclusions, checkpoints,comparisons, prompts and more details &gt; </strong><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX"><strong>https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX</strong></a></p><p><strong>Trigger word : ohwx 3d render</strong></p><p>This is a training of a public LoRA style (4 separate training each on 4x A6000).</p><p>Experimenting captions vs non-captions. So we will see which yields best results for style training on FLUX.</p><p>Generated captions with multi-GPU batch Joycaption app.</p><h1 id="i-used-my-multi-gpu-joycaption-app-(used-8x-a6000-for-ultra-fast-captioning)-g5wzj0tjo">I used my multi-GPU Joycaption APP (used 8x A6000 for ultra fast captioning)</h1><h1 id="https:www.patreon.composts110613301-ebdssj79y"><a target="_blank" rel="ugc" href="https://www.patreon.com/posts/110613301">https://www.patreon.com/posts/110613301</a></h1><p><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/LTfUYHXCpcwzt3_us0R26.png" alt="Joycaption examples" /></p><h1 id="i-used-my-gradio-batch-caption-editor-to-edit-some-words-and-add-activation-token-as-ohwx-3d-render-d5aka8nub">I used my Gradio batch caption editor to edit some words and add activation token as ohwx 3d render</h1><h1 id="https:www.patreon.composts108992085-pyzfsk2cj"><a target="_blank" rel="ugc" href="https://www.patreon.com/posts/108992085">https://www.patreon.com/posts/108992085</a></h1><p><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/BleDJpEMrCMXXRTCPKJqb.png" alt="Gradio batch caption editor" /></p><p>The no caption dataset uses only ohwx 3d render as caption</p><h1 id="i-am-using-my-newest-4x_gpu_rank_1_slow_better_quality.json-on-4x-a6000-gpu-and-train-500-epochs-114-images-0wx0ajwn6">I am using my newest 4x_GPU_Rank_1_SLOW_Better_Quality.json on 4X A6000 GPU and train 500 epochs - 114 images</h1><h1 id="https:www.patreon.composts110879657-oyv5pjkk6"><a target="_blank" rel="ugc" href="https://www.patreon.com/posts/110879657">https://www.patreon.com/posts/110879657</a></h1><p><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/jK75d8i1x5hAHSYSsJNBd.png" alt="Training configuration" /></p><p>All trainings are saved as Float and 128 LoRA rank thus they are above 2GB per checkpoint</p><h2 id="inconsistent-dataset-training-n60cplq65">Inconsistent Dataset Training</h2><p>This is the first training I made with the below dataset</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Inconsistent-Training-Dataset-Images-Grid.jpg"><strong><u>Inconsistent-Training-Dataset-Images-Grid.jpg</u></strong></a></p><p>When you pay attention to the grid image above shared, you will see that the dataset is not consistent</p><p>The training dataset with used captions (only for With Captions training) can be see in below directory</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/tree/main/Training-Dataset"><strong><u>Training-Dataset</u></strong></a></p><p>It has total 114 images</p><p>This training total step count was 500 * 114 / 4 (4x GPU - batch size 1) = 14250 steps</p><p>It took like 37 hours on 4x RTX A6000 GPU with slow config - faster config would take like half</p><p>There were 2 trainings made with this dataset. Epoch 500 checkpoints are named as below</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/SECourses_Style_Inconsistent_DATASET_NO_Captions.safetensors"><strong><u>SECourses_Style_Inconsistent_DATASET_NO_Captions.safetensors</u></strong></a> <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/SECourses_Style_Inconsistent_DATASET_With_Captions.safetensors"><strong><u>SECourses_Style_Inconsistent_DATASET_With_Captions.safetensors</u></strong></a></p><p>Their checkpoints are saved in below folders</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/tree/main/Training-Checkpoints-NO-Captions"><strong><u>Training-Checkpoints-NO-Captions</u></strong></a> <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/tree/main/Training-Checkpoints-With-Captions"><strong><u>Training-Checkpoints-With-Captions</u></strong></a></p><p>Its grid results are shared below</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Inconsistent-Training-Dataset-Results-Grid-26100x23700px.jpg"><strong><u>Inconsistent-Training-Dataset-Results-Grid-26100x23700px.jpg</u></strong></a></p><p>When you pay attention to above image you will see that it has inconsistent results</p><h2 id="consistent-dataset-training-ivfighz98">Consistent Dataset Training</h2><p>After I noticed that the initial training dataset was inconsistent i have pruned the dataset and made it much more consistent</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Fixed-Consistent-Training-Dataset-Images-Grid.jpg"><strong><u>Fixed-Consistent-Training-Dataset-Images-Grid.jpg</u></strong></a></p><p>When you pay attention to the grid image above shared, you will see that is way more consistent, still not perfect though</p><p>Now it has total 66 images</p><p>The training dataset with used captions for this training (only for With Captions training) can be see in below directory</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/tree/main/Fixed-Consistent-Training-Dataset"><strong><u>Fixed-Consistent-Training-Dataset</u></strong></a></p><p>This training total step count was 500 * 66 / 4 (4x GPU - batch size 1) = 8250 steps</p><p>It took like 24 hours on 4x RTX A6000 GPU with slow config - faster config would take like half</p><p>There were 2 trainings made with this dataset. Epoch 500 checkpoints are named as below</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/SECourses_3D_Render_Style_Fixed_Dataset_NO_Captions.safetensors"><strong><u>SECourses_3D_Render_Style_Fixed_Dataset_NO_Captions.safetensors</u></strong></a> <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/SECourses_3D_Render_Style_Fixed_Dataset_With_Captions.safetensors"><strong><u>SECourses_3D_Render_Style_Fixed_Dataset_With_Captions.safetensors</u></strong></a></p><p>Their checkpoints are saved in below folders</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/tree/main/Training-Checkpoints-Fixed-DATASET-NO-Captions"><strong><u>Training-Checkpoints-Fixed-DATASET-NO-Captions</u></strong></a> <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/tree/main/Training-Checkpoints-Fixed-DATASET-With-Captions"><strong><u>Training-Checkpoints-Fixed-DATASET-With-Captions</u></strong></a></p><p>Its grid results are shared below - this one includes results from inconsistent dataset as well</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Fixed-Consistent-Training-Dataset-Results-Grid-50700x15500px.jpg"><strong><u>Fixed-Consistent-Training-Dataset-Results-Grid-50700x15500px.jpg</u></strong></a></p><p>When you pay attention to above image you will see now it is way more consistent</p><h1 id="best-checkpoint-and-conclusion-36gzrmzd3">Best Checkpoint And Conclusion</h1><p>When inconsistent dataset was used, training with captions yielded way better results.</p><p>However, when training made with a consistent dataset, no captions yielded better and more consistent results with early epochs.</p><p>Thus I concluded that, epoch 75 of no-captions dataset is best checkpoint</p><p>Here below comparison images for fixed dataset</p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Fixed-Consistent-Training-Dataset-No-Captions-Only-Grid.jpg"><strong><u>Fixed-Consistent-Training-Dataset-No-Captions-Only-Grid.jpg</u></strong></a></p><p><a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Fixed-Consistent-Training-Dataset-With-Captions-Only-Grid.jpg"><strong><u>Fixed-Consistent-Training-Dataset-With-Captions-Only-Grid.jpg</u></strong></a></p><p>Best checkpoint download link : <a target="_blank" rel="ugc" href="https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Training-Checkpoints-Fixed-DATASET-NO-Captions/SECourses_3D_Render_Style_Fixed_Dataset_NO_Captions-000075.safetensors"><strong><u>Training-Checkpoints-Fixed-DATASET-NO-Captions/SECourses_3D_Render_Style_Fixed_Dataset_NO_Captions-000075.safetensors</u></strong></a></p><p>75 checkpoints is equal to 75 * 66 / 4 = 1238 steps</p><h1 id="tutorials-to-train-your-style-w218z4593">Tutorials To Train Your Style</h1><p>1 : <a target="_blank" rel="ugc" href="https://youtu.be/bupRePUOA18"><strong><u>https://youtu.be/bupRePUOA18</u></strong></a></p><h3 id="flux:-the-first-ever-open-source-txt2img-model-truly-beats-midjourney-and-others-flux-is-awaited-sd3-kngktgkwu"><strong>FLUX: The First Ever Open Source txt2img Model Truly Beats Midjourney &amp; Others - FLUX is Awaited SD3</strong></h3><p><a target="_blank" rel="ugc" href="https://youtu.be/bupRePUOA18"><strong><u><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/dguyYoaghc8IVdBrKMDkl.png" alt="image" /></u></strong></a></p><p>2 : <a target="_blank" rel="ugc" href="https://youtu.be/nySGu12Y05k"><strong><u>https://youtu.be/nySGu12Y05k</u></strong></a></p><h3 id="flux-lora-training-simplified:-from-zero-to-hero-with-kohya-ss-gui-(8gb-gpu-windows)-tutorial-guide-5d7jhk58d"><strong>FLUX LoRA Training Simplified: From Zero to Hero with Kohya SS GUI (8GB GPU, Windows) Tutorial Guide</strong></h3><p><a target="_blank" rel="ugc" href="https://youtu.be/nySGu12Y05k"><strong><u><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/5oeVl6mmaRyYZkxuXSShm.png" alt="image" /></u></strong></a></p><p>3 : <a target="_blank" rel="ugc" href="https://youtu.be/-uhL2nW7Ddw"><strong><u>https://youtu.be/-uhL2nW7Ddw</u></strong></a></p><h3 id="blazing-fast-and-ultra-cheap-flux-lora-training-on-massed-compute-and-runpod-tutorial-no-gpu-required!-vytgup0en"><strong>Blazing Fast &amp; Ultra Cheap FLUX LoRA Training on Massed Compute &amp; RunPod Tutorial - No GPU Required!</strong></h3><p><a target="_blank" rel="ugc" href="https://youtu.be/-uhL2nW7Ddw"><strong><u><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/hPBegzqT2A52hrveI7buf.png" alt="image" /></u></strong></a></p><p>The dataset can't be used commercially</p><p><img src="https://cdn-uploads.huggingface.co/production/uploads/6345bd89fe134dfd7a0dba40/7ZFz_ZW53ipp8LHYuPPSg.png" alt="Training progress" /></p>
modelVersions.availability: Public
modelVersions.baseModel: Flux.1 D
modelVersions.downloadUrl: https://civitai.com/api/download/models/817828
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/817828
modelVersions.AutoV1: A7AF2298
modelVersions.AutoV2: 1819369596
modelVersions.AutoV3: 435E68D6DEC8
modelVersions.BLAKE3: 862234197A90402325CB4557DE8A4A1E79EC030890B2AC4B4D43F0B42504FD62
modelVersions.CRC32: 293CC6EA
modelVersions.SHA256: 18193695966B7900C0AEA09D80AAB7896FFCCD2B56CCFA72E52C8B56BDF16902
modelVersions.format: SafeTensor
modelVersions.name: SECourses_3D_Render_Style_Fixed_Dataset_NO_Captions-000075.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-09-07T22:46:51.262Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UFR2-{ERK5Vy?wM|S~MxyFM{SzRR~Ct7buo#
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/230c03b9-d389-49ca-b4a9-80862020ec60/width=450/28273431.jpeg
modelVersions.hash: UGRe{gEkJBRB_3WoS#MeyZMxNZWE^+tSkptQ
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b4621ab7-c779-4f6f-ae34-17c377d07551/width=450/28273433.jpeg
modelVersions.hash: UuQltQNHR-e?-;ogX7V[.TV[W;f+MyWBkCbI
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/67a0e15f-d8fd-43e5-9511-4113a72ede2c/width=450/28273426.jpeg
modelVersions.hash: UBSY?bNeE#no-rNeJ,ICRVozS~IV~Wa{kpsp
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/fbce572d-2dea-4bd3-b6fd-e23bf4edf8a1/width=450/28273425.jpeg
modelVersions.hash: UYPin.NINbM~^-bbX7ofysRjX8WAo}jYbZRQ
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/26496e0b-990e-4fb7-9ae0-81252a2aa2c8/width=450/28273441.jpeg
modelVersions.hash: UlRClJS$WBV[%2X8Woah?^jESzj]a#RjbbRj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f015f2fb-89ae-4ef6-8f86-82b2e2c0ed39/width=450/28273432.jpeg
modelVersions.hash: USQv5rJBNbRo*0WBX7i{caRQX8jr#7kDX7Rk
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1b2eacb1-82ec-4d12-b2fe-bffac30f73e6/width=450/28273434.jpeg
modelVersions.hash: UURVX.IoNHnn=}ofX8M|cuNGS1og.9kWoyjF
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/96c7a48e-f321-4e0f-b884-b866e3fa49d3/width=450/28273435.jpeg
modelVersions.hash: ULRLw$JBOXni?cV@XSMe*0RjXSV[?bozX7kX
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6341106d-6af6-4dc2-a870-bf4c51e79464/width=450/28273437.jpeg
modelVersions.hash: UaRCA4S$SNVtz=S3SgV].mV@X7kD.SofkBV[
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d40f07ba-f8d8-46b0-9c49-20c92a454b93/width=450/28273436.jpeg
modelVersions.hash: UIRyjJ9aJA-pV|NHXRxwN2IoSgRk~WoekVMx
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/3b665f12-f450-4839-a5a0-ae51654c8d70/width=450/28273438.jpeg
modelVersions.hash: UEQJ7hELEgM+~qNIOXM}%$NGS}i|-=j?bunj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/083b4e7d-7820-4671-bbd8-e330cbbf265c/width=450/28273439.jpeg
modelVersions.hash: UZQ]c-S$Rkxa?bW:t6nO.TR*WVo2H@bbWBkC
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9b96792e-27a1-4699-8d14-438ab3cee945/width=450/28273440.jpeg
modelVersions.hash: UzO:6ANwNHr@%NbHazjb?wj@oKj[jdW;ofoJ
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/fbecd4fa-af4d-4a15-90d2-69649823f187/width=450/28273942.jpeg
modelVersions.name: v1.0
modelVersions.publishedAt: 2024-09-07T22:54:25.460Z
modelVersions.trainedWords:  ohwx 3d render
name: SECourses 3D Render for FLUX - Full Dataset and Workflow Shared
tags: 3d render 3d render style