<p>This is a LoRA of the internet celebrity Belle Delphine for Pony Diffusion v6.</p><p> </p><p>Trigger word: “<strong><em>Belle Delphine</em></strong>”.</p><p></p><p>Suggested LoRA weight: Depending on the style you want 0.4 – 1.0.</p><p>The model is relatively flexible considering both prompting and using in other finetunes based on Pony Diffusion.</p><p> </p><p>Relevant additional tags might be:</p><ul><li><p>“focused eyes” – Large open eyes</p></li><li><p>“braces” – Should be self explanatory</p></li><li><p>“snapchat” – If images were from snapchat, they were tagged, as these images have a lower quality and the text artifacts</p><p></p></li></ul><p>Should people be interested in some other tags (although their accuracy / reproduction varies), I might also share them. They mostly relate to clothing.</p><p> </p><p>Images were generated in SD.Next and should include metadata. I ran ADetailer for some of them, however it isn’t always a necessity (depending on the prompt and used model).</p><p> </p><h2 id="training-hl4tuvi26">Training</h2><p> </p><p>As always, I will add a little bit about the training.</p><p> </p><p>I curated a new dataset for SD3, however as training tools aren’t up to date yet, I decided to give it a run on Pony Diffusion, as I already have a base SDXL and SD 1.5 model.</p><p> </p><p>The model you see here is not the first iteration. My initial trial was trained on the zonkey model, and it had impressive (accurate) results, however prompting was very brittle, for example if you left out “Belle Delphine” you would just get complete white noise. No idea how that happened. Also, it didn’t work at all with external LoRAs or on other models. (The training of that trial was with kohya, masked loss, DoRA).</p><p> </p><p>So, when SD3 released and it didn’t look that special, I decided to retrain the dataset, this time on the Pony Diffusion base model hoping for more flexibility. I also switched to OneTrainer (which I already used to generate the initial masks).</p><p> </p><p>The LoRA was trained on all images I could find (so quite many - in the low 5 digits). In addition to that, I created masks for the images in an automated fashion. I then tagged all images with wd-swinv2-tagger-v3 by SmilingWolf. For the SD3 dataset, I also labelled all images with several captions using a custom multimodal LLM workflow. (Sidenote: This took longer than training the LoRAs).</p><p> </p><p>Then once again using a custom workflow, I clustered the created images based on their contents and added tags to those clusters.</p><p> </p><p>I finally took all of this data, and trained it in OneTrainer with a random mixture of booru tags and natural language prompts.</p><p>Relevant training parameters:</p><ul><li><p>Prodigy optimizer</p></li><li><p>18 epochs @ 4480 steps</p></li><li><p>No image repeats (after all I had sufficiently many)</p></li><li><p>Batch size 4</p></li><li><p>Using image masks, with unmasked probability of 0.03, unmasked weight 0.02 (which causes the occasional watermark bleed through)</p></li><li><p>1024 resolution with aspect bucketing</p></li><li><p>LoRA rank 96, alpha 2 (later resized to target 64, with sv_fro 0.98)</p></li></ul><p> </p><p>Training was done for about 48 hours on a RTX 4090.</p><p> </p><p>If you have any additional questions feel free to ask. However, I used tons of custom- and purpose-built code here, and this is probably nothing I will share. However, I can give you some pointers should you be interested in doing something similar.</p><p> </p><h2 id="disclaimer-3ud6i9ws9">Disclaimer</h2><p> </p><p>I want to highlight again that this model is non-commercial, and you should only post images on CivitAI which follow the Content Rules.</p><p></p><p>Users are solely responsible for the content they generate using this LoRA. It is the user’s responsibility to ensure that their usage of this model adheres to all applicable local, state, national and international laws. I do not endorse any user-generated content and expressly disclaim any and all liability in connection with user generations.</p>
Public
Pony
https://civitai.com/api/download/models/575881
true
https://civitai.com/api/download/models/575881
E7040AA8
ADA6183EBB
489B9548B6D7
B9F99960D892BEFE8DD7F42D56BF7530D6D18F123DDE9873035D5D7D685F1E9F
B550BF9F
ADA6183EBBF6C0C249A2A2653D91DDB12669FE6071054A3800242FCC9DC4F94F
SafeTensor
DI_Belle_Delphine_pony.safetensors
No Pickle imports
Success
2024-06-16T03:31:45.963Z
Model
Success
UBG%ih~C0hOFL0S#57s;0zRjsRxaeUMxv}M{
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/3cc30568-dfd3-454c-83ff-b966ef61666d/width=450/15959634.jpeg
UPJHwNxu%$X:~CI@PCI;D#Vrogt7K8E3rqbI
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/373e1bae-8001-416b-8644-9e901ceec09a/width=450/15959739.jpeg
UGHoI8%MOZx^{{s:%#jFPBWqRPR*pxoKibj?
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/ae4ba117-5a2f-4288-96e8-7882f26d702e/width=450/15959746.jpeg
UAA^j{RP0e?H4m%NxabbuPITvfSg={%hE2xa
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4b961d8f-745b-47b2-9d41-fdfc21418b9c/width=450/15959752.jpeg
UXI}hlRiEMxZ~Woz%La~NukD$ga}.8RPIUsm
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5c253b76-5323-4805-b6a8-f9c627a2f697/width=450/15959758.jpeg
UVHUqS-:~qkBn#X9M{%MIpoLV?bHxuaeWVIo
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/23209c51-6479-4830-afc2-2aaeed43cd7f/width=450/15959769.jpeg
URI5b|~VNdspibI=tlVsShRPxbNK%$xurrR+
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b76259ea-3f35-414c-8d7c-ca9d5e54f754/width=450/15959794.jpeg
U6BMJR~B0001nTEMEK^iE2ae%1t7Fvxt=e9a
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1aa837ac-d85e-47ce-8403-1a3be824a3cc/width=450/15959795.jpeg
UAIf_E%#0}S~-;%2}@tRMJR+vgRP+vMx0fo|
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f5332549-f6d1-44be-955d-def84d94e14c/width=450/15959815.jpeg
UFE2|Ls,_3IU~qoJtljaE2D*IV%34nWrRPoz
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5d1bce27-d508-4621-b8f2-c665fe96e41f/width=450/15959933.jpeg
UMKme4M}67^+~VxvxuxaEyaJ=xD%tl9ZRjRj
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/05e24002-4130-4dbb-ab87-a04c49a9a528/width=450/15959967.jpeg
UNCZ^bV@.Stl_NRitRtRgORjR5t7tRozVst7
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/191f1995-0a99-48da-b1ef-66b335506c5f/width=450/15960002.jpeg
UFIDwJI-0K~W00RlS~k90x$*MxIo%M-:eTIV
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/0cdf2bc6-eb5f-48ef-b662-dc01c8f3c95e/width=450/15960039.jpeg
UDCF;e9ZV@tR~WIoozxuRjt7WYt7ELxtwcWW
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a8338603-12e7-48b0-becb-f0277de4c853/width=450/15960046.jpeg
UBHUti-:0ewN~WD%E2IAK+MKH=TI9]-;ZNNF
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/c71d76c8-ec9f-4cd3-9269-7e65309558db/width=450/15960108.jpeg
UII#Gh?F~Vt6_N%1E0f5EToME3M|-=$%xaxu
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/93d0d97e-4e4b-43bc-97ed-6d7e824f033a/width=450/15960141.jpeg
UKJaG_9F^j-;}@xZ%M%1NeS%%MWE-:aKr?Io
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/3e1b62bd-0d91-4627-bbc2-42b3ee1c70af/width=450/15960192.jpeg
UaL|lv%M*0xu%hbHs,jYNfWBi^kD%2axR+a}
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b79d635f-7eb2-4383-b7dc-22563430850e/width=450/15960207.jpeg
UMGH|~t59Fxb~U%1D*R-=_jIIrI:MyRkNItQ
image
https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/725c424f-dea1-4d6b-89ac-37bbd735014f/width=450/15960320.jpeg
v1.0
2024-06-16T03:41:03.404Z
Belle Delphine
Belle Delphine - Pony
celebrity