description: <h3 id="initial-test-of-my-fursuit-head-lora-for-pony-trained-locally-on-windows-11-on-a-3090-using-ai-toolkit.-b2szlya3c">Initial test of my <a rel="ugc" href="https://civitai.com/models/536317/fursuit-head-lora-for-ponyxl">Fursuit Head LoRA for Pony</a>, trained locally on Windows 11 on a 3090 using <a rel="ugc" href="https://github.com/ostris/ai-toolkit">AI-Toolkit</a>.</h3><p></p><p>Training converged after around 4-5 hours. After about 4000 steps with gradient accumulations steps set to 2 image quality began to rapidly degrade. Checkpoints were saved in 1000 step increments, though it seems 3500 steps might have produced better results than 3000 or 4000 steps, so I will keep this in mind for future iterations.</p><p>Dataset is largely the same as the dataset used for the Pony LoRA with a couple of additions and removals. Images were automatically captioned using XComposer2 4KHD and then manually modified for precision. Around 20% of the dataset was made up of regularization images consisting of people and animals of various kinds, styles, and in various situations which I generated with FLUX directly within ComfyUI, saving the prompt used directly alongside the image.</p><p>Surprised by how well this first test has turned out. Increasing the size of the dataset, increasing the ratio of regularization images, and decreasing the checkpoint saving interval should allow for even higher quality iterations, so stay tuned!</p><p></p><h3 id="recommended-parameters-61xmqgbd4">Recommended Parameters</h3><p><strong>LoRA Weight:</strong> </p><p>0.8 - 0.9</p><p><strong>Trigger Word:</strong> </p><p>Fursuit Head (See example images for prompts)</p><p></p><h3 id="other-notes-br5t63i48">Other Notes</h3><ul><li><p>Example images were generated with dev using default model weights and FP16 T5. Cannot guarantee similar quality at FP8 or NF4, but I would love to see how your tests turn out</p></li><li><p>Using the Realism LoRA tends to improve image quality and background elements for realistic generations, but can make the fursuit heads look more like real animals than actual fursuits. This might be preferable for some, but otherwise, it is recommended to set the Realism LoRA weight to anything below 0.75</p></li><li><p>Seems to be pretty flexible to prompting style, but just in case, here is an example of how XComposer captioned most of the images:</p><ul><li><p><em>a photograph of a woman wearing a cat fursuit head. She is standing outdoors and is the sole focus of the photograph. She is dressed in a pink shirt, black skirt, and black thigh-highs. Her hair is a multi-color combination of white and black and she has fangs. She is wearing animal gloves, and in her hand she is holding her skirt up. There are plants in the background</em></p></li></ul></li><li><p>Around 60% of the dataset consisted of NSFW elements. I am not sure how well these transferred over to the LoRA, but they shouldn't be present unless prompted for</p></li></ul>
modelVersions.availability: Public
modelVersions.baseModel: Flux.1 D
modelVersions.description: <p>Initial version, 4000 steps</p><p>Recommended to set LoRA weight less than 1.</p><p>Works in Comfy using UNet Loader.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/720558
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/720558
modelVersions.AutoV1: FC7CDBC5
modelVersions.AutoV2: 38782DE85A
modelVersions.AutoV3: 837E9EE7C89E
modelVersions.BLAKE3: 039B96064CA0EB0AE5C0DA2572DB114948361186D236C0A067E10D255B9F390F
modelVersions.CRC32: FC793B60
modelVersions.SHA256: 38782DE85A5A271B78F584B2D08EDF29975A73F709200DC6D1460B7B75854A09
modelVersions.format: SafeTensor
modelVersions.name: fursuithead_flux_04000.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-08-13T22:40:47.757Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UDCFMbxc0Jxu?IkDOHo$I7xHyGS%I=spS0V?
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b92fef04-bedb-4121-a292-454043843a2b/width=450/24174322.jpeg
modelVersions.hash: UaD0r:axDhoJ?waeMwayW=j@t7fkIAbHt7j[
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/ac0bee22-f3b8-4378-afaa-f076ce163ce0/width=450/24174392.jpeg
modelVersions.hash: UdI~.HaRCT-6AyIam-slo|IVVsW=?Gs:xBxa
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/663d359a-e6da-4a54-b48f-0086ecda5300/width=450/24174434.jpeg
modelVersions.name: v1-4000
modelVersions.publishedAt: 2024-08-13T22:41:36.806Z
modelVersions.trainedWords: fursuit head
name: Fursuit Head - FLUX
tags: anime concept realism costume furry fursuit