description: <p>得益于Zhanglvmin大神的努力，sd-webUI-Forge已经支持FLux1-dev和Flux1-schnell模型，我训练了一个基于<code>flux1-dev.safetensors</code>微调的人像LoRA，已经用Forge体验过，发布出来，欢迎大家体验。</p><p>Thanks to the efforts of the amazing <strong>lllyasviel</strong>, sd-webUI-Forge now supports the Flux1-dev and Flux1-schnell models. I’ve trained a portrait LoRA based on <code>flux1-dev.safetensors</code> and have already tested it with Forge. I'm releasing it for everyone to try out.</p><p></p><p></p><p>概述：</p><ul><li><p>lora是基于<code>flux1-dev.safetensors</code>进行训练的，载入base model和lora后，提示词里加入涉及woman的描述，得到的图片基本都会呈现黄亦玫的面部特征。（黄亦玫是一部电视剧里的角色）</p></li><li><p>经过Zhanglvmin的更新，<code>flux1-dev</code>上训练的lora也支持了<code>flux1-dev-bnb-nf4.safetensors</code>模型。</p></li><li><p>在comfyUI里一样可以在<code>flux1-dev.safetensors</code>基础上使用该lora。</p></li></ul><p>Overview:</p><ul><li><p>This LoRA was trained based on <code>flux1-dev.safetensors</code>. After loading the base model and the LoRA, adding prompts related to "woman" will usually result in images featuring the facial characteristics of <strong>Huang Yimei</strong> (a character from a TV series).</p></li><li><p>Thanks to lllyasviel’s updates, LoRAs trained on <code>flux1-dev</code> now also support the <code>flux1-dev-bnb-nf4.safetensors</code> model.</p></li><li><p>This LoRA can also be used with <code>flux1-dev.safetensors</code> in webUI-Forge and ComfyUI.</p></li></ul><p></p><p>使用步骤：</p><ul><li><p>Lora</p><ul><li><p>下载本lora模型后，放入<code>./stable-diffusion-webui-forge/models/Lora</code>里，<code>flux1-dev.safetensors</code>下载后放入<code>./stable-diffusion-webui-forge/models/Stable-diffusion</code>里。</p></li></ul></li><li><p>LoRA使用</p><ul><li><p>在prompt文本框里加入lora名称<code>&lt;lora:lora_huangyimei_flux1_dev_v1:0.9&gt;</code>和其他描述性的提示词，点击<code>Generate</code>即可使用本lora进行模型推理。<code>0.9</code>是LoRA的权重，也可以换成<code>0~1</code>的任何小数。</p></li></ul></li></ul><p>Usage Steps:</p><ul><li><p>LoRA:</p><ul><li><p>Download the LoRA model and place it in <code>./stable-diffusion-webui-forge/models/Lora</code>. Download <code>flux1-dev.safetensors</code> and place it in <code>./stable-diffusion-webui-forge/models/Stable-diffusion</code>.</p></li></ul></li><li><p>Using the LoRA:</p><ul><li><p>In the prompt text box, add the LoRA name <code>&lt;lora:lora_huangyimei_flux1_dev_v1:0.9&gt;</code> along with other descriptive prompts. Click "Generate" to use this LoRA for inference. The <code>0.9</code> represents the LoRA weight, which can be adjusted to any decimal between 0 and 1.</p></li></ul></li></ul><p></p><p>使用细节：</p><ul><li><p>推荐尺寸有<code>768*1152</code>,<code>768*1360</code>,<code>832*1216</code>等等。(训练集的尺寸是<code>768*1152</code>和<code>768*768</code>)</p></li><li><p>像素如果用<code>512*512</code>，画出的人物手部容易畸形。原因在于画面太小，留给手部的空间很有限，无法在那么小的像素里画出完好的人手。</p></li><li><p>出图人物的清晰度不够高的话，可以把迭代步数从20步提升到40步。</p></li><li><p>手部如果有问题，可以锁定种子数，微调迭代步数<code>steps</code>。</p></li><li><p>训练集里的图片几乎基本都是半身像、牛仔镜头像，没有全身像。因此使用LoRA生成全身图，效果不好。等后续增加了训练集里图片的数量和质量，可以解决这个问题。</p></li><li><p>跑图的时候，不是每一次出图都会符合预期。需要先20步迭代或25步迭代跑多张图，发现满意的图了，锁定种子之后，xyz plot测试恰当的迭代步数。</p></li><li><p>flux模型对提示词服从度更高，手指出问题的情况也更少，应对复杂提示词、绘制复杂场面时表现更好。因此可以在flux出图之后，去SD精修。</p></li></ul><p>Details:</p><ul><li><p>Recommended resolutions include <code>768*1152</code>, <code>768*1360</code>, <code>832*1216</code>, etc. (The training set images are in <code>768*1152</code> and <code>768*768</code> resolutions).</p></li><li><p>Using a resolution of <code>512*512</code> can result in distorted hand features due to limited canvas space, which makes it difficult to render hands accurately at such low pixel counts.</p></li><li><p>If the generated image lacks sharpness, try increasing the iteration steps from 20 to 40.</p></li><li><p>If hand features are problematic, lock the seed and fine-tune the iteration steps (<code>steps</code>).</p></li><li><p>The training set primarily consists of half-body and cowboy shots, with very few full-body images. As a result, generating full-body images with this LoRA may produce unsatisfactory results. This issue can be improved by expanding the training set with higher-quality images.</p></li><li><p>Flux models have higher prompt adherence and fewer issues with hand rendering. They also perform better when handling complex prompts and scenes. Therefore, you can use flux to generate an image first, then refine it with SD (Stable Diffusion).</p></li><li><p>When generating images, the results may not always meet your expectations on the first try. Generating many pictures with one prompt by running iterations with 20 or 25 steps. Once you find a satisfactory image, lock the seed and use an XYZ plot to test for the optimal number of iteration steps.”</p></li></ul>
modelVersions.availability: Public
modelVersions.baseModel: Flux.1 D
modelVersions.downloadUrl: https://civitai.com/api/download/models/728170
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/728170
modelVersions.AutoV1: C11B4E9B
modelVersions.AutoV2: 8A79E8D3DB
modelVersions.AutoV3: 9D9FC85B7020
modelVersions.BLAKE3: DB7956E7F7F12403753FB05D448CAED95F6B7A6902AA19CFE7FF6B9E0C8572A6
modelVersions.CRC32: 843D4B9C
modelVersions.SHA256: 8A79E8D3DBBDA48945FCCAA7F01FB03EA3F166BCB24133DF1905CA396A7E00C1
modelVersions.format: SafeTensor
modelVersions.name: huangyimei-flux-dev-v1.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-08-16T09:11:15.394Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UMI}ea.9JVt7wZxB~qRj.SNGn4off,WYRlNG
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/8079f76a-0bdd-4806-b66e-b6fd0dec182a/width=450/24570255.jpeg
modelVersions.hash: UkHUqX^+_Nx]~WWCx^RjtRIUoLM{ofaexaof
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6afdfffd-c9a8-43a5-9d8d-32a48cf1a0f0/width=450/24570325.jpeg
modelVersions.hash: U*IE-Do0.8tR~pWBo#ozt6RjM|kCRkkCjZoe
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/01d42f4d-9bd1-4c80-8e1b-70ab4cef71b5/width=450/24570326.jpeg
modelVersions.hash: UQDvK6~Vxn%g$wo#Nft6E2R%ozjZNHj]xZoM
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4eb0f1ad-a9d1-4f1c-8721-135f3065cb81/width=450/24570330.jpeg
modelVersions.hash: UHJQDxrD0x4=tIV]~U0MJ7E2?GM}xvS2M{xa
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/33023dc6-96f7-4e10-a5d1-fb5a3d510681/width=450/24570369.jpeg
modelVersions.hash: U9Frt=Q,0K4.00tl?H%gLNE2-U-UiwM_NeRj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d13233a0-1f41-4b25-89be-00f725241ca2/width=450/24570368.jpeg
modelVersions.name: v1.0
modelVersions.publishedAt: 2024-08-16T09:57:52.149Z
name: 黄亦玫-Character-LoRA-for-flux1-dev
tags: character