description: <p>Lora+ と CosineAnnealingLR と PagedAdamW8bit の組み合わせテスト</p><p>20epochで形になるがLossがきれいな低下傾向だったので100epochまで学習させたLoRA</p><pre><code>--lr_scheduler_type "CosineAnnealingLR" --lr_scheduler_args "T_max=900" "eta_min=0e-0" --network_args "loraplus_lr_ratio=16"</code></pre><p>T_maxをlrが底になるように設定したほうが良いと途中で気づいた</p><p>PagedAdamW8bit はVRAM足りるならAdamW8bit で良かったとか</p><p></p><p>推奨ネガティブ</p><pre><code>blurred details,blur,blurred,upscaled image</code></pre><p>アップスケールとラマクリーナーで一部ディテールが潰れた画像があるため</p><p></p><p></p><h3 id="combination-test-of-lora+-cosineannealinglr-and-pagedadamw8bit-l9ug09l8q">Combination Test of Lora+, CosineAnnealingLR, and PagedAdamW8bit</h3><p>This LoRA model showed promising results after 20 epochs, with a clear downward trend in Loss, so I extended training to 100 epochs.</p><p>Parameters:</p><ul><li><p><strong>LR Scheduler Type</strong>: <code>CosineAnnealingLR</code></p></li><li><p><strong>LR Scheduler Args</strong>: <code>T_max=900</code>, <code>eta_min=0e-0</code></p></li><li><p><strong>Network Args</strong>: <code>loraplus_lr_ratio=16</code></p></li></ul><h3 id="observations-gltietjq0">Observations</h3><ul><li><p><strong>T_max Setting</strong>: It's better to set <code>T_max</code> to ensure the learning rate reaches its minimum.</p></li><li><p><strong>Optimizer Choice</strong>: PagedAdamW8bit was used, but AdamW8bit would have been sufficient if VRAM was available.</p></li></ul><h3 id="recommended-negative-prompts-4k4p643uh">Recommended Negative Prompts</h3><ul><li><p><strong>Prompts</strong>: <code>blurred details, blur, blurred, upscaled image</code></p></li><li><p><strong>Reason</strong>: Some images had details blurred due to upscaling and using the Lama Cleaner.</p></li></ul><p></p><p></p><p>余談</p><p>スペルはzだ</p><p>ロータス・エリーゼという名車があるのでスペルミスでちょっと無駄なことをした</p>
modelVersions.availability: Public
modelVersions.baseModel: Pony
modelVersions.downloadUrl: https://civitai.com/api/download/models/518325
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/518325
modelVersions.AutoV1: A0E877CF
modelVersions.AutoV2: 0570462DEA
modelVersions.AutoV3: 5336FA50E97A
modelVersions.BLAKE3: 1B28791208120F230F03B9E0986389D6737C14EBF880BB77105C3972550A6F85
modelVersions.CRC32: 47FD2699
modelVersions.SHA256: 0570462DEAB9660202B2F3CD31F0AB478324EE7BEB8E23024CD402496D94AEC6
modelVersions.format: SafeTensor
modelVersions.name: ToEliZe-XLPony_v001.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-05-20T08:21:39.477Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: U4IXKp0K0000?GIZ4U0|0L00_L5R00x]OY8y
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/da4b98ef-6b00-435c-a393-0dfc9fa0eb8c/width=450/13032686.jpeg
modelVersions.hash: ULL4f:~B9FV^Iu9aIVR+yN$kNGyCu3a2IUs:
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/96dd50ae-5cd1-4763-b4ab-356b415e2b95/width=450/13032684.jpeg
modelVersions.hash: URKv]Z0f9vn,_LMy9tkBRlR*VtxtEfNHaikC
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/fbce9fc5-ba3a-4156-8856-d0327abda55f/width=450/13032685.jpeg
modelVersions.hash: UaLgR$_N?v?v.8ofRjjZt8a{ayWBxuWBflWC
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/47c08cac-e518-43a8-b91d-9c9c5b91e075/width=450/13032720.jpeg
modelVersions.name: v001
modelVersions.publishedAt: 2024-05-20T08:47:44.203Z
modelVersions.trainedWords: Elize Lutus TALES OF XILLIA blonde hair green eyes
name: エリーゼ・ルタス Elize Lutus (TALES OF XILLIA) XLPony
tags: character girls game