description: <h1 id="heading-19451">FOREWORD</h1><p><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/7b4d593a-3c7a-49f5-ba09-bc320743ce3f/width=525/7b4d593a-3c7a-49f5-ba09-bc320743ce3f.jpeg" /></p><p>low rank adapters are not what they appear. when we make a parameter efficient fine tuning adapter for a stable diffusion model, we are tasking the image synthesis program to solve a complicated optimization problem which generates an entirely new program.<br />the process of selecting optimization problems does not yet have useful, specific, or strict rules which make it easy for us to choose the training settings or training data to produce image generation adapters (stable diffusion LoRAs) which do precisely what we want.<br /><br />I hope to make navigating this problem a little bit easier.</p><h1 id="heading-19452">ROTATE-SWORD</h1><h2 id="heading-19453">Training data preparation:</h2><p><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9fab6228-5bb7-4460-8b8e-d97362e59584/width=525/9fab6228-5bb7-4460-8b8e-d97362e59584.jpeg" /></p><p>Literally draw something. Anything. It's all cool. The kind of texture you use will influence the behavior of your output adapter model, so using a paint-like texture instead of a crayon-like texture might better reflect your tastes and creative values.</p><p>The only important limit is to make sure that you color in whatever you draw, and use different colors to represent differences in depth, reflectivity, and patterns on the texture.<br />Mirror your image, rotate it in each of the 4 cardinal directions, and each of the 4 diagonal directions for a 16x multiplication of your training data.</p><p>Use a machine vision labeling tool for your training data. I do not recommend hand-labeling image caption training data unless you are a specialist in machine vision, and I can barely fine tune a text classifier.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4c7cc570-7981-487a-ab73-7f561a385d1c/width=525/4c7cc570-7981-487a-ab73-7f561a385d1c.jpeg" /></p><p>Check your training data to make sure that tags which reflect the object and background are propagated onto every single individual image. In my training set, I noticed that <em>most</em> of my images were missing <em>most</em> of the tags that they should have shared!</p><p> <img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/8fc61cba-637b-447e-90f3-b8e915b976ef/width=525/8fc61cba-637b-447e-90f3-b8e915b976ef.jpeg" /></p><p>This is easily corrected by copying and pasting the valid tags a few times. If you are a more computer-prone person, I am certain you can find a way to use shell scripting to make that faster or simpler.</p><h2 id="heading-19454">Training:</h2><p>I used a network_dim of 64, a network alpha of 64. a learning rate of 5e-05 (in every field), an internal resolution of 768x768 (works even on 8gb gpus if you lower training batchsize!), ++a min_snr_gamma of 5.0,++ and a multires noise discount of 0.13. I used 5 'dataset repeats' and 12 epochs for my first training run. In your training, the total of (repeats*epochs) should be around 50-70. I would recommend no repeats and targeting 60 epochs so it is easier to see your adapter model changing in response to training.<br /><br />training settings marked with a ++ are probably placebos and at least frivolous. they probably do not need to be imitated for good training results.<br />Make sure to save a checkpoint and sample an image at every single training epoch! <img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/21b1808f-1230-48d0-94c8-f2a2313ef7de/width=525/21b1808f-1230-48d0-94c8-f2a2313ef7de.jpeg" /></p><h2 id="heading-19455">The output model(s):</h2><p>did i mention this training process took like 18 minutes without optimizing any training parameters, and hugely overshooting a converged output adapter model? </p><p>don't hesitate to train single-object single-texture loras on every single model you can find. train SD1.5. train SD2.0. try all of your favorite photorealistic and anime dreambooths! <br />as long as you're giving the training process a simple, straightforward optimization goal, through a constrained, specific dataset, all of the stable diffusion models will learn something interesting from your dataset.</p><p>Attached are rotate-sword loras using this exact training dataset and methodology using stable diffusion 1.5, NAI-leak, counterfeit-3, and my personal block-weight-merged model (like counterfeit, but with fewer purple splotches).</p><p><br />I recommend using the lora-ctl addon for automatic1111's webui with loras trained in this fashion. It is unlikely you want for your adapter model to generate endless white expanses or abstract backgrounds as your specific aesthetic goal. A lora-ctl alpha curve of &lt;lora:loraname:1:0@0.25,0.75@0.35,0.75@0.7&gt;will moderate behavior of that kind very nicely.</p>
modelVersions.availability: Public
modelVersions.baseModel: Other
modelVersions.description: <p>So the first bespoke-base model turned out so well I trained it a second time. v2.0 is a bit 'more' than v1.6. I don't even remember what the different training thesis was, but the results sure aren't the same. Wild and uncontrollable.</p><p><br />use with lora-ctl and the following starting settings:</p><p>&lt;lora:rotate-sword-2-10:1:0@0.25,0.75@0.35,0.75@0.7&gt;</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/160031
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/160031
modelVersions.AutoV1: 5340631A
modelVersions.AutoV2: 900350C114
modelVersions.AutoV3: A05663373D8B
modelVersions.BLAKE3: F3203FE3AE2BC9D300BA80A017BF78105A4ACC797AB6A53B7225F7A2F83AFC31
modelVersions.CRC32: B316BD19
modelVersions.SHA256: 900350C1140E424F4FCDAD5CCC785F373963AC9358BEDCE5C75E0556860C8092
modelVersions.format: SafeTensor
modelVersions.name: rotate-sword-2-10.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-09-12T03:35:51.413Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.downloadUrl: https://civitai.com/api/download/models/160031?type=Model&format=SafeTensor
modelVersions.AutoV1: 5340631A
modelVersions.AutoV2: 900350C114
modelVersions.AutoV3: A05663373D8B
modelVersions.BLAKE3: F3203FE3AE2BC9D300BA80A017BF78105A4ACC797AB6A53B7225F7A2F83AFC31
modelVersions.CRC32: B316BD19
modelVersions.SHA256: 900350C1140E424F4FCDAD5CCC785F373963AC9358BEDCE5C75E0556860C8092
modelVersions.format: SafeTensor
modelVersions.name: rotate-sword-2-10.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-09-12T03:30:38.569Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UGNdBvMc~W-=^*jsbcn$xFRjI?of.9xuMxE1
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/7299d41e-acfe-4e4d-b7b3-e9fccf25b8a1/width=450/2462293.jpeg
modelVersions.hash: U6R3NF=_=_?w.9xuxtR+~WtmE2Vr~BIUE1$*
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/8c6bee0d-0154-4472-8d03-a8adcff9cfd9/width=450/2462299.jpeg
modelVersions.hash: U5Fi75%M_2Io00M{4:t700IUNGD%_NWV~qV@
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/08b9344b-6484-4a2b-9d18-265c38e9686f/width=450/2462342.jpeg
modelVersions.hash: UBEC?}_300IU*0D%4Tt7XTt7nNoftRRjV=Ri
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/fa08a24c-686e-4e7b-8d1e-5d2947657899/width=450/2462403.jpeg
modelVersions.hash: UOG+q1_4%fxu%i.8Mw%0WXWBV=aex]jEt7xv
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/2d34e269-5c3e-427c-a4c9-a459481c86c5/width=450/2462404.jpeg
modelVersions.name: 2.0
modelVersions.publishedAt: 2023-09-12T03:31:14.612Z
modelVersions.trainedWords: simple background, white background, weapon, sword, no humans, still life
modelVersions.availability: Public
modelVersions.baseModel: Other
modelVersions.description: <p>Trained on bespoke auto-block-merge counterfeit derivative model. Will work on other models, of course. Fewer purple splotches than the counterfeit-3 train.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/160026
modelVersions.downloadUrl: https://civitai.com/api/download/models/160026
modelVersions.AutoV1: 960C1213
modelVersions.AutoV2: 1313C0A620
modelVersions.AutoV3: 00D660EC7159
modelVersions.BLAKE3: 3671FB9D55CEAB1399F2AD5A4AFF12C9553B4A54CE9C7EC12EF451D48B78D8E6
modelVersions.CRC32: 81356D2B
modelVersions.SHA256: 1313C0A6206282763DF85BF18B29982005F1D25E7BB20503420D10B7CE28E564
modelVersions.format: SafeTensor
modelVersions.name: rotate-sword-1-06.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-09-12T03:20:41.749Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: U9S~t}%M?c~q_3ofIUV@%2t7M|IV%Mfkxuof
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/33318c15-263b-4bf4-897b-4a23a41f46a2/width=450/2462172.jpeg
modelVersions.hash: U7ODa+t7bw~q-:xukDIU%Mt7WBM{%MM{j?-;
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/628b162b-980f-4789-9511-f69981cd685a/width=450/2462174.jpeg
modelVersions.hash: U9LXSu_3H?~q00D%9FD%#jt7.8Rk%Lj[%Mxu
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/eefbe283-7d49-4cf6-ac39-fdf7916555a7/width=450/2462175.jpeg
modelVersions.hash: U8K_8+~qM{~q00D%009Fslt7?bM{%2j[xu-;
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/7e0ec019-fb76-4167-8b59-d2224ca42143/width=450/2462176.jpeg
modelVersions.name: v1.6
modelVersions.publishedAt: 2023-09-12T03:20:51.119Z
modelVersions.trainedWords: simple background, white background, weapon, sword, no humans, still life
modelVersions.availability: Public
modelVersions.baseModel: Other
modelVersions.description: <p>Trained directly on counterfeit 3. this is not a good idea. this lora was trained and shared only for educational purposes. if you use this directly, even on the counterfeit base model, you may experience VAE errors and mysterious purple splotches on your renders.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/160022
modelVersions.downloadUrl: https://civitai.com/api/download/models/160022
modelVersions.AutoV1: 2790BD19
modelVersions.AutoV2: 677AF716EF
modelVersions.AutoV3: 241BC07A9AAA
modelVersions.BLAKE3: 787A4BD9C8DC0FA1572251715AAA97FA3B226058290D51E82C5C5CCF388D7B9F
modelVersions.CRC32: 2DC54160
modelVersions.SHA256: 677AF716EF281DF2825A9BBA2F2E3838ECE927AF08BC814DE36AC8C323B26F24
modelVersions.format: SafeTensor
modelVersions.name: rotate-sword-cft3-05.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-09-12T03:15:57.954Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: U2Ir1..9%L=]~pxutSRO,Tnh9_XT%2M{o#xu
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/baf69b1b-a1bb-419d-bc61-b1aae79a0168/width=450/2462137.jpeg
modelVersions.name: v1.0 CFT
modelVersions.publishedAt: 2023-09-12T03:14:29.799Z
modelVersions.trainedWords: simple background, white background, weapon, sword, no humans, still life
modelVersions.availability: Public
modelVersions.baseModel: Other
modelVersions.description: <p>NAI-based. I recommend using this version for models which have a more 'flat' or illustrative artstyle.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/160021
modelVersions.downloadUrl: https://civitai.com/api/download/models/160021
modelVersions.AutoV1: 2FA7158D
modelVersions.AutoV2: 7467D0A4FE
modelVersions.AutoV3: BF2A92EF1372
modelVersions.BLAKE3: 45E7A0B59CF978A486A433174035A879C7AFAF7408F36167993DA87008A3C7AB
modelVersions.CRC32: 421C3FF5
modelVersions.SHA256: 7467D0A4FE561A3BC3C5612464E275A801420BCD7BD3E0B16427DEC661DA01B3
modelVersions.format: SafeTensor
modelVersions.name: rotate-sword-nai-05.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-09-12T03:10:44.745Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: U7MH7Ao~Di-p~Wx]IoIU9FMxD%%MJCV??Hx]
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/ece55175-6fe5-4318-8d0e-8f74891a2346/width=450/2462110.jpeg
modelVersions.name: v1.0 NAI
modelVersions.publishedAt: 2023-09-12T03:11:17.352Z
modelVersions.trainedWords: simple background, white background, weapon, sword, no humans, still life
modelVersions.availability: Public
modelVersions.baseModel: SD 1.5
modelVersions.description: <p>SD 1.5. I do not recommend using this version for models which do not have behavior very similar to the SD 1.5 base model.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/160008
modelVersions.downloadUrl: https://civitai.com/api/download/models/160008
modelVersions.AutoV1: 977F4877
modelVersions.AutoV2: 5F829F5F56
modelVersions.AutoV3: E3CA1D08AB4C
modelVersions.BLAKE3: 80A132B75B73538CD472C0046A994D69F1F20BF17CDCE637F6A734FB2F63B35C
modelVersions.CRC32: 83DCAC6C
modelVersions.SHA256: 5F829F5F56303384BC4C5A50363014C0ABAB7A94EC3B36860A1A5BB2AE923AAB
modelVersions.format: SafeTensor
modelVersions.name: rotate-sword-sd15-05.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-09-12T03:05:46.820Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: U6C%dIrp01.9Vs%ME29G00NL^+IT.9D%-U~p
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1d6b33fa-7930-46d6-8765-c69f66416d1f/width=450/2462018.jpeg
modelVersions.name: v1.0 SD1.5
modelVersions.publishedAt: 2023-09-12T03:05:46.956Z
modelVersions.trainedWords: simple background, white background, weapon, sword, no humans, still life
name: rotatesword
tags: texture style object an entire way of life