description: <p>This LoRA allows depicting a realistic Mercy / Mercy Cosplay from Overwatch in Flux.dev.</p><p>More specifically, the default outfit, witch outfit, and a little bit of the winged victory and Dr. Ziegler outfit are available ... and everything the creative Flux can dream of!</p><p>I provided two versions in this upload. The example images of them use exactly the same seed, prompt and everything. The difference is in the captioning of the dataset. More about that in the training section. ¹=main variant, ²=_sc variant (short caption)</p><p></p><p>Main trigger: <strong><u>mercy</u></strong>²  (/ mercy cosplay, mercy outfit, ...)¹</p><p></p><p>Individual cosplay elements have been tagged, so you can – and even might have to – use them. </p><ul><li><p><strong>Halo</strong>² (/ golden halo¹)</p></li><li><p><strong>Staff</strong> (broom staff)</p></li><li><p><strong>Pistol </strong></p></li><li><p><strong>Iconic hair</strong>¹, <strong>iconic hair wig</strong>¹, <strong>wig</strong>² (... or more verbose captions like iconic mercy hair wig)</p></li><li><p><strong>Wings</strong> ([white, black, ....] mechanical wings (with [golden, yellow, glowing, transparent, ...] blades), feathered wings, angelic wings)</p></li></ul><p></p><p>Overall outfits which have been tagged:</p><ul><li><p><strong>Mercy </strong>(This is the default outfit, feel free to add “plastic white body armor” or similar to get more of a plastic look, otherwise add words like fabric)</p></li><li><p><strong>Witch mercy</strong> (this is sufficient for the outfit, however if something doesn’t work you can add some more details or specifics like: book on hip, broom staff, witch hat, ...)</p></li><li><p><strong>Winged victory mercy</strong> (seems to be too little training data to really do it consistently or in any good way, it just does a default mercy, the following keywords will help the LoRA remember a bit: feathered wings, white and blue robe with gold trim, ivy, ... or similar words which are close to the looks of that skin)</p></li><li><p><strong>Dr. Ziegler Mercy</strong> (also too little training data, best results by adding lab coat, iconic hair wig, ...) </p></li></ul><p></p><p>Suggested LoRA weight: Depending on the style you want <strong>0.7 – 1.0</strong>.</p><p></p><p>And with that we can talk a bit about the</p><p></p><h2 id="training-etgajfs2y">Training</h2><p>I had an idea for this dataset and just executed it, then I came across by the post <a rel="ugc" href="https://civitai.com/articles/6982/flux-is-smarter-than-you-and-other-surprising-findings-on-making-the-model-your-own">„<em>FLUX is smarter than you! - and other surprising findings on making the model your own</em>”</a> by Pyro and decided to test it out.</p><p></p><p>178 images are contained in this dataset and they are as diverse as I could get it (although no Harold or chihuahuas). I then ran InternVL2-8b to give all of them a base caption. I hoped the model was smart enough to determine the outfit with some prompting, however that wasn’t the case (at least not with my prompting skills). So, I changed the main prompt and just had it describe the general image with only very little about the main subject. Then I did a manual pass describing all stuff I wanted (the outfit type, and the specific individual items).</p><p>I then copied that dataset and reduced the captions to only the outfit and relevant items to experiment with the findings Pyro described.</p><p></p><p>This means a caption like:</p><p><em>“Winged Victory Mercy Cosplay.  The character is standing on a rocky terrain with a waterfall in the background, surrounded by lush greenery. white and blue robe adorned with gold trim and intricate patterns. They have large, white, feathered wings attached to their back. In their right hand, they are holding a pistol. The overall scene is serene and natural, with sunlight filtering through the trees, creating a peaceful atmosphere. In the bottom left is a "Shappi" watermark.”</em></p><p>Turned into:</p><p>“<em>winged victory mercy with pistol and wings, wig</em>”</p><p></p><p><span style="color:#868e96">*Sidenote: I labelled the original captions always with outfit or cosplay or similar, so it does worse when just writing “Mercy” without any added text.  </span></p><p></p><p>I then trained both of the datasets with the ai-toolkit by ostris with exactly the same settings which were:</p><ul><li><p>Alpha, Dim: 16</p></li><li><p>Total Steps: 9000</p></li><li><p>Caption dropout: 0.05</p></li><li><p>Resolutions: 512, 768, 1024</p></li><li><p>Batch Size: 1</p></li><li><p>Noise scheduler: flowmatch</p></li><li><p>Learn rate: 1.7e-4</p></li><li><p>Linear timesteps</p></li><li><p>Quantized (with gradient checkpointing)</p></li></ul><p></p><p><strong>And now onto my observations:</strong></p><p></p><p>Both LoRAs work sufficiently, and it is much easier to just caption single words.</p><p>However, I personally like the average result of the LoRA trained on long texts more. The images are more “cinematic”, so that is personal preference. </p><p></p><p>In addition, in my opinion the LoRA with more detailed captions has more fine control, but it also sometimes needs more text to obtain results. But it also reproduces less watermarks from the original source dataset.</p><p>One disadvantage it has (if you want to call it that), is that it likes to generate drawings or less realistic looking images sometimes -&gt; if you do not specify cosplay or outfit. And in some cases, it is difficult to then get a realistic image, as you cannot just add a negative in Flux.</p><p></p><p>I also feel like the fine details, such as the specific hair shape is done better by the model with more detailed captions.</p><p></p><p><u>So in conclusion:</u></p><p>I think Pyro has valuable findings, I however do not agree entirely with them. Short captions ease the work, however are less flexible in LoRAs which allow multiple nuances. I would suggest doing short captions to save time, especially on smaller less complex datasets.</p><p>I myself however will continue using longer captions for more complex things. I do think that you really need very good captions then. If you do not want to spend the effort to do great captions, do short ones instead.</p><p>However I am very sceptical of other points Pyros mentions, I do not believe in their statement that you can ~“talk to your LLM” during captioning.</p><p></p><p></p><p>I congratulate you for reaching the end!</p><p></p><p>I would be happy to answer questions if you have any, however you will probably have to wait about a month, I will be busy in the next few weeks and will probably not be logging onto CivitAI. </p><p></p>
modelVersions.availability: Public
modelVersions.baseModel: Flux.1 D
modelVersions.description: <p>Long caption version of the model. It is trained on only single word captions for the concepts. For more info read the training description.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/776886
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/776886
modelVersions.AutoV1: F36571AD
modelVersions.AutoV2: A844724A0A
modelVersions.AutoV3: FF24D253A450
modelVersions.BLAKE3: D147838D838305A3820FE7B9BC46A557AFD7DA28AF21EE0B65DE20FAADE42D6E
modelVersions.CRC32: 0A52C657
modelVersions.SHA256: A844724A0AE0190D2BF58D0034A48D0A547A38636DC49F0F533263A4D7B675A0
modelVersions.format: SafeTensor
modelVersions.name: DI_mercy_cosplay_flux.d.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-08-28T00:10:58.548Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UBCX+wAb10=v1$$$,o9^EMxFsnNa}WJUJB$%
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/75660f2c-e8a9-47fb-84d8-ad2257595b9c/width=450/26480343.jpeg
modelVersions.hash: UCL|fU59]{xb~pR+Efsl00SK9#tP,]X9%4M{
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4f8a76f0-f02b-4d6c-9f18-6ba530f29d49/width=450/26480377.jpeg
modelVersions.hash: URL2@J$f~PRRJC%KIVxs4tt6It%0%Kiy%2M}
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d04eb2b3-0701-45ed-a409-15e9db237c12/width=450/26480423.jpeg
modelVersions.hash: UKKKD:IVx@xuMwt6JDR,I9xtMyM{~qa#I9of
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/413fa8c8-be96-4ad5-9209-9a5988ae2bbc/width=450/26480452.jpeg
modelVersions.hash: U7DuuYIo0N~Vs$-p0Mxt_2Ip$*xZ00%1-QM{
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/24e3ec96-47fb-4664-9ac6-d6898a674cf2/width=450/26480479.jpeg
modelVersions.hash: U7COUHAJ}nNH%1S2S4sA9}=t9_NbxFR*R+xF
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/009b3513-a675-44e0-ba83-16b0f18f211b/width=450/26480791.jpeg
modelVersions.hash: UEH{TUOZ00~WDg-W.AS08w9aoLf30LD$R5%L
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/7d89d3b8-ec16-4774-bfde-c11fc1b0476a/width=450/26480846.jpeg
modelVersions.hash: U9N@]z^9yGxbTDobg3W:0xsqD~bb00RjE0Rj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f36bd5f2-9b1f-47ad-a918-be2c2a6c20aa/width=450/26480872.jpeg
modelVersions.hash: USHDjbv}Cmw]C7XSRPS$9uwbvLoJibi_s,i_
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/7f0209b6-7cef-4de6-af6b-e9724ec53f73/width=450/26480924.jpeg
modelVersions.hash: UEKwnJ~V9^%K:g-;E2-:*0E1VtMy01xu-=IV
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d627de80-8f61-4c59-b5c6-5a4307274f8c/width=450/26480961.jpeg
modelVersions.hash: UAK1d#%2S}JV0KR*~Xs900M_R%x].8t88^Mx
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/ec4b2b44-c250-461a-8f9c-be0a5381eb2d/width=450/26480977.jpeg
modelVersions.hash: UPA.MerX.QX,?ws:w}X8eHxaVcohInxvWTtl
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/c7f2a319-73da-41f5-b3e3-3897d4e3b72d/width=450/26481023.jpeg
modelVersions.hash: UFHBoTxAE2~X^N_39_Mw$eIoE3WB?bn+D%%M
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b8e9fbdb-df8e-4cc5-bffd-9ff0d6bda5be/width=450/26481077.jpeg
modelVersions.hash: U6F}=xTL0000-,og%g-n00$2?^_NtRX.-600
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/905eb122-5845-4096-b8a1-52cc6fb6dec9/width=450/26481093.jpeg
modelVersions.name: v1.0
modelVersions.publishedAt: 2024-08-28T00:10:06.513Z
modelVersions.trainedWords: Mercy Witch Mercy halo wings staff pistol iconic hair iconic hair wig
modelVersions.availability: Public
modelVersions.baseModel: Flux.1 D
modelVersions.description: <p>Short caption version of the model. It is trained on only single word captions for the concepts. For more info read the training description.</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/776846
modelVersions.downloadUrl: https://civitai.com/api/download/models/776846
modelVersions.AutoV1: 5EB081B6
modelVersions.AutoV2: EA371378FB
modelVersions.AutoV3: 72387E8B42F5
modelVersions.BLAKE3: 1109BFDB774A7E26781F8AAAF2B76D116E0125DFE2D4153C0CB21B9A13AF429E
modelVersions.CRC32: 32F81B12
modelVersions.SHA256: EA371378FB972760B7141F0A63958606527B1FE09277E507D157B0A7D5BD3BB6
modelVersions.format: SafeTensor
modelVersions.name: DI_mercy_cosplay_sc_flux.d.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-08-28T00:01:08.798Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UKEBEJKPAu=w68$%$gI?EgxZo2Nd}rS$OY$%
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1a12bc5e-87b7-4b9c-b49c-92f69de84128/width=450/26478133.jpeg
modelVersions.hash: UIMZ?n5U-M$x_NM|NFX900R+IuoM%4kWa*V@
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/66ffd02f-cf03-4eef-a88c-bc5c118e0c71/width=450/26478179.jpeg
modelVersions.hash: UFJP|~9$~0IB1%?YE2XR02%0T1%LMx9Ix]Vt
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/79d91662-c332-4c51-abe9-5b4fa4f70504/width=450/26478247.jpeg
modelVersions.hash: UOMQInIV%f%2eloJT1WXMwxtRQRj_NozIAof
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/287159c3-abb6-4a0c-9d5f-d96a76d89123/width=450/26478190.jpeg
modelVersions.hash: UOMQInIV%f%2eloJT1WXMwxtRQRj_NozIAof
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/889b39f5-ce5e-4d7a-a681-88e9c83e84a3/width=450/26478270.jpeg
modelVersions.hash: U9Gb0FMc03~prmx^4og3?Gs,=|xD0Ms.$#Rj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/64828b23-e3fd-4d3d-9a95-f3a849cc68a1/width=450/26478280.jpeg
modelVersions.hash: U9Fg{?JW}@jY%LENs+s.o}slI:WCnixV9xs:
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b920e726-83ac-423e-a68f-cf4499e2b563/width=450/26478288.jpeg
modelVersions.hash: UBIFbxkr00~qI7t8.9ob4T9at-V?00D%I9t7
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/860317e9-339d-4728-a167-1e3adfd0538a/width=450/26478327.jpeg
modelVersions.hash: UBP4$Z]uO]-=nNt7t7R%0dxbITW.0fnlD$Rj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/8c1e2434-c018-4d02-bb51-0c4b3397e8c9/width=450/26478442.jpeg
modelVersions.hash: UMH|,M#,8cxY3qOYM|XT5R$%zoi_R5VswvnO
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/fa2c480e-cdb2-4bd7-88c3-a9691bd08338/width=450/26478466.jpeg
modelVersions.hash: UFM7V{~qF|-;z,x^9u-;pxE1a1Vs0K%M?cM{
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f67d258f-a8bb-442a-97b4-35fa96875092/width=450/26478489.jpeg
modelVersions.hash: UCKw;4xuOXtS0ebc~XxZ00nhNdS$%#SN8wR5
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/62add7a3-294b-4186-ba68-645330c15d89/width=450/26478530.jpeg
modelVersions.hash: UMAB%}$+%NTI?]xGxvXSWrt7jGo}Iut7WBtl
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5fb584b2-7fc0-4321-908c-0e9189032426/width=450/26479111.jpeg
modelVersions.hash: UII#WB$~IU~W~V~WI[I9w@NGNIM{?bs:IUxt
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/0afc7bf6-3a52-4ed8-bddc-fdef85e00526/width=450/26479250.jpeg
modelVersions.hash: U9G8fnOY000K%EaLxv%K00wI?w-=ozXnwa9F
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d3518eb6-744d-4924-bfd4-6d6dd4ae280a/width=450/26479281.jpeg
modelVersions.name: v1.0 - short caption
modelVersions.publishedAt: 2024-08-28T00:02:00.109Z
modelVersions.trainedWords: Mercy Witch Mercy halo wings staff pistol iconic hair iconic hair wig
name: Mercy / Mercy Cosplay - Flux.dev
tags: cosplay mercy clothing overwatch