description: <h3 id="emotion-puppeteer-sdxl-lora-cuz0nglhv">🎭 <strong><span style="color:rgb(34, 139, 230)">Emotion Puppeteer - </span><span style="color:#fd7e14">SDXL LoRA</span></strong> 🎭</h3><h3 id="how-to-use-rjgoj4c5r"><strong>How to use</strong></h3><p>Put one or two of these words in your prompt:</p><ul><li><p>👁️ grieving, glaring, gazing, seething, beaming, eyes wide, winking, squinting</p></li><li><p>👄 frowning, pouting, smiling, laughing, singing, screaming, sneering, snarling, grimacing, breathing, gasping, puckering, resting, relaxing</p></li><li><p>This <a target="_blank" rel="ugc" href="https://postimg.cc/8sr6LDy0">visual cheat sheet</a> shows all combos of the above</p></li></ul><p>For a stronger effect, increase the weight of those words, and/or increase the lora weight up to 1.2. Feedback and questions welcome. <strong>Please share your results!</strong></p><h3 id="suggestions-wakscftla"><strong>Suggestions</strong></h3><ul><li><p>Best for closeups. Most training images head and shoulders or closer</p></li><li><p>Best with square aspect ratio. All training images were square</p></li><li><p>Best for realism. Most training images were photos</p></li><li><p>For character consistency, use a combination of controlnets</p></li><li><p>Keep your negative prompt short</p></li></ul><h3 id="other-optional-prompts-irhlhi43l"><strong>Other optional prompts</strong></h3><p>These words were all used in training, but their effect is weaker:</p><pre><code>gnashing, cackling, flirting, glowering, leering, kissing, shrieking, shouting, smooching, sniffling, threatening, tisking, taunting, vomiting, wincing, yelling, accusatory, agony, amused, angry, anguish, annoyed, appalled, approving, aroused, ashamed, astonished, awestruck, bemused, bewildered, bitter, blame, certain, cheerful, cocky, concentrating, concerned, confident, confusion, contempt, contemptuous, content, crazed, crestfallen, crushed, curious, dazed, defiant, delighted, depressed, despairing, determined, disappointed, disapproving, disbelief, disgusted, dismayed, distrust, disturbed, dominant, ecstatic, embarrassed, enraged, envious, euphoric, evil grin, exasperated, excited, flirtatious, frightened, frustrated, furious, gentle, gleeful, happily, happy, hate, heartache, heartbroken, helpless, horrified, hurt, hurting, impatient, impressed, in love, incredulous, insane, insolent, intrigued, jubilant, judgemental, loathing, lustful, merry, misery, mistrust, mocking, nauseated, nonplussed, outraged, overjoyed, passionate, perplexed, petulant, pissed off, pitying, playful, puzzled, regretful, repulsed, revolted, rude, sad, scared, scorn, seductive, seizure, shaken, shocked, sickened, silenced, skeptical, smarmy, sour, startled, stunned, submissive, sultry, surprised, suspicious, terrified, thinking, ticked off, uncertain, unconvinced, unsettled, vexed, violent, wonder</code></pre><h3 id="how-it-was-trained-srmmt3pdn"><strong>How it was trained</strong></h3><p>I used ~300 high-resolution images, mostly photos, curated and captioned by hand. Sorry, <strong>I can't share the training images</strong> due to the need to protect the privacy of the subjects.</p><p>Each training image's captions included one word for the mouth type and one for the eye type. Some combinations had much higher representation in the data that others. All captions also included 2 to 4 specific matching emotions. The captions didn't include any other words. No other descriptions of the subject, physical parts of the face, background, style, or quality. Caption shuffling was used. Prior preservation wasn't. ~10K steps with default LR.</p>
modelVersions.availability: Public
modelVersions.baseModel: SDXL 1.0
modelVersions.downloadUrl: https://civitai.com/api/download/models/679571
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/679571?type=Training%20Data
modelVersions.AutoV1: EE871AC4
modelVersions.AutoV2: 5A5DC23AE2
modelVersions.BLAKE3: 39CE59FFE658976080E1E33CD4D17C40AA48F17F8CA3BB3FD526C088456B99EE
modelVersions.CRC32: E71227C7
modelVersions.SHA256: 5A5DC23AE2F14D6A8C013377585E17C18A856D42515F8506E2BB3745EC23B19E
modelVersions.format: Other
modelVersions.name: 679571_training_data.zip
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-07-28T23:45:53.735Z
modelVersions.type: Training Data
modelVersions.virusScanResult: Success
modelVersions.downloadUrl: https://civitai.com/api/download/models/679571
modelVersions.AutoV1: AFBC94E2
modelVersions.AutoV2: 6DB9D6F075
modelVersions.AutoV3: A9570946518C
modelVersions.BLAKE3: 9BFD594C13C68DAC6DBC1FDC1F741C7829A576D29EF2334894119E277AE0853D
modelVersions.CRC32: 9BE40A7D
modelVersions.SHA256: 6DB9D6F075EAA7F2BA856DF6B159A9B05AD76A671C1C0EF066D496F9D3AA9F0B
modelVersions.format: SafeTensor
modelVersions.name: Emotion_Puppeteer_XL.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-07-30T05:26:26.328Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UCH2D$-:BP^+?X?b.9RQ.ms:=wNH?v%2aKIo
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/38e0ac0a-548f-47ae-8023-3b3f19218cdd/width=450/21972360.jpeg
modelVersions.hash: UPH_iE.79sRk$xxuyDM|tRV[-pt6?^ofRPWB
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/65dc490e-71e1-4155-aea9-9257d94d32d1/width=450/21972753.jpeg
modelVersions.hash: U4EL]FB;01}9*y,:AZ_300Md8w01qFt,8wDj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/cebc8e14-b5b1-4087-97eb-48ad57436e42/width=450/21979603.jpeg
modelVersions.hash: UCI;Ix1N-A}?R5Q-Ip-n04-qo|9u58IpMxWC
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/e8a5e726-fdf1-45e0-9875-557048feea24/width=450/21977823.jpeg
modelVersions.hash: UBHwljSbqD1@-oAVMKVYyAtP.6xYIoxtx@K1
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/71a2f98a-f8af-4a5d-8bb0-51729a47b912/width=450/21987673.jpeg
modelVersions.hash: UNFFNxV=54~WD-odxssqW=V]MxRkxZRkRjoy
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5cc9b42e-07ac-4faa-ae39-f7e430696cd6/width=450/21986278.jpeg
modelVersions.hash: UBEx@d9[0xtefANM9Es%00M~-A-U~URNt9%N
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4f633920-5a8a-490b-8c8f-7d36a43e8382/width=450/21985261.jpeg
modelVersions.name: V1
modelVersions.publishedAt: 2024-07-30T09:14:22.934Z
name: Emotion Puppeteer XL
tags: concept expressions emotions faces face