description: <h1 id="superlora's-experimental-nea96yb14"><strong><span style="color:#be4bdb">S</span><span style="color:#7950f2">u</span><span style="color:#4c6ef5">p</span><span style="color:#228be6">e</span><span style="color:#15aabf">r</span><span style="color:#e64980">LoRA</span></strong><span style="color:#fd7e14">'</span><strong><span style="color:#e64980">s</span><span style="color:#4c6ef5"> </span><span style="color:#868e96">[Experimental]</span></strong></h1><p></p><h3 id="what-is-this-m7sa9e9bm"><strong>What is this?</strong></h3><p>This is a collection of large rank (DIM), large dataset LoRA's which are mostly for testing full-finetuning settings with combined datasets which have been used for individual LoRA's. (see each version notes for lists)</p><p></p><p>Goal is to land on a single dataset and training settings that can</p><ul><li><p>Express all the concepts well in a single checkpoint/lora</p></li><li><p>Improve the base output quality aesthetics and anatomy</p></li></ul><p></p><p>Then I will use that dataset and training settings for new full-finetune models. </p><p></p><h3 id="who-is-this-for-0ssry17uy"><strong>Who is this for?</strong></h3><p>If you enjoy any of the LoRA's datasets included, you might enjoy the combined results of these as well - in testing the individual concepts/characters are also still fairly well respresented so far.</p><p></p><p>These might also be useful to other creators for use in model mixing/finetuning, I've trained on base Pony for compatibility with the largest amount of merge mixes.</p><p></p><h3 id="datasets-0e5jt63pf"><strong>Datasets</strong></h3><p>Datasets included have: </p><ul><li><p>Manual curating of quality and aesthetic tags:</p><ul><li><p><code>masterpiece, best quality, low quality, very aesthetic, aesthetic</code></p></li></ul></li><li><p>Around ~1000 images each</p></li></ul><p></p><p>e.g. this collection of LoRA datasets:</p><ul><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/640161/dog-girl-concepts">Dog Girl Concepts - 犬娘</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/353989/dragon-girl-concepts-pony">Dragon Girl Concepts [Pony]</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/352478/oni-girl-concept-pony">Oni Girl Concept [Pony]</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/586298/bird-girl-concepts-characters-monster-girl-encyclopedia">Bird Girl Concepts - Characters - Monster Girl Encyclopedia - 魔物娘図鑑</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/554006/bioluminescence-concepts-monster-girl-encyclopedia">Bioluminescence Concepts - Monster Girl Encyclopedia - 魔物娘図鑑</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/522765/plant-girl-concepts-monster-girl-encyclopedia">Plant Girl Concepts - Monster Girl Encyclopedia - 魔物娘図鑑</a></p></li></ul><p></p><p><strong><span style="color:rgb(193, 194, 197)">Recommended prompt structure:</span></strong></p><p>Positive prompt:</p><pre><code>{{tags}}
  score_9, score_8_up, score_7_up, score_6_up, absurdres, masterpiece, best quality, very aesthetic</code></pre><p>Negative prompt:</p><pre><code>(worst quality, low quality:1.1), score_4, score_3, score_2, score_1, error, bad anatomy, bad hands, watermark, ugly, distorted, signature</code></pre>
modelVersions.availability: Public
modelVersions.baseModel: Pony
modelVersions.description: <p><strong>Datasets (from existing LoRA's):</strong></p><ul><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/640161/dog-girl-concepts"><u>Dog Girl Concepts - 犬娘</u></a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/353989/dragon-girl-concepts-pony">Dragon Girl Concepts [Pony]</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/352478/oni-girl-concept-pony">Oni Girl Concept [Pony]</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/586298/bird-girl-concepts-characters-monster-girl-encyclopedia">Bird Girl Concepts - Characters - Monster Girl Encyclopedia - 魔物娘図鑑</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/554006/bioluminescence-concepts-monster-girl-encyclopedia">Bioluminescence Concepts - Monster Girl Encyclopedia - 魔物娘図鑑</a></p></li><li><p><a target="_blank" rel="ugc" href="https://civitai.com/models/522765/plant-girl-concepts-monster-girl-encyclopedia">Plant Girl Concepts - Monster Girl Encyclopedia - 魔物娘図鑑</a></p></li></ul><p><strong>Training settings (Kohya):</strong></p><pre><code>{
    "LoRA_type": "Standard",
    "LyCORIS_preset": "full",
    "adaptive_noise_scale": 0,
    "additional_parameters": " --optimizer_args \"decouple=True\" \"weight_decay=0.5\"  \"betas=0.9,0.99\" \"use_bias_correction=False\" --lr_scheduler_type \"CosineAnnealingLR\" --lr_scheduler_args \"T_max=30\"",
    "async_upload": false,
    "block_alphas": "",
    "block_dims": "",
    "block_lr_zero_threshold": "",
    "bucket_no_upscale": true,
    "bucket_reso_steps": 256,
    "bypass_mode": false,
    "cache_latents": true,
    "cache_latents_to_disk": true,
    "caption_dropout_every_n_epochs": 0,
    "caption_dropout_rate": 0,
    "caption_extension": ".txt",
    "clip_skip": 2,
    "color_aug": false,
    "constrain": 0,
    "conv_alpha": 1,
    "conv_block_alphas": "",
    "conv_block_dims": "",
    "conv_dim": 1,
    "dataset_config": "",
    "debiased_estimation_loss": false,
    "decompose_both": false,
    "dim_from_weights": false,
    "dora_wd": false,
    "down_lr_weight": "",
    "dynamo_backend": "no",
    "dynamo_mode": "default",
    "dynamo_use_dynamic": false,
    "dynamo_use_fullgraph": false,
    "enable_bucket": true,
    "epoch": 30,
    "extra_accelerate_launch_args": "",
    "factor": -1,
    "flip_aug": false,
    "fp8_base": false,
    "full_bf16": true,
    "full_fp16": false,
    "gpu_ids": "",
    "gradient_accumulation_steps": 1,
    "gradient_checkpointing": true,
    "huber_c": 0.1,
    "huber_schedule": "snr",
    "huggingface_path_in_repo": "",
    "huggingface_repo_id": "",
    "huggingface_repo_type": "",
    "huggingface_repo_visibility": "",
    "huggingface_token": "",
    "ip_noise_gamma": 0,
    "ip_noise_gamma_random_strength": false,
    "keep_tokens": 0,
    "learning_rate": 1,
    "log_tracker_config": "",
    "log_tracker_name": "",
    "log_with": "",
    "logging_dir": "E:/work/LoRa_work/logging",
    "loss_type": "l2",
    "lr_scheduler": "cosine",
    "lr_scheduler_args": "",
    "lr_scheduler_num_cycles": 1,
    "lr_scheduler_power": 1,
    "lr_warmup": 0,
    "main_process_port": 0,
    "masked_loss": false,
    "max_bucket_reso": 2048,
    "max_data_loader_n_workers": 0,
    "max_grad_norm": 1,
    "max_resolution": "1024,1024",
    "max_timestep": 1000,
    "max_token_length": 225,
    "max_train_epochs": 30,
    "max_train_steps": 0,
    "mem_eff_attn": false,
    "metadata_author": "motimalu",
    "metadata_description": "",
    "metadata_license": "",
    "metadata_tags": "",
    "metadata_title": "",
    "mid_lr_weight": "",
    "min_bucket_reso": 512,
    "min_snr_gamma": 5,
    "min_timestep": 0,
    "mixed_precision": "bf16",
    "model_list": "custom",
    "module_dropout": 0,
    "multi_gpu": false,
    "multires_noise_discount": 0.3,
    "multires_noise_iterations": 6,
    "network_alpha": 128,
    "network_dim": 128,
    "network_dropout": 0,
    "network_weights": "",
    "noise_offset": 0,
    "noise_offset_random_strength": false,
    "noise_offset_type": "Multires",
    "num_cpu_threads_per_process": 2,
    "num_machines": 1,
    "num_processes": 1,
    "optimizer": "Prodigy",
    "optimizer_args": "",
    "output_dir": "D:/model_output",
    "output_name": "monmusu_superlora_v1",
    "persistent_data_loader_workers": false,
    "pretrained_model_name_or_path": "C:/workspace/webui_forge_cu121_torch21/webui/models/Stable-diffusion/ponyDiffusionV6XL_v6StartWithThisOne.safetensors",
    "prior_loss_weight": 1,
    "random_crop": false,
    "rank_dropout": 0,
    "rank_dropout_scale": false,
    "reg_data_dir": "",
    "rescaled": false,
    "resume": "",
    "resume_from_huggingface": "",
    "sample_every_n_epochs": 10,
    "sample_every_n_steps": 0,
    "sample_prompts": "score_9, score_8_up, score_7_up, score_6_up, dragon girl, transparent tail, transparent horns, transparent wings, masterpiece, best quality, very aesthetic",
    "sample_sampler": "euler_a",
    "save_every_n_epochs": 30,
    "save_every_n_steps": 0,
    "save_last_n_steps": 0,
    "save_last_n_steps_state": 0,
    "save_model_as": "safetensors",
    "save_precision": "bf16",
    "save_state": false,
    "save_state_on_train_end": false,
    "save_state_to_huggingface": false,
    "scale_v_pred_loss_like_noise_pred": false,
    "scale_weight_norms": 0,
    "sdxl": true,
    "sdxl_cache_text_encoder_outputs": false,
    "sdxl_no_half_vae": true,
    "seed": 339491249,
    "shuffle_caption": true,
    "stop_text_encoder_training_pct": 0,
    "text_encoder_lr": 1,
    "train_batch_size": 8,
    "train_data_dir": "C:/data/monmusu_datasets",
    "train_norm": false,
    "train_on_input": true,
    "training_comment": "",
    "unet_lr": 1,
    "unit": 1,
    "up_lr_weight": "",
    "use_cp": false,
    "use_scalar": false,
    "use_tucker": false,
    "v2": false,
    "v_parameterization": false,
    "v_pred_like_loss": 0,
    "vae": "",
    "vae_batch_size": 0,
    "wandb_api_key": "",
    "wandb_run_name": "",
    "weighted_captions": false,
    "xformers": "xformers"
  }</code></pre>
modelVersions.downloadUrl: https://civitai.com/api/download/models/745477
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/745477
modelVersions.AutoV1: 94B6DDDE
modelVersions.AutoV2: FF7104F85D
modelVersions.AutoV3: 714D351885DA
modelVersions.BLAKE3: 284AAFB958975471561CAE0FDF8A0C4B6816A166D9252E0FB243C00A4DB98955
modelVersions.CRC32: 416BD4EF
modelVersions.SHA256: FF7104F85D4C46098B7ECCBA2AECC1363EE77E4B0A6A829C8599D9E7BDC6C16C
modelVersions.format: SafeTensor
modelVersions.name: monmusu_superlora_v1.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-08-20T08:53:03.233Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UGGcAO~38wRi?Issi_ogJ5R.XltQIVIpI[M}
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/68ec552f-00c1-4662-a85c-fa2be027a6d7/width=450/25241575.jpeg
modelVersions.hash: U6DdIk%3009s|=?b8w8^qu%LNaJV?uRkKkMx
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b609afea-8537-4fec-93cf-2bfd20c32ecc/width=450/25241853.jpeg
modelVersions.hash: UQKKf@%f0f%z0z%#%gNap{oz$gV@%#kqR5xa
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4f560387-e37f-45f9-a473-205c42f9c69b/width=450/25241880.jpeg
modelVersions.hash: UMIq[S9F4:x]}@%LAHW?KQaww{W?.7xFITIB
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a1ec5634-cf06-4bb0-8986-c5a7121e73a0/width=450/25241914.jpeg
modelVersions.hash: UKE:oB_M0h0f.mMxj?%LEkRP-5xvTygOXTWA
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b79b41c2-f1a6-49fe-bf90-70cd0098bbee/width=450/25241952.jpeg
modelVersions.hash: UHFF]pR60Y%N.SxWIoK6Kjx^~TcFp_Mx%x%0
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f976415e-202e-4693-8f9e-380ffa83f572/width=450/25242016.jpeg
modelVersions.hash: UDF$?{?X0d.8DB9H9[-p01o}vpiwyW-V~Tti
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5b2be31e-812b-4154-af30-76983364fd0c/width=450/25242027.jpeg
modelVersions.hash: UCBXsGv^000?5ARj#4-;00XT_M#i.9oxo{Dj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/65f71ce3-7702-4239-9b47-287e90056909/width=450/25242050.jpeg
modelVersions.hash: UEHn~S~U00E$044;NwD*ys%f?H%20h9aZ$-V
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/c3110d83-9dae-4617-a7f7-38bd4ead3cbc/width=450/25242070.jpeg
modelVersions.name: Monmusu v1.0 [Pony]
modelVersions.publishedAt: 2024-08-20T08:49:55.546Z
name: Finetuning Superloras
tags: anime concept monster girl