Waifu-Colorize-XL

Waifu-Colorize-XL is an SDXL-based model specifically designed for colorizing anime-themed images.

Task	Model
Generation	WAI-NSFW-illustrious-SDXL-V14.0-V-Prediction
Inpainting	Waifu-Inpaint-XL
Colorizing	Waifu-Colorize-XL

Overview

Waifu-Colorize-XL is further trained from Waifu-Inpaint-XL, enabling it to colorize grayscale or binarized images.

Model Details

• Developed by: ShinoharaHare
• Model type: Diffusion based image-to-image generative model for colorizing
• Language(s) (NLP): English
• License: CreativeML Open RAIL++-M
• Finetuned from: Waifu-Inpaint-XL

🧨 Diffusers

Grayscale Colorized

import torch
from diffusers import StableDiffusionXLInpaintPipeline
from diffusers.utils import load_image

pipeline = StableDiffusionXLInpaintPipeline.from_pretrained(
  'ShinoharaHare/Waifu-Colorize-XL',
  custom_pipeline='ShinoharaHare/Waifu-Colorize-XL',
  torch_dtype=torch.half
)
pipeline.to('cuda')

grayscale_image = load_image('https://cdn-uploads.huggingface.co/production/uploads/630ed69a31970d1cd4fd575d/ZusF3zcH-auhPgSxY0LKs.png')
prompt = '' # Write you own prompt if you want.

colorized_image = pipeline(
  prompt=prompt,
  image=grayscale_image,
  num_inference_steps=28,
  guidance_scale=5.0 if prompt else 0.0,
  height=grayscale_image.height,
  width=grayscale_image.width
).images[0]

colorized_image.show()