readme: ---
  language: zh
  license: creativeml-openrail-m
  
  tags:
  - stable-diffusion
  - stable-diffusion-diffusers
  - text-to-image
  - zh
  - Chinese
  - Anime
  
  inference: true
  widget:
  - text: "1个女孩,绿色头发,毛衣,看向阅图者,上半身,帽子,户外,下雪,高领毛衣"
    example_title: 1个女孩
  - text: "单人,看向阅图者,短发,刘海,黑发,1个男孩,眼间刘海"
    example_title: 1个男孩
  
    
  extra_gated_prompt: |-
    One more step before getting this model.
    This model is open access and available to all, with a CreativeML OpenRAIL-M license further specifying rights and usage.
    The CreativeML OpenRAIL License specifies: 
  
    1. You can't use the model to deliberately produce nor share illegal or harmful outputs or content 
    2. IDEA-CCNL claims no rights on the outputs you generate, you are free to use them and are accountable for their use which must not go against the provisions set in the license
    3. You may re-distribute the weights and use the model commercially and/or as a service. If you do, please be aware you have to include the same use restrictions as the ones in the license and share a copy of the CreativeML OpenRAIL-M to all your users (please read the license entirely and carefully)
    Please read the full license here: https://huggingface.co/spaces/CompVis/stable-diffusion-license
    
    By clicking on "Access repository" below, you accept that your *contact information* (email address and username) can be shared with the model authors as well.
  extra_gated_fields:
   I have read the License and agree with its terms: checkbox
  ---
  # Taiyi-Stable-Diffusion-1B-Chinese-v0.1
  
  - Github: [Fengshenbang-LM](https://github.com/IDEA-CCNL/Fengshenbang-LM)
  - Docs: [Fengshenbang-Docs](https://fengshenbang-doc.readthedocs.io/)
  - API：[Fengshen-OpenAPI](https://fengshenbang-lm.com/open-api)
  
  ## 简介 Brief Introduction
  
  首个开源的中文Stable Diffusion动漫模型，基于100万筛选过的动漫中文图文对训练。训练细节可见[开源版二次元生成器！IDEA研究院封神榜团队发布第一个中文动漫Stable Diffussion模型](https://zhuanlan.zhihu.com/p/598766181)，更多text2img案例可见[太乙动漫绘画使用手册1.0](https://docs.qq.com/doc/DUFRMZ25wUFRWaEl0)
  
  The first open source Chinese Stable diffusion Anime model, which was trained on M1 filtered Chinese Anime image-text pairs. See details in [IDEA Research Institute Fengshenbang team released the first opensource Chinese anime Stable Diffussion model](https://zhuanlan.zhihu.com/p/598766181), see more text2img examples in [Taiyi-Anime handbook](https://docs.qq.com/doc/DUFRMZ25wUFRWaEl0)
  
  ## 模型分类 Model Taxonomy
  
  
  | 需求 Demand |     任务 Task     | 系列 Series |    模型 Model    | 参数 Parameter | 额外 Extra |
  | :------------: | :-----------------: | :-----------: | :----------------: | :--------------: | :----------: |
  | 特殊 Special | 多模态 Multimodal | 太乙 Taiyi | Stable Diffusion |       1B       |  Chinese  |
  
  ## 模型信息 Model Information
  
  我们将两份动漫数据集(100万低质量数据和1万高质量数据)，基于[IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1](https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1) 模型进行了两阶段的微调训练，计算开销是4 x A100 训练了大约100小时。该版本只是一个初步的版本，我们将持续优化并开源后续模型，欢迎交流。
  
  We use two anime dataset(1 million low-quality data and 10k high-qualty data) for two-staged training the chinese anime model based our pretrained model [IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1](https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-1B-Chinese-v0.1). It takes 100 hours to train this model based on 4 x A100. This model is a preliminary version and we ~~will~~ update this model continuously and open sourse. Welcome to exchange！
  
  ### Result
  
  首先一个小窍门是善用超分模型给图片质量upup：
  
  The first tip is to make good use of the super resolution model to give the image quality a boost:
  
  比如这个例子：
  ```
  1个女孩,绿眼,棒球帽,金色头发,闭嘴,帽子,看向阅图者,短发,简单背景,单人,上半身,T恤
  Negative prompt: 水彩,漫画,扫描件,简朴的画作,动画截图,3D,像素风,原画,草图,手绘,铅笔
  Steps: 50, Sampler: Euler a, CFG scale: 7, Seed: 3900970600, Size: 512x512, Model hash: 7ab6852a
  ```
  
  生成图片的图片是512 * 512（大小为318kb）：
  ![](result_examples/t-shirt-girl.png)
  
  在webui里面选择extra里的R-ESRGAN 4x+ Anime6B模型对图片质量进行超分：
  ![](result_examples/upscale-model.png)
  
  就可以超分得到2048 * 2048（大小为2.6Mb）的超高清大图，放大两张图片就可以看到清晰的区别，512 * 512的图片一放大就会变糊，2048 * 2048的高清大图就可以一直放大还不模糊：
  ![](result_examples/t-shirt-girl-upscale.png)
  
  以下例子是模型在webui运行获得。
  
  These example are got from an model running on webui.
  
  首先是风格迁移的例子：
  
  Firstly some img2img examples:
  
  ![](result_examples/liuyifei_and_huge.png)
  
  下面则是一些文生图的例子：
  
  The Next are some text2img examples:
  
  | prompt1                                                                              | prompt2                                                                                                              |
  | ----------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------- |
  | 1个男生,帅气,微笑,看着阅图者,简单背景,白皙皮肤,<br />上半身,衬衫,短发,单人        | 1个女孩,绿色头发,毛衣,看向阅图者,上半身,帽子,户外,下雪,高领毛衣                                                   |
  | ![](result_examples/boy.png)                                                      | ![](result_examples/girl.png)                                                        