Answers.Body: <p>You better use diffusion, not GAN. Style transfer isn't enough. You need to re-render the entire landscape to animate like TikTok. Use img2img from this repo.</p>
  <pre><code>https://github.com/AUTOMATIC1111/stable-diffusion-webui
  </code></pre>
  <p>If you want a light-weighted model, use this. But you have to manually fine-tune the model into the anime style. I do not recommend using this unless you have a solid ML background</p>
  <pre><code>https://huggingface.co/OFA-Sys/small-stable-diffusion-v0
  </code></pre>
  <p>For the dataset, use the Danbooru dataset.
  Either from here or a small version is available in Hugging Face or use Grabber</p>
  <pre><code>https://gwern.net/danbooru2021#danbooru2020
  https://huggingface.co/datasets/tensorcat/Danbooru-2020-Small
  https://github.com/Bionus/imgbrd-grabber
  </code></pre>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-03-08T03:13:22.307Z
Answers.LastActivityDate: 2024-03-04T05:28:05.417Z
Answers.LastEditDate: 2024-03-04T05:28:05.417Z
Answers.UserDisplayName: Jang
Body: <p>I have a task to build the Tiktok Manga/Anime AI model or the Anime AI model like Snap Edit application.</p>
  <p>I have researched and collected several models on Github, but they still are not good enough, like Tiktok or SnapEdit.
  These are some models on GitHub:</p>
  <ul>
  <li><a href="https://github.com/TalkUHulk/realworld-stylegan2-encoder" rel="nofollow noreferrer">https://github.com/TalkUHulk/realworld-stylegan2-encoder</a></li>
  <li><a href="https://github.com/williamyang1991/DualStyleGAN" rel="nofollow noreferrer">https://github.com/williamyang1991/DualStyleGAN</a></li>
  </ul>
  <p>These models focus on only the face without a background which does not cartoonize the whole image like SnapEdit.
  This is an example:</p>
  <p><a href="https://i.sstatic.net/4oY1b.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/4oY1b.jpg" alt="enter image description here" /></a>
  <a href="https://i.sstatic.net/HJOUl.jpg" rel="nofollow noreferrer"><img src="https://i.sstatic.net/HJOUl.jpg" alt="enter image description here" /></a></p>
  <p>So could you give me some direction to start with this task?</p>
  <p><strong>My idea</strong>: I have plan to do following steps, but I belive that it is so tough and take time.</p>
  <ul>
  <li>Detect each object on the images.</li>
  <li>Replace each object with a similar anime/manga style image -&gt; Need to compare all images.</li>
  <li>Put anime objects back into the image and make them fit with the image.</li>
  <li>Find a similar anime background and replace it too.</li>
  </ul>
  <p>It would lead to a problem about how to build the database with anime style? How to find a similar anime/cartoon image? How to get objects and replace them without blur or weird images?</p>
  <p>Thank you for helping!</p>
  
Tags: <ai-design><image-generation>
Title: Rebuild Tiktok Manga/Anime AI model
UserDisplayName: Truong Hoang
ThreadText: # Rebuild Tiktok Manga/Anime AI model
  
  (Asked by: username_0 on 2023-01-09)
  
  I have a task to build the Tiktok Manga/Anime AI model or the Anime AI model like Snap Edit application.
  
  I have researched and collected several models on Github, but they still are not good enough, like Tiktok or SnapEdit.
  These are some models on GitHub:
  
  * <https://github.com/TalkUHulk/realworld-stylegan2-encoder>
  * <https://github.com/williamyang1991/DualStyleGAN>
  
  These models focus on only the face without a background which does not cartoonize the whole image like SnapEdit.
  This is an example:
  
  [![enter image description here](https://i.sstatic.net/4oY1b.jpg)](https://i.sstatic.net/4oY1b.jpg)
  [![enter image description here](https://i.sstatic.net/HJOUl.jpg)](https://i.sstatic.net/HJOUl.jpg)
  
  So could you give me some direction to start with this task?
  
  **My idea**: I have plan to do following steps, but I belive that it is so tough and take time.
  
  * Detect each object on the images.
  * Replace each object with a similar anime/manga style image -> Need to compare all images.
  * Put anime objects back into the image and make them fit with the image.
  * Find a similar anime background and replace it too.
  
  It would lead to a problem about how to build the database with anime style? How to find a similar anime/cartoon image? How to get objects and replace them without blur or weird images?
  
  Thank you for helping!
  
  **Tags:** ai-design, image-generation
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2023-03-08. Score: 2 | Accepted answer
  
  You better use diffusion, not GAN. Style transfer isn't enough. You need to re-render the entire landscape to animate like TikTok. Use img2img from this repo.
  
  ```
  https://github.com/AUTOMATIC1111/stable-diffusion-webui
  
  ```
  
  If you want a light-weighted model, use this. But you have to manually fine-tune the model into the anime style. I do not recommend using this unless you have a solid ML background
  
  ```
  https://huggingface.co/OFA-Sys/small-stable-diffusion-v0
  
  ```
  
  For the dataset, use the Danbooru dataset.
  Either from here or a small version is available in Hugging Face or use Grabber
  
  ```
  https://gwern.net/danbooru2021#danbooru2020
  https://huggingface.co/datasets/tensorcat/Danbooru-2020-Small
  https://github.com/Bionus/imgbrd-grabber
  
  ```
  
  
  ---
  
  